Welcome!

Open Source Authors: Pat Romanski, Liz McMillan, Elizabeth White, Trevor Parsons, Lori MacVittie

Related Topics: SOA & WOA, AJAX & REA

SOA & WOA: Article

Amazon - The Real Web Services Company

Not only Amazon is the real Web Services company now, it is becoming an icon for the 21st century software tools company

I am biased writing this article because my company is a big user of Amazon Web Services. But please read on and see why I am so excited about what the largest online retailer is doing these days. Not only Amazon is the real Web Services company now, it is becoming an icon for the 21st century software tools company. Not Microsoft, not IBM not even Google, but Amazon has been quietly, and recently not so quietly, building the blocks of the next generation software platform.

At the core of the Amazon strategy are the Web Services. The Amazon team takes the concepts of search, storage, lookup and management the data and turns them into pay-per-fetch and pay-per-space web services. This is a brilliant strategy and Amazon is certainly a visionary company. But what impresses me the most as an engineer is their ability to take very complex problems, solve them and then shrink wrap their solutions with a simple and elegant API. 

At the core of the Amazon strategy are the Web Services. The Amazon team takes the concepts of search, storage, lookup and management the data and turns them into pay-per-fetch and pay-per-space web services. This is a brilliant strategy and Amazon is certainly a visionary company. But what impresses me the most as an engineer is their ability to take very complex problems, solve them and then shrink wrap their solutions with a simple and elegant API. 

At the core of the Amazon strategy are the Web Services. The Amazon team takes the concepts of search, storage, lookup and management the data and turns them into pay-per-fetch and pay-per-space web services. This is a brilliant strategy and Amazon is certainly a visionary company. But what impresses me the most as an engineer is their ability to take very complex problems, solve them and then shrink wrap their solutions with a simple and elegant API. 

The current line up
One look at the stack above is enough to realize that Amazon is very serious about becoming a software company and monetizing both their expertise and vast amount of information that they accumulate in the last decade. But with the second look you will realize that they are doing it in a very systematic way. They take an area like messaging, search or storage and ask: What does it take to virtualize it in a way that entire world can consume? Then they build one or more services that can  collectively or individually address the problem.

The Amazon teams is very conscious about making the services minimalistic, fine-grained and interoperable. And this works out great from both technical and business perspective. Because each service is decoupled, it can be build and maintained by different teams and can play well with other services as just a building block. Its great from the business perspective too, because the pricing model around bandwidth and disk space leads to separation of services in order to maximize the revenue.

Eat your own dog food
Perhaps the most admirable thing about the Amazon efforts is that they are productizing their own infrastructure. It may not be widely known, but Amazon.com itself runs on all these services. The blocks that comprise the biggest store on Earth are servicing each other! For example, the site relies on eCommerce service and the Simple Storage Service.

The lack of the real customer feedback is a notorious problem in software engineering. The gap between the what software engineer thinks is useful and what the real customers want is a lot of times just hard to bridge. And how do you solve this problem for something like Amazon Web Services? Amazon's answer - turn ½ of the company to be the customers of the other half. This 'eat your own dog motto' forces the Web Services strategy on the success path. Failure is just simply not an option, since it is going to undermine the operations of the main business.

The eCommerce solutions
The eCommerce layer was the first layer that Amazon build. Here we see a pure information play, where the web giant is exposing a huge amount of information for people to develop a wide range of services. Except for the eCommerce service itself other services in this layer are not free. But eCommerce service is a good freebie to Amazon since in the end of the day it drives all the traffic back to the site.

There are quite a few applications using this service now. Success stories mentioned on Amazon web site include Inside C ,  Action Engine and Associate-O-Matic. The Web 2.0 community also dipped into this service. One of the more interesting examples is TheRightCart, which uses the service to fuel web-wide social shopping. For geeks, there is  Amazon CLI, which provides command line interface to the entire Amazon store. At adaptiveblue, we also use the eCommerce API to dynamically lookup information when user highlights a title of the object on a page.

A common theme that runs among all these solutions is that they ultimately drive the traffic back to Amazon, making money for Amazon, for the companies and also enabling better online experience for the end users.

Messaging and Storage Solutions
As the web turns into an operating system we see the emergence of the infrastructural elements analogous to what we have seen in the real operating systems and middleware. I have previously written an article in this magazine about the groundbreaking Amazon Simple Storage Service. This service is in essence a virtual hashtable for storing massive amounts of information based on key-value schema. With this service, Amazon opens up years of expertise in large-scale data management and enables new breed of applications – smart, thick client solutions that do not need to worry about storage.

And with the Simple Queue Service Amazon ventures into the middleware territory. This service enables developers to post and read messages from queues, facilitating simple communication mechanism between applications. The service is again, another example of Amazon strategy to  productize a piece of their own infrastructure as a Web Service. There are no success stories on the site at this time, because people are probably still a bit scared and skeptical. But it is very likely that this very service is used a lot internally within Amazon. And I bet as time goes and the paradigm shift takes place, we will see more and more users.

Search Solutions
With Google being a distant front runner in the search space other web giants are racing to catch up. Amazon's answer? A vertical search engine platform. Again another clever move that has not been acknowledged widely.

The vertical search engines promise to dethrone Google be delivering a better quality results. Amazon's approach – combat Google by making it simple to build the vertical search applications. The two examples: Camera Image search is a digital camera search engine and Zip File search,just scratch the tip of the iceberg of what is possible with this innovative service.

Conclusion
We are witnessing an amazing play in Web Services space. Amazon is becoming a software company by productizing their own infrastructure. They are carefully mapping out the architecture, but also moving very rapidly, recognizing that competition will be coming soon. In my option they now have a pretty good head start and it will be difficult for other to catch up. So watch out Google!

Even if you can not use the Amazon web services in your business today, you should take time to take a look at this innovation. The Amazon services give us a glimpse of what software will become. It is worth while to think about it, to understand the building blocks and simply to learn.

More Stories By Alex Iskold

Alex Iskold is the Founder and CEO of adaptiveblue (http://www.adaptiveblue.com), where he is developing browser personalization technology. His previous startup, Information Laboratory, created innovative software analysis and visualization tool called Small Worlds. After Information Laboratory was acquired by IBM, Alex worked as the architect of IBM Rational Software Analysis tools. Before starting adaptiveblue, Alex was the Chief Architect at DataSynapse, where he developed GridServer and FabricServer virtualization platforms. He holds M.S. in Computer Science from New York University, where he taught an award-winning software engineering class for undergraduate students. He can be reached at [email protected]

Comments (2) View Comments

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


Most Recent Comments
Web 2.0 News Desk 08/17/06 03:48:02 PM EDT

I am biased writing this article because my company is a big user of Amazon Web Services. But please read on and see why I am so excited about what the largest online retailer is doing these days. Not only Amazon is the real Web Services company now, it is becoming an icon for the 21st century software tools company. Not Microsoft, not IBM not even Google, but Amazon has been quietly, and recently not so quietly, building the blocks of the next generation software platform.

Web 2.0 News Desk 08/17/06 03:34:34 PM EDT

I am biased writing this article because my company is a big user of Amazon Web Services. But please read on and see why I am so excited about what the largest online retailer is doing these days. Not only Amazon is the real Web Services company now, it is becoming an icon for the 21st century software tools company. Not Microsoft, not IBM not even Google, but Amazon has been quietly, and recently not so quietly, building the blocks of the next generation software platform.

@ThingsExpo Stories
There's no doubt that the Internet of Things is driving the next wave of innovation. Google has spent billions over the past few months vacuuming up companies that specialize in smart appliances and machine learning. Already, Philips light bulbs, Audi automobiles, and Samsung washers and dryers can communicate with and be controlled from mobile devices. To take advantage of the opportunities the Internet of Things brings to your business, you'll want to start preparing now.
SYS-CON Events announced today that Gridstore™, the leader in hyper-converged infrastructure purpose-built to optimize Microsoft workloads, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Gridstore™ is the leader in hyper-converged infrastructure purpose-built for Microsoft workloads and designed to accelerate applications in virtualized environments. Gridstore’s hyper-converged infrastructure is the industry’s first all flash version of HyperConverged Appliances that include both compute and storag...
SYS-CON Events announced today that Windstream, a leading provider of advanced network and cloud communications, has been named “Silver Sponsor” of SYS-CON's 16th International Cloud Expo®, which will take place on June 9–11, 2015, at the Javits Center in New York, NY. Windstream (Nasdaq: WIN), a FORTUNE 500 and S&P 500 company, is a leading provider of advanced network communications, including cloud computing and managed services, to businesses nationwide. The company also offers broadband, phone and digital TV services to consumers primarily in rural areas.
Can call centers hang up the phones for good? Intuitive Solutions did. WebRTC enabled this contact center provider to eliminate antiquated telephony and desktop phone infrastructure with a pure web-based solution, allowing them to expand beyond brick-and-mortar confines to a home-based agent model. It also ensured scalability and better service for customers, including MUY! Companies, one of the country's largest franchise restaurant companies with 232 Pizza Hut locations. This is one example of WebRTC adoption today, but the potential is limitless when powered by IoT.
The recent trends like cloud computing, social, mobile and Internet of Things are forcing enterprises to modernize in order to compete in the competitive globalized markets. However, enterprises are approaching newer technologies with a more silo-ed way, gaining only sub optimal benefits. The Modern Enterprise model is presented as a newer way to think of enterprise IT, which takes a more holistic approach to embracing modern technologies.
The cloud is now a fact of life but generating recurring revenues that are driven by solutions and services on a consumption model have been hard to implement, until now. In their session at 16th Cloud Expo, Ermanno Bonifazi, CEO & Founder of Solgenia, and Ian Khan, Global Strategic Positioning & Brand Manager at Solgenia, will discuss how a top European telco has leveraged the innovative recurring revenue generating capability of the consumption cloud to enable a unique cloud monetization model to drive results.
The Internet of Everything (IoE) brings together people, process, data and things to make networked connections more relevant and valuable than ever before – transforming information into knowledge and knowledge into wisdom. IoE creates new capabilities, richer experiences, and unprecedented opportunities to improve business and government operations, decision making and mission support capabilities. In his session at @ThingsExpo, Gary Hall, Chief Technology Officer, Federal Defense at Cisco Systems, will break down the core capabilities of IoT in multiple settings and expand upon IoE for bo...
“With easy-to-use SDKs for Atmel’s platforms, IoT developers can now reap the benefits of realtime communication, and bypass the security pitfalls and configuration complexities that put IoT deployments at risk,” said Todd Greene, founder & CEO of PubNub. PubNub will team with Atmel at CES 2015 to launch full SDK support for Atmel’s MCU, MPU, and Wireless SoC platforms. Atmel developers now have access to PubNub’s secure Publish/Subscribe messaging with guaranteed ¼ second latencies across PubNub’s 14 global points-of-presence. PubNub delivers secure communication through firewalls, proxy ser...
The 16th International Cloud Expo has announced that its Call for Papers is open until February 28, 2015. 16th International Cloud Expo, to be held June 9-11, 2015, at the Javits Center in New York City brings together Cloud Computing, APM, APIs, Security, Big Data, Internet of Things, DevOps and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportunity. Submit your speaking proposal today!
An entirely new security model is needed for the Internet of Things, or is it? Can we save some old and tested controls for this new and different environment? In his session at @ThingsExpo, New York's at the Javits Center, Davi Ottenheimer, EMC Senior Director of Trust, reviewed hands-on lessons with IoT devices and reveal a new risk balance you might not expect. Davi Ottenheimer, EMC Senior Director of Trust, has more than nineteen years' experience managing global security operations and assessments, including a decade of leading incident response and digital forensics. He is co-author of t...
To many people, IoT is a buzzword whose value is not understood. Many people think IoT is all about wearables and home automation. In his session at @ThingsExpo, Mike Kavis, Vice President & Principal Cloud Architect at Cloud Technology Partners, will discuss some incredible game-changing use cases and how they are transforming industries like agriculture, manufacturing, health care, and smart cities. He will discuss cool technologies like smart dust, robotics, smart labels, and much more. Prepare to be blown away with a glimpse of the future.
SYS-CON Events announced today that On the Avenue Marketing Group, a sales and marketing firm that utilizes events to market and sell products to consumers, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. On the Avenue Marketing Group (OTA) is a sales and marketing firm that utilizes events to market and sell products to consumers. On behalf of our clients, we attend thousands of fairs, festivals, expos, concerts, conferences, and sporting events annually, helping them reach millions of individuals ...
The true value of the Internet of Things (IoT) lies not just in the data, but through the services that protect the data, perform the analysis and present findings in a usable way. With many IoT elements rooted in traditional IT components, Big Data and IoT isn’t just a play for enterprise. In fact, the IoT presents SMBs with the prospect of launching entirely new activities and exploring innovative areas. CompTIA research identifies several areas where IoT is expected to have the greatest impact.
Technology is enabling a new approach to collecting and using data. This approach, commonly referred to as the "Internet of Things" (IoT), enables businesses to use real-time data from all sorts of things including machines, devices and sensors to make better decisions, improve customer service, and lower the risk in the creation of new revenue opportunities. In his General Session at Internet of @ThingsExpo, Dave Wagstaff, Vice President and Chief Architect at BSQUARE Corporation, discuss the real benefits to focus on, how to understand the requirements of a successful solution, the flow of ...
Cloud Expo 2014 TV commercials will feature @ThingsExpo, which was launched in June, 2014 at New York City's Javits Center as the largest 'Internet of Things' event in the world.
Cultural, regulatory, environmental, political and economic (CREPE) conditions over the past decade are creating cross-industry solution spaces that require processes and technologies from both the Internet of Things (IoT), and Data Management and Analytics (DMA). These solution spaces are evolving into Sensor Analytics Ecosystems (SAE) that represent significant new opportunities for organizations of all types. Public Utilities throughout the world, providing electricity, natural gas and water, are pursuing SmartGrid initiatives that represent one of the more mature examples of SAE. We have s...
Since 2008 and for the first time in history, more than half of humans live in urban areas, urging cities to become “smart.” Today, cities can leverage the wide availability of smartphones combined with new technologies such as Beacons or NFC to connect their urban furniture and environment to create citizen-first services that improve transportation, way-finding and information delivery. In her session at @ThingsExpo, Laetitia Gazel-Anthoine, CEO of Connecthings, will focus on successful use cases.
Analytics is the foundation of smart data and now, with the ability to run Hadoop directly on smart storage systems like Cloudian HyperStore, enterprises will gain huge business advantages in terms of scalability, efficiency and cost savings as they move closer to realizing the potential of the Internet of Things. In his session at 16th Cloud Expo, Paul Turner, technology evangelist and CMO at Cloudian, Inc., will discuss the revolutionary notion that the storage world is transitioning from mere Big Data to smart data. He will argue that today’s hybrid cloud storage solutions, with commodity...
There is no doubt that Big Data is here and getting bigger every day. Building a Big Data infrastructure today is no easy task. There are an enormous number of choices for database engines and technologies. To make things even more challenging, requirements are getting more sophisticated, and the standard paradigm of supporting historical analytics queries is often just one facet of what is needed. As Big Data growth continues, organizations are demanding real-time access to data, allowing immediate and actionable interpretation of events as they happen. Another aspect concerns how to deliver ...
The 3rd International Internet of @ThingsExpo, co-located with the 16th International Cloud Expo - to be held June 9-11, 2015, at the Javits Center in New York City, NY - announces that its Call for Papers is open until February 28, 2015. The Internet of Things (IoT) is the biggest idea since the creation of the Worldwide Web more than 20 years ago.