Open Source Cloud Authors: Pat Romanski, Elizabeth White, Liz McMillan, Yeshim Deniz, Zakia Bouachraoui

Related Topics: @DevOpsSummit, Open Source Cloud

@DevOpsSummit: Article

Hidden Costs of Open Source By @HoardingInfo | @DevOpsSummit [#DevOps]

Open source projects allow us to adopt technology without a lot of hoops

by Chris Riley

Open source projects allow us to adopt technology without a lot of hoops.  We get to leverage a strong community base, and potentially support the growing group committed to building even better solutions, which can have the added benefit of notoriety. But there is one problem - open source is not as it seems. While it might appear free to begin with, it does come with cost down the road in real dollars, pain, risk, and time.

hidden-costs-of-open-source Many companies are open-source first. Where every new challenge is faced with the question, "is there an open source tool to help us?" This is driven by the notion of free support for the dev community and the interest in speed of adoption. And often, their love is rooted in the original spirit of open source which is not the dominant driving force today.

There are three types of open-source technologies:

  1. Community Drive: These types of projects are usually fairly small. They are originally created by one or two individuals and often as part of an asset from a larger and existing code base. The projects are shared over GitHub, and contribution is almost always done by the original creators as they see fit. While there are some larger projects of this sort, the large ones usually evolve into a commercial interest-driven one. The pros of these types of projects are that they are the only ones that keep the spirit of the early days of open source alive. They are pure and free. The cons are you cannot trust that they will ever be updated or maintained. The original creators' interest in continuing the project is usually predicated on their use of the code themselves. Their driver is not tied directly to the growth of the project like others described below. Which means unless you fork the code, and keep it as your own, never reverting back or expecting anything from the original project, you are good.
  2. Commercial Interest Driven: This is the most popular type of open source project. And while many developers may know there is a strong commercial backing for them, they are not fully aware of the motives. Examples of such projects are orchestration tools, NoSQL DBs, enterprise search tools, release automation, and so on. Commercial interest means that there is a larger company who has eaten the effort and actual cost of creating the original code base. They have the ability to rally a large community, and an impressive set of contributors. These are the larger, more commonly used open source tools by the developer community. But they are a little sneaky. One or more of the primary committers will work for the commercial entity.  Many of the feature request will come from the commercial interest itself. They know that as much as  90% of the user base will never pay them. But  they leverage the enterprise driver to have clear support and stability in their vendor. So their hope via some great events around the technology, and sniffing around the user base, is that the cream will rise to the top and purchase an "enterprise" version, commercial support, or professional services to support a company's use of the product. For the smaller developers they get to reap the benefits, although there are some risks stated below.
  3. Consumer Enterprise Driven: This one is very interesting. Companies like PayPal, Etsy, Netflix, Facebook are releasing very large open source projects. Some, like Netflix even have their own microsites around the projects and have a small full time staff to support their growth in addition to internal committers. All the code is developed in-house usually, but there are times when outside committers are allowed. Why do they do it? One very simple reason - talent. By giving goodwill to community it makes it a lot easier to entice top tier developers. As simple as that. The pros of such tools is they are validated at high volume. That is also the con, they are just not right for all applications, especially small ones.

The Hidden Costs

  1. It could disappear in the blink of an eye. Especially for the first type, they could disappear instantly. And for the consumer enterprise open source projects, they also could move on quickly and let the projects die on the vine as they replace old code bases with brand new approaches. Just look at how Google and Facebook have burned through programming languages, file systems, databases, etc. As for commercial interest open source, there is a strong backing and they will remain as long as the company survives.
  2. Features could get stripped. There might be a driver for the commercial interest open source solutions to strip down their project; they often do this to encourage more adoption of the enterprise solutions. There is even a trend to create a middle tier professional offering for smaller companies.
  3. Not built for you. Many are not general enough to be used in projects without a lot of additional effort. And this effort just may not be worth it. This is most commonly true with the consumer enterprise projects; the solutions were built specifically for them, and not generalized for the public as the commercial interest ones are.

The constant across all of these is the unknown and instability of the solution.

The reality is, to really dive into an open-source project you will likely have to settle with a commercial interest one. You probably will be blindsided at some point by the need to "upgrade" in addition to your overall, sometimes ignored, costs. These include adaptation of the tool for you, and security planning. Often these hidden costs are higher than if a commercial solution was purchased. And if it is a cloud solution, the cost difference could be equivalent to the days of licensing enterprise software (CAPEX) compared to cloud competitors (OPEX) which can be a savings many times over.

Open source is a powerful tool, and no comprehensive development environment will be without some valuable open source components. The key is knowing that there often is a motive, and even when there isn't, there will always be a trade off and some hidden costs. The idea is that you are deliberate about adopting open source, and not adopting just because it is easy. And you should always compare the open source tool with a commercial pay for alternative, in order to better decide and weigh the costs. You might be surprised to find that the paid offering is a clear winner.

More Stories By Trevor Parsons

Trevor Parsons is Chief Scientist and Co-founder of Logentries. Trevor has over 10 years experience in enterprise software and, in particular, has specialized in developing enterprise monitoring and performance tools for distributed systems. He is also a research fellow at the Performance Engineering Lab Research Group and was formerly a Scientist at the IBM Center for Advanced Studies. Trevor holds a PhD from University College Dublin, Ireland.

IoT & Smart Cities Stories
All in Mobile is a place where we continually maximize their impact by fostering understanding, empathy, insights, creativity and joy. They believe that a truly useful and desirable mobile app doesn't need the brightest idea or the most advanced technology. A great product begins with understanding people. It's easy to think that customers will love your app, but can you justify it? They make sure your final app is something that users truly want and need. The only way to do this is by ...
Digital Transformation and Disruption, Amazon Style - What You Can Learn. Chris Kocher is a co-founder of Grey Heron, a management and strategic marketing consulting firm. He has 25+ years in both strategic and hands-on operating experience helping executives and investors build revenues and shareholder value. He has consulted with over 130 companies on innovating with new business models, product strategies and monetization. Chris has held management positions at HP and Symantec in addition to ...
DXWorldEXPO LLC announced today that Big Data Federation to Exhibit at the 22nd International CloudEXPO, colocated with DevOpsSUMMIT and DXWorldEXPO, November 12-13, 2018 in New York City. Big Data Federation, Inc. develops and applies artificial intelligence to predict financial and economic events that matter. The company uncovers patterns and precise drivers of performance and outcomes with the aid of machine-learning algorithms, big data, and fundamental analysis. Their products are deployed...
Dynatrace is an application performance management software company with products for the information technology departments and digital business owners of medium and large businesses. Building the Future of Monitoring with Artificial Intelligence. Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more busine...
The challenges of aggregating data from consumer-oriented devices, such as wearable technologies and smart thermostats, are fairly well-understood. However, there are a new set of challenges for IoT devices that generate megabytes or gigabytes of data per second. Certainly, the infrastructure will have to change, as those volumes of data will likely overwhelm the available bandwidth for aggregating the data into a central repository. Ochandarena discusses a whole new way to think about your next...
CloudEXPO | DevOpsSUMMIT | DXWorldEXPO are the world's most influential, independent events where Cloud Computing was coined and where technology buyers and vendors meet to experience and discuss the big picture of Digital Transformation and all of the strategies, tactics, and tools they need to realize their goals. Sponsors of DXWorldEXPO | CloudEXPO benefit from unmatched branding, profile building and lead generation opportunities.
Cell networks have the advantage of long-range communications, reaching an estimated 90% of the world. But cell networks such as 2G, 3G and LTE consume lots of power and were designed for connecting people. They are not optimized for low- or battery-powered devices or for IoT applications with infrequently transmitted data. Cell IoT modules that support narrow-band IoT and 4G cell networks will enable cell connectivity, device management, and app enablement for low-power wide-area network IoT. B...
The hierarchical architecture that distributes "compute" within the network specially at the edge can enable new services by harnessing emerging technologies. But Edge-Compute comes at increased cost that needs to be managed and potentially augmented by creative architecture solutions as there will always a catching-up with the capacity demands. Processing power in smartphones has enhanced YoY and there is increasingly spare compute capacity that can be potentially pooled. Uber has successfully ...
SYS-CON Events announced today that CrowdReviews.com has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5–7, 2018, at the Javits Center in New York City, NY. CrowdReviews.com is a transparent online platform for determining which products and services are the best based on the opinion of the crowd. The crowd consists of Internet users that have experienced products and services first-hand and have an interest in letting other potential buye...
When talking IoT we often focus on the devices, the sensors, the hardware itself. The new smart appliances, the new smart or self-driving cars (which are amalgamations of many ‘things'). When we are looking at the world of IoT, we should take a step back, look at the big picture. What value are these devices providing. IoT is not about the devices, its about the data consumed and generated. The devices are tools, mechanisms, conduits. This paper discusses the considerations when dealing with the...