For many, the words open source conjures up concepts of hippy idealism where geeks in a spirit of free love give away their work to others for nothing. For many, it’s about as anti-capitalist as you can get.
Those many are as gullible as the citizens of Ancient Troy.
Open source is one of the deadliest weapons in the arsenal of any experienced strategist. It can be used to remove barriers to entry into an opponent’s business, to encourage standardization around your practice creating a cost of transition for opponents, and it can be used to develop ecosystems to strengthen your position as part of a land grab for new sources of value or even as a source of recruitment of talent.
Whilst customers delight in the benefits that open source brings, for a vendor the successful application of an open source approach by a competitor can be fatal.
But really … are technology companies that smart?
Take Facebook’s open compute project, which in effect open sources the design of large-scale data centres. You might view this as a generous act by Facebook to encourage and enable efficiency in the hosting business. The benefits for customers and those in the business of providing data centres could be significant. Bravo, Facebook.
But wait, isn’t the ability to operate and maintain efficiently large-scale data centres a barrier to entry into Google‘s search business? Facebook wouldn’t be presenting this gift in the hope of undermining Google’s position … would it?
Take Google’s open source Android project that in effect provides device manufacturers with the software necessary to compete with Apple and IOS. You might view this as a generous act by Google.
But wait, wasn’t IOS and the devices Apple builds a threat to Google’s value chain around data? Has Google created a competing ecosystem to Apple in order to protect itself? Google wouldn’t be presenting this gift in the hope of undermining Apple’s position … would it?
There is a long list of open source projects that on the surface seem generous acts of kindness – a beautifully presented wooden horse. What are often hidden inside are the competitive machinations between companies. Open source is a deadly serious business and those who exclude this tool from their arsenal put themselves at a considerable strategic weakness.
As someone who spent several years developing strategy for the large and rapidly growing open source operating system, Ubuntu, you can bet your bottom dollar people think very carefully in these terms.
The latest arena where open source is being deployed is in the infrastructure layer of the cloud computing stack. For me, this represents a bit of personal journey … to explain I’ll start at the beginning of my involvement.
Back in 2005, I was running a subsidiary of Canon providing software systems throughout the group. I had given a talk at a conference in the previous year on the commoditization of IT activities and how our industry was changing. We were building such a system within the company and we had visions of a worldwide ‘grid’ of utility computing providers.
The idea of providing computing as a utility and the analogy to electricity dates back to Parkhill’s visionary 1966 book. Hence, this obviously wasn’t new in 2004. We understood the cycle of economic change and how once innovative activities (such as electricity or a thousand other business activities) then evolve to become ubiquitous, well defined and more like a commodity. We understood that each time this happened it caused an explosion of growth of new, higher order industries.
We were well armed, we understood the principles, we knew we didn’t need to fear the incumbents because of their inertia – but we needed an edge. It didn’t take long to find it but I’ll come to that soon.
In early 2006, we launched ‘Zimki’ – the world’s first dedicated platform as a service enabling others to build applications. Of course, we didn’t call it a platform as a service – the term hadn’t been invented back then. The service was provided as a utility and contained all the basics a platform should offer. It was designed to make it easy for anyone to build entire applications by removing all the unnecessary muck of worrying about installing machines, configuring systems and so on. You simply wrote code and launched.
The resultant speed of development was revolutionary. As Zimki grew, Amazon entered the fray with EC2 and we were joyful with the validation of the market. We looked like we had a potential but imperfectly formed winner in our small Canon subsidiary. We also had our edge – our secret weapon.
We understood that customers would have inertia through concerns over governance, transparency and lock-in. Some of these we could tackle with education but for others, we needed to remove the fear. Hence, in late 2006, we announced that we were open sourcing the entire platform. We were going to enable competitors and customers to build their own Zimki environments. We were going to create a competitive market of utility providers with an open source system at the heart of it.
One strategist told me I was “mad” to give away this advantage. However, our eyes were on bigger prizes. Yes, we would have a small piece of a larger pie but we were looking further up the value chain to capture the exchange, the assurance and the switching services that such a market creates.
We had our secret weapon, we knew the big prizes, we could deal with customer inertia by creating a competitive market, we were rapidly growing, we were a profitable company, we were at the vanguard of a new industry in early 2007 … we had everything. What could possibly go wrong?
Alas, I made a mistake and didn’t counter the internal politics and build the right sort of internal alliances. As a result, when the parent company focused on outsourcing IT, I didn’t have the political capital to counter.
Despite this failure, the game plan itself was sound. So, when I started to run Cloud strategy for Canonical (the providers of Ubuntu), my focus was on using open source to both solve lock-in issues and make a land grab whilst co-opting Amazon’s growing ecosystem.
It was this search that brought us to Eucalyptus – a start-up providing open source technology to create an equivalent of Amazon’s cloud.
Unfortunately this game is always full of twist and turns. Eucalyptus was our anointed target to dominate this space but they soon embarked on an open core route mixing both open and proprietary elements. Despite its uptake and the growth of Ubuntu, the lack of a strong open source community raised concerns.
At that time, one of my colleagues had moved to Rackspace where he was instrumental in Rackspace and NASA’s own open source play – OpenStack. Their approach was clearer – an open source equivalent of Amazon … what could go wrong?
Unfortunately, for reasons which today are still unfathomable, OpenStack appeared to focus on competing rather than co-opting what had become the de facto standard of the industry, namely the Amazon Cloud APIs of EC2 and S3.
The screw then recently turned again.
With the failure of OpenStack to capture the space combined with a new highly experienced open source CEO at Eucalyptus, there has been a flurry of recent announcements including a partnership with Amazon to ensure fidelity of Eucalyptus’ APIs with Amazon’s.
Hence, on one hand we have the EC2/S3 equivalent cloud that isn’t quite open sourced (yet), and on the other hand, the entirely open sourced cloud that isn’t quite an EC2/S3 equivalent (yet).
What a pickle.
An unkind observer would comment that Eucalyptus has built its wooden horse but debates over who pays for what whilst OpenStack can’t quite decide whether it wants a wooden horse or a wooden cow? The Trojans can sleep quite soundly.
Except, Citrix has today rolled out onto the battlefield a bright shiny wooden horse packed full of soldiers. It’s an obvious move but the point is that Citrix has now done it.
Citrix has taken CloudStack – a technology used by many companies for building infrastructure clouds – and entirely open sourced it under the Apache foundation. They’ve announced significant funding for the project and openly discussed fidelity with the Amazon EC2 and S3 APIs. They have a list of supporting companies to make you gasp.
For us customers, one way or another we’re increasingly heading towards a future of competitive utility computing markets based around open source systems providing the de facto APIs of Amazon.
Will it be CloudStack, Eucalyptus or OpenStack? That depends upon what moves they play next.
However, for competitors in this space, if you’re not wary of Geeks bearing gifts, you should be.
--- 12th June 2015
Well, the screw turned again and again.
Eucalyptus ended up being purchased by HP and OpenStack has all the flurry and noise of victory without the install base combined with a collective prisoner dilemma. CloudStack seems to be in the long game. For the time being, AWS has walked away with the prize.
There are potential threats to Amazon's dominance in IaaS on the horizon such as Alibaba along with other smaller environments such as Google compute engine and Azure. However, in practice we're into the long haul for open source to win back the space. We didn't have to be here but that's where we find ourselves.
The game itself has now moved up the stack into the platform space with CloudFoundry making a pretty decent open source play. Let us hope they avoid all the errors that lead to a collective prisoner dilemma (e.g. encouraging differentiation on features rather than operations) or failing to act as a decent gardener of their ecosystem (i.e. Pivotal trying to capture all the space or failing to understand the importance of others making value or failing to work effectively with others due to own interests). They've got a good team but you never know ... never underestimate the damage that some out of their depth Exec / MBA could do to a good strategic play.
Beyond platforms then confusion reigns with containers becoming the new "paradigm" shift of marketing enabling a future platform of ... oh, it's pitiful. Containers are a great subsystem but unless your goal is causing endless sprawl in enterprises then many of the approaches seem half baked and doomed to repeat the lessons of past failure.
These days I've moved on from mechanisms of strategic play (e.g. situational awareness, open source, use of ecosystems) and basic economic patterns (e.g. weak signal detection, evolution of organisations) and I'm focused on competition between nations. I occasionally take a peek at what is going on in the cloud world. It's often rather depressing to discover a breed of self proclaimed thought leaders / consultants discovering basic concepts like componentisation & inertia along with economic principles such as Jevons' paradox or punctuated equilibriums all over again.
I'm glad I retired from cloud back in 2010 after five years. I don't think I could have coped with a constant rediscovery of existing stuff. The allure of financial riches was there (the same when I worked for a market maker on LIFFE) but I have the constant need to move on and to discover new possibilities.
The good news is we're entering a really interesting time with multiple points of industrialisation (big data, sensor as a service, robotics, currency, immersive tech, 3D printing, genetic engineering etc) looming over the next 15 years. In particular 2025-2030 is looking likely to become a peak time of wonder across multiple fields ... endless possibilities of recombination and genesis. This is all very exciting.
You never know by 2030, open source efforts in the IaaS space might have clawed back their position but most of us will be too distracted to care. We will all be dazzled by the new possibilities.
The good news is we're entering a really interesting time with multiple points of industrialisation (big data, sensor as a service, robotics, currency, immersive tech, 3D printing, genetic engineering etc) looming over the next 15 years. In particular 2025-2030 is looking likely to become a peak time of wonder across multiple fields ... endless possibilities of recombination and genesis. This is all very exciting.
You never know by 2030, open source efforts in the IaaS space might have clawed back their position but most of us will be too distracted to care. We will all be dazzled by the new possibilities.