We spend this week talking about workload scheduling, starting with Mesos. It’s a fun ride from CONTROL-M to Lambda, along with Cloud Foundry and serverless. So get ready to beat a horse into glue. Plus, how to handle gifts for father’s day and the usual recommendations at the end.
Check out the full show notes for links to the recommendations, conferences, and tech news items we didn’t get to cover.
Heron is a newly open-sourced replacement for Storm. Supporting all of our own code isn’t sustainable, need an open source community.
The Ellen Degeneres photo tweet from the 2015 Academy Awards knocked a couple of services over. 25% traffic spike, hit 255k/tweets per second. 2016 Academy Awards had 2x the traffic, no failures.
30,000 node Mesos cluster (probably largest). “We don’t like being the biggest of anything, we find the edge cases.” 130,000,000 containers launched daily.
Some of their acquisitions were in public cloud, they don’t move them in-house. They’re actually pushing new services out to AWS where they can. Vine, TellApart, Crashlytics, MoPub, BlueFin, etc. Ad-serving is mostly in AWS.
Users: Time Warner, Twitter (30,000 host deployment), Apple Siri.
Maybe Brandon can regale us with some history: tales of The Mercury Wars!
Also, some ALM stuff. Sadly, I don’t have access to the IDC reports on this, however, they’re expecting big things: “IDC’s analysis of this market resulted in worldwide agile application life-cycle management software 2014 revenue of $450.3 million, up 30.5% from the 2013 revenue of $345 million. IDC expects very strong growth for agile ALM software for the 2014–2019 time frame, with growth to $1.8 billion by 2019 and a high CAGR of 32%”
“When Apple moved to bare metal with Mesos, one of the big reasons why they did it was, first, they did not need the virtual machines and, second, they got a big performance improvement. The virtualization tax that we often talk about is very real and for Apple it was on the order of 30 percent. Removing it meant Apple could run Siri jobs 30 percent faster, which is a really big deal.”
As Coté Memo subscribers know I’ve been working on a report on Mesosphere. It now up, as alway available for 451 clients.
Here’s the 451 Take:
As with vendors like CoreOS, Docker and Red Hat (and the work around Google Kubernetes), Mesosphere is rethinking the infrastructure needed for cloud-native applications. We see a growing demand to rewrite and re-platform the bulk of applications existent in the consumer and enterprise spaces to fit into mobile and tablet form factors and take advantage cloud infrastructure. For example, the recent IBM/Apple partnership promises to develop ‘hundreds’ of iOS native applications and the back-end services to support those apps. As cloud platforms like OpenStack mature, alternatives like Mesosphere may present architectural – and wallet-share – competition for public and private cloud. As companies look to solve these problems, they may find themselves intellectually behind – most companies are just now addressing lower-level cloud infrastructure needs – requiring companies like Mesosphere to do a hefty amount of thought-leadership and market-making.