Link: Ignore the hysteria, Cloud Foundry is just fine

Sure you can do a lot of things with Kubernetes. It’s great, but Cloud Foundry is designed to make “Happy developers,” as Comcast open-source senior director Nithya Ruff put it at the Cloud Foundry Summit.

Cloud Foundry’s audience, as Karl Isenberg, one of its developers, explained on StackOverflow, is “enterprise application devs who want to deploy 12-factor stateless apps using Heroku-style buildpacks.”

Source: Ignore the hysteria, Cloud Foundry is just fine

Link: Users forge ahead with Cloud Foundry-Kubernetes integration

“There are a million solutions out there to your technical problems, but what we wanted was to solve the people and process problems,”

And:

“It depends on Pivotal. If they add a common pattern in the future for deployment with Istio and Envoy through a cluster and platform-agnostic service mesh, then, yes, we will combine them,” said another senior engineer at the carrier.

Source: Users forge ahead with Cloud Foundry-Kubernetes integration

Link: Cloud Foundry Project Eirini Inches the Group Closer to Kubernetes

“A lot of work needs to be done for that but it’s evolving quickly,” Childers said of interoperability tests using Eirini as a bridge between Diego and Kubernetes. He did add that the evolution from Diego to Eirini, if it does occur, will be similar to how Cloud Foundry moved from its DEA architecture system to its Diego architecture system. That involved Diego having to show functional parity to DEA and the necessary production readiness for vendors and organizations to feel comfortable using Diego in place of DEA.

Source: Cloud Foundry Project Eirini Inches the Group Closer to Kubernetes

Link: SUSE on Cloud 9 for love-in with OpenStack and Kubernetes

> With the Cloud Application Platform 1.4, SUSE has set its sights on a multi-cloud world laying claim to being the first software distribution to go 100 per cent Kubernetes for Cloud Foundry.
>
> …
>
> The juice comes from Cloud Foundry’s Project Eirini, which allows devs to seamlessly switch between Kubernetes or Cloud Foundry Diego as their container scheduler. An organisation already invested in the Kubernetes world therefore does not have to faff around with the Cloud Foundry Application Runtime orchestration. A single scheduler should do the trick.

Source: SUSE on Cloud 9 for love-in with OpenStack and Kubernetes

Link: Pivotal Cloud Foundry 2.5, Now GA, Harnesses the Power of Istio and Envoy to Make Your Developers More Productive

Whole lotta features:

> – Weighted routing uses Istio and Envoy to simplify blue-green deployments (beta)
> – Platform Automation for PCF, the engine of your perpetual upgrade machine (beta)
> – Windows Server 2019, Microsoft’s most container-friendly OS yet, now powers PAS for Windows (coming soon)
> – Consume upstream Kubernetes your way with the new PKS family
> – Got apps that need multiple custom ports? Run ‘em on PAS.
> – Use metadata on API resources throughout PAS to share context
> – Keep tabs on all your apps, wherever they run with multi-foundation Apps Manager (coming soon)
> – Steeltoe 2.2 improves the stability of your microservices, simplifies connections to MongoDB
> – Spring Cloud Data Flow for PCF 1.4: Wire up data pipelines across Kubernetes and Cloud Foundry (coming soon)
> – Single Sign-On for PCF 1.9 will help you get more done faster with a new, streamlined dashboard (coming soon)
> – Detecting manifest changes with Ops Manager is much easier
> – Other Enhancements
> – Public Service Announcements
> – Try Pivotal Cloud Foundry for Free

Source: Pivotal Cloud Foundry 2.5, Now GA, Harnesses the Power of Istio and Envoy to Make Your Developers More Productive

Link: Cloud Foundry Cult

Owen covers CF Summit Basel:

“The users we spoke with didn’t just see it as a PaaS – it was the underlying philosophy of application delivery and management upon which future developments would be based. The Foundation claims Cloud Foundry saves, on average, 10 weeks of development time and $100,000 per app development cycle. In fact, in its own survey, 92% of users cite cross-platform flexibility as important. If these panelists are gaining such benefits, it’s easy to understand why they are so enamored with it.”
Original source: Cloud Foundry Cult

Link: Finally, a more coherent IBM story?

‘IBM is pushing their cloud hard than ever before. Even though it is mostly IBM Cloud Private, this is the first time I heard a more consistent hybrid cloud story. They have moved away from OpenStack (completely) and CloudFoundry (for the most part) and building a good hybrid cloud story using Kubernetes. Both he product team and services team seem to be quite excited about the opportunity Kubernetes offers them. Kubernetes on Bare Metal as a service is a step in the right direction. Unlike OpenStack and, to some extent, CloudFoundry, Kubernetes gives IBM a chance to have a more unified story from their infrastructure assets to middleware assets. Their “One Cloud Architecture” push is directed in this direction and helps IBM tell a consistent story across their entire portfolio.’
Original source: Finally, a more coherent IBM story?

Link: Finally, a more coherent IBM story?

‘IBM is pushing their cloud hard than ever before. Even though it is mostly IBM Cloud Private, this is the first time I heard a more consistent hybrid cloud story. They have moved away from OpenStack (completely) and CloudFoundry (for the most part) and building a good hybrid cloud story using Kubernetes. Both he product team and services team seem to be quite excited about the opportunity Kubernetes offers them. Kubernetes on Bare Metal as a service is a step in the right direction. Unlike OpenStack and, to some extent, CloudFoundry, Kubernetes gives IBM a chance to have a more unified story from their infrastructure assets to middleware assets. Their “One Cloud Architecture” push is directed in this direction and helps IBM tell a consistent story across their entire portfolio.’
Original source: Finally, a more coherent IBM story?

Link: Meltdown and Spectre underscore the ongoing need for infrastructure automation

“In the Cloud Foundry scenario, these are embodied by BOSH to automate the infrastructure resource, namely VMs, container clusters, virtual storage and networks, configuration and deployment and Concourse for the development pipeline. Together, these enable organizations to rapidly and consistently patch all applications using the PaaS environment. Together, these enable organizations to rapidly and consistently patch all applications using the PaaS environment.”
Original source: Meltdown and Spectre underscore the ongoing need for infrastructure automation

Platforms are hard to sell, apps easier

Kevin Ichhpurani, executive vice president of global ecosystem and channels at GE Digital, and corporate officer of GE, told CRN during GE’s Minds and Machines conference in San Francisco last week that channel partners will have more success developing and selling applications around IoT, as opposed to grappling with the long and complex sales cycle of the GE Predix IoT platform itself.

Source: GE Digital Pivots Industrial IoT Sales Focus From Platform To IoT Apps — And Looks To Partners As Sales Engine

IBM’s new Private Cloud Stack, it’s got the Kubernetes & Containers

This week, Big Blue rolled out its new IBM Cloud Private software platform that is designed to enable enterprises to develop on-premises private cloud environments to accelerate app development and allow for easier movement of workloads between their private clouds and public clouds – not only the IBM Cloud but also those from other vendors. Similarly, IBM is leaning on open and container-based technologies for enhanced integration and portability of workloads. The IBM Cloud Private platform is built on Kubernetes, an open-source technology for container orchestration, and will support both Docker containers and Cloud Foundry framework.

More:

IBM Cloud Private can run on a variety of infrastructures, including the vendor’s own mainframe and Power systems, its hyperconverged infrastructure that runs Nutanix software, and IBM Storage’s Spectrum Access solution. In addition, it can run on systems from Dell EMC, Lenovo, Cisco Systems and NetApp, and can be deployed by such VMware, Canonical and other OpenStack distributions as well as bare-metal systems. The private cloud platform also includes such developer services for data analytics as Db2, Db2 Warehouse, PostgreSQL and MongoDB, developer tools like Netcool, UrbanCode, and Cloud Brokerage and open-source management software such as Jenkins, Prometheus, Grafana, and ElasticSearch.

Source: IBM Builds Private Cloud Stack With Kubernetes And Containers

Pivotal Conversations: Debunking Cloud Foundry Myths

Our podcast this week:

There’s a whole slurry of myths about Cloud Foundry. With the platform updating so quickly, many of the issues behind these myths have long been addressed, and many were just false from the get-go. Coté and Richard talk about a recent post dismissing common myths. We also discuss recent news from the infrastructure software world and go over a bunch of upcoming events that Pivotal will be at.

If you use something like Overcast, be sure to check out the overly-extensive chapters and links right inside the podcast.

You should subscribe to the podcast!

Cloud Foundry’s Vision: A Services Ecosystem that Transcends Containers

“What’s the whole point of Cloud Foundry? It’s an abstraction on infrastructure,” stated Kearns. “And really, if you net it even further down, the whole point is to absolve organizations — particularly, traditional, non-tech organizations — from undifferentiating heavy lifting. What that means is, working on things that are not relevant or differentiating for your business.

Also, much discussion of the history of service broker/registries.

Link

SUSE to Acquire HPE’s OpenStack, Cloud Foundry Portfolio, Boost Kubernetes Investment, TheNewStack

“We see PaaS as a strategic component of our software-defined infrastructure and application platform strategy,” stated SUSE President of Strategy, Alliances and Marketing Michael Miller, in a note to The New Stack, “and Cloud Foundry as the open source project and technology that brings together the best innovation and industry collaboration. We want to leverage that innovation for the benefit of our customers, and we have a vision for the convergence of CaaS technologies [in SUSE’s case, Containers as a service] like Docker and Kubernetes and PaaS technologies like Cloud Foundry that we think will address the real-world needs of our customers and partners. We will now work with the Cloud Foundry community to develop that vision.”

http://thenewstack.io/suse-add-hpes-openstack-cloud-foundry-portfolio-boost-kubernetes-investment/

065: The High-level WTF on “Scheduling”

We spend this week talking about workload scheduling, starting with Mesos. It’s a fun ride from CONTROL-M to Lambda, along with Cloud Foundry and serverless. So get ready to beat a horse into glue. Plus, how to handle gifts for father’s day and the usual recommendations at the end.

Check out the full show notes for links to the recommendations, conferences, and tech news items we didn’t get to cover.

Listen above, subscribe to the feed (or iTunes), or download the MP3 directly.

With Brandon Whichard, Matt Ray, and Coté.

SPONSOR

Show notes

Father’s Day

MesosCon

  • Platform Infrastructure at Twitter: The Past, Present and – Future – Chris Pinkham, VP of Engineering, Twitter
  • Forgot to talk about this, but here are my notes from the MesosCon presentation by Twitter
  • Former Nimbula founder (Oracle acquisition), early AWS founder.
  • Twitter’s kinda big deal, maybe you’ve heard of them. Over 1000 services manage Twitter, over 1,000,000 cores.
  • http://twitter.github.io
  • Heron is a newly open-sourced replacement for Storm. Supporting all of our own code isn’t sustainable, need an open source community.
  • The Ellen Degeneres photo tweet from the 2015 Academy Awards knocked a couple of services over. 25% traffic spike, hit 255k/tweets per second. 2016 Academy Awards had 2x the traffic, no failures.
  • 30,000 node Mesos cluster (probably largest). “We don’t like being the biggest of anything, we find the edge cases.” 130,000,000 containers launched daily.
  • Some of their acquisitions were in public cloud, they don’t move them in-house. They’re actually pushing new services out to AWS where they can. Vine, TellApart, Crashlytics, MoPub, BlueFin, etc. Ad-serving is mostly in AWS.
    Users: Time Warner, Twitter (30,000 host deployment), Apple Siri.

What exactly is scheduling?

  • BMC CONTROL-M
  • Coté gets Matt to “checks out” his crudes understanding. (Spoiler: Checks out.)

Serverless, what’s the deal?

Mid-roll

BONUS LINKS!

Not covered in show:

Somebody’s using Kubernetes

  • Hear the tale!
  • Concur & Barkly Protects
  • Both shops did customizations to the codebase (AWS AZ & ELB support, Prometheus)

AWS & Australia News

Coté’s revamped Pivotal Conversations Podcast

Typosquatting Package Managers

  • Seriously messed up.
  • “In the thesis itself, several powerful methods to defend against typo squatting attacks are discussed. Therefore they are not included in this blog post.”

A Docker on every HPE Server

  • Running on HPE
  • Reference Architectures!
  • HPE 3PAR and SiteScope plugins!
  • Maybe Brandon can regale us with some history: tales of The Mercury Wars!
  • Also, some ALM stuff. Sadly, I don’t have access to the IDC reports on this, however, they’re expecting big things: “IDC’s analysis of this market resulted in worldwide agile application life-cycle management software 2014 revenue of $450.3 million, up 30.5% from the 2013 revenue of $345 million. IDC expects very strong growth for agile ALM software for the 2014–2019 time frame, with growth to $1.8 billion by 2019 and a high CAGR of 32%”
  • erry-one doin’ it! What’s up with Chef’s ALM/CD stuff? Pivotal circle of code vision, with ConcourseCI.

Recommendations

Automating the three ring binder, an example from the US Government

18F is fun the watch if you’re interested in transforming to cloud. In this FAQ about cloud.gov, their Cloud Foundry service, they talk about how they help speed up the slow meatware process of compliance:

A typical agency process to demonstrate compliance with FISMA and gain an ATO requires generation of a gigantic, copy-pasted document enumerating the full design of the system. We document all of the federally-required controls in every section of the cloud.gov platform in a software-friendly way. This enables us to generate different documents suitable to different contexts: human-readable, gap analysis, spreadsheet matrix, web page visualization, etc.

Any app deployed on cloud.gov will be able to leverage these “parts-included” descriptions to make generating their own documentation much easier; they only need to supply information about what their system adds on top of the PaaS. For more information, you can watch the recent DigitalGov University video on “Handling FISMA Faster and Better.”

There’s a few interesting things here:

  1. They automate as much of the process as possible, doing the copy and pasting for you. Now, this should make you question needing to do all that meatware work in the first place but…
  2. If you can’t beat the meatware process problem, join it and try to automate it. There’s probably some value in there, and even for the parts where there is no value, it might be a waste of effort to fight it (versus other ways to spend your resources of time and favors). 3. And, as I mention on my cloud strategy piece on dealing with legacy IT, perhaps by doing all this you can expose how silly it is and eliminate it.

(If you like this line of thinking, check out my webinar on Dec 1st in dealing with legacy IT in your cloud strategy.)

Pivotal Cloud Foundry 1.6, getting beyond the blinking cursor into the application layer

There’s a new release of Pivotal Cloud Foundry out this week. We’ve been seeing great pick-up from customers, and the nature of conversations I’ve been seeing while visiting them has been changing from operations, IaaS-driven topics to discussions about improving application development and delivery. This release also reflects that shift “up the stack.” Here’s my brief take on how things are going for Pivotal Cloud Foundry.

The most typical path to using Pivotal Cloud Foundry

First, this is how I see most customers arriving at Pivotal Cloud Foundry:

Who does Pivotal see as their toughest competition? According to Watters, that distinction belongs to AWS. Cloud customers often believe that AWS itself is enough. [James] Watters says that there wouldn’t even be the concept of cloud-native apps without Amazon, but “people need more than just Amazon to be successful.” Watters believes that some of Pivotal’s best customers are those who first tried to creates platforms themselves, but then asked “what’s the right thing to do for my organization?”

The rest of the piece is a good, brief overview of the new feature in Pivotal Cloud Foundry 1.6.

What I see in this release is a movement “up the stack” to address application architecture and development concerns. You can see this in the incorporation of Spring Cloud (which supports, among many other things, a microservices approach), support for .Net (almost every large organization wants and needs this for the way they develop applications), and the numerous integrations with ALM tools (like Cloudbees, GitLabs, etc.).

For many years – and still! – the focus of “cloud” has been on the infrastructure layer: setting up the “operating system” for the cloud, your big datacenter, and everything that results in that magical blinking cursor:

I think of this as the “blinking cursor” problem. You know that softly pulsing cursor: it’s the result of millions ­—if not billions! — of dollars spent on cloud projects. These “private cloud” projects see companies redoing how their IT department provides infrastructure. They move from physical to virtual management; move from manual ticket processing to self­-service, automated provisioning; and after efforts that must have seemed like building all of the furniture for a new IKEA store with just a pocket knife, they might end up with their own cloud. And then, after all of this, they’ve gotten the blinking cursor up! The servers are ready to use! Now the hard work of designing, developing, deploying, and managing the applications that run the business starts. There is little wonder that 95% of folks in [a poll asking “what went wrong with your private cloud project?”] were not completely satisfied with their private cloud projects.

I still see much of the conversation centering around getting the blinking curser up, and too little on how to create and manage good applications. So, obviously I like our new positioning “up the stack,” not only providing application-centric services, cloud-ified middleware, and the operations capabilities needed keep those application up and running.

In addition to the actual product, you can see this reflected on the team (the evangelist/advocate/community team) I’m on where we’ve added people who focus on explaining how to do better software development, in addition to the more operations-centric people we started with.

Momentum: customer and ecosystem growth and character

Momentum wise, I measure Pivotal Cloud Foundry based on customers and the overall Cloud Foundry ecosystem.

Customer wise, we’ve gone from about $40m in bookings in 2014 to a $100m annual bookings run-rate this year. Those are two, slightly different type numbers, but you can get a feel for the amount of business we’ve been doing, and more important, the high growth and fast traction we’re getting. What I like about out customer base is that they’re everyday, big brands and companies. This not only means I can better explain what I do to my non-tech friends and relatives, but also means we have a sustainable customer base: these Global 2,000 customers aren’t going away anytime soon, esp. if they keep up the strategy that brought them to Pivotal Cloud Foundry: transforming to a software defined business.

There’s a Cloud Foundry Summit this week in Berlin and it evidenced the ecosystem momentum around Cloud Foundry, the open source project that Pivotal Cloud Foundry is based on. There’s now just north of 50 members. When you look at those logos notice how many non-tech companies are on there: it’s still mostly tech companies who want to use or extend Cloud Foundry, but there’s a delightful number of non-tech companies who want to support the platform that’s supporting their business. And, of course, the work with Microsoft to support .Net brings that whole ecosystem very close as well. As I mentioned above, many of the every organization I talk with really wants .Net support. Another interesting thing to watch is growth in use of Azure; that’s an option that I hear companies exploring a lot now-a-days, and, indeed, as Microsoft said in the press around this release, “[t]he demand for Azure was so high that we already have Fortune 100 customers building their next-generation applications with Pivotal Cloud Foundry on Azure.”

Obviously, working at Pivotal I’m highly biased on all this. Still, I think there’s good evidence that things are panning out. My main hope, as always, is that we can help improve the state of software, globally, and, thus, improve how organizations are operating.

More on Pivotal Cloud Foundry 1.6:

Cloud Native Journey Series

I’ve been working on a series of blog posts on “the cloud native journey.” I put that in quotes because it’s admittedly a cheesy marketing phrase. The point of it is: if you’re looking to start using all these new cloud-based ideas for improving how your company does custom software development, what’s that look like. You know, what’s the “journey.”

Cutter Survey

All four parts are now up:

  1. The introduction to the series
  2. The Purity & Tyranny Of A Blank Screen: The Greenfield Journey – see also a recording of my webinar on this section, also the slides.
  3. Dealing With The Stuff That Makes All The Money: The Legacy Journeycheck the recording of the webinar on this section, too. Also, the slides.
  4. The Cloud Native Journey: Enterprise Transformation – check out the recording of the webinar on this part. Also, the slides.

There’s also a PDF of the whole thing if you prefer that format.

Tell me what you think of it!

Beyond the accidental platform

While I was up in Chicago, I was asked to give a talk at the Cloud Foundry meetup. Cedric volonteered out of the blue to record it, so there’s this lovely recording:

Here’s the abstract for the talk:

No matter what, you end up with a platform – the collection of tools, practices, and services you use end-to-end to develop, deploy, and run your application. Many people aren’t conscious of this fact and end up with an ‘accidental platform. All I’d like to accomplish with this talk is convince you that you should definitely be conscious of the platform you’re building and make sure it’s not just an accidental one.

Check out the slides as well if you’re interested.

Axel Springer | Case Study | Pivotal

“Together, the teams were able to reduce deployment times from 14 hours to 14 minutes, facilitated by Pivotal Cloud Foundry’s integration with Jenkins and Gradle build systems. Since this pilot, Pivotal Cloud Foundry has had zero downtime. It is being maintained by just two operators, using their preferred tools: Logstash, DataDog and PagerDuty. Furthermore, it runs in Axel Springer’s chosen datacenter on European soil.”

Axel Springer | Case Study | Pivotal

Composable Cloud At HP

“It’s not a microservice-built application; it’s not moving to a true CI/CD model; but it gets them incrementally on that path, and they start to get some value more short-term from that.”

“That’s where we focus: hit ’em where their problems are today,” he says. “‘Skate to where the puck is going,’ to use the Gretzky saying, but at the same time don’t skate out of the rink. Don’t come at them and say, ‘Hey, we have the microservices platform for you.’ ‘Awesome. What am I going to do with my SAP system?’ Getting that balance right is what we’ve been focused on.”

Bill Hilf on HP’s cloud approach.

From Zero to Factory: Revolutionizing ‘Time-to-Value’

There’s plenty to like in here from this 2013 talk, tips and such. Also, see this more recent interview, in text, for example:

[Y]ou have to start with a position that all organizations (it doesn’t matter what industry you’re in) are going to be disrupted by highly agile, highly automated competitors who leverage technology to be the disruptive force in the sector. And, businesses clearly have a choice as to whether they are going to be the ones doing the disruption or whether they are going to be the ones having to respond to the disruption. But in either case, it depends on your ability to adapt, change and to compete. We live in a world that is increasingly digital and where technology is the lever through which much of that computation takes place. My advice to IT folks is that you’ve got to be able to have that conversation in the voice of business leaders – you’ve got to be able to articulate that reality in a language that can be understood. This is not a technology conversation, it’s a business and a competitive strategy conversation.

Also, see the slides.