ArchiTECHt Daily: Confluent's $50M and the bright future for open source

Tuesday's news that Apache-Kafka-based startup Confluent raised another $50 million (and now more tha
ArchiTECHt Daily: Confluent's $50M and the bright future for open source
By ARCHITECHT • Issue #32
Tuesday’s news that Apache-Kafka-based startup Confluent raised another $50 million (and now more than $80 million since launching in 2014) should help its open source big data peers, and the general community of open source startups, sleep a little easier at night. This even as yet another big cloud computing conference kicks off on Wednesday, surely promising a slew of new competitive managed services and features from Google.
What Confluent’s big new round says to me—and something I saw playing out firsthand during my stint at Mesosphere—is that many (broadly defined) big data projects are just getting underway in earnest and that enterprises, especially, want to build them with mature open source technologies. Kafka and Spark, in particular, are remarkably popular among companies building real-time building applications. Elasticsearch (whose parent company Elastic is holding its annual user conference this week) seems quite popular, as well.
Growing competition from massive cloud providers like Amazon Web Services, Google and Microsoft, should give the companies backing these open source projects pause—followed by, perhaps, a feeling of gratitude. More mature cloud platforms attract bigger, more risk-averse users that also happen to be more concerned with issues like lock-in and knowing that the technologies they choose will be around for a while. And we’re at a point right now where an established open source project can offer stronger assurances than most cloud services on those issues.
So, as I wrote last week while explaining why AWS might see its market share slip in the coming years, the result of this could be massive adoption of cloud computing infrastructure running open source technologies on top of it. This should be a golden opportunity for open source infrastructure companies, and not just those in the big data space, to ride the cloud wave and hopefully attract customers that will stick with them for a long time. 
Over time, cloud services will get better and more appealing, especially to younger companies, and newer, shinier open source projects will pop up. But by that time, technologies like Kafka and companies like Confluent will be the incumbents likely powering some strategically important workloads, and will not be easily replaced.
P.S. I intentionally did not address the current NoSQL database or Hadoop markets here. I think they have their own unique sets of challenges, and opportunities, that don’t necessarily apply to newer, more focused open source startups.

Sponsor: Datos IO
Sponsor: Datos IO
Around the web: All things data
This would be an interesting acquisition if this rumor is true. At the least, Kaggle presents an opportunity for Google to get its tools in front of a lot of good data scientists. In the fight to become the AI platform of choice, this is important.
This highlights the work of a handful of companies trying to quantify and automate farm work, which has become huge business. The Monsanto acquisition of Climate Corp. a couple years ago drove that home.
Around the web: Cloud and infrastructure
Something tells me we’ll be hearing a lot more from Google about partners this week. This group is focused around specific use cases: app dev, data analytics, machine learning and infrastructure.
I think a lot of people’s immediate reaction is that MongoDB is having a hard time getting users for Atlas, its managed version. Even if that’s true, a 512MB free tier isn’t the answer. It’s just good business.
Pivotal is, relatively quietly, working it’s way into a billion-dollar company. The big data business didn’t work out, but Cloud Foundry is a force to be reckoned with, even for the container companies.  •  Share
In a about a year. Lest you forget who the biggest, most popular cloud provider on the planet it.
This is just one of many reasons why people like containers, and also why they believe open source software will help them have their cake and eat it too when it comes to adopting cloud.
Around the web: Artificial intelligence
Yes, this stuff is becoming possible thanks to companies like Nvidia putting GPUs in cars. But the bigger breakthrough has to be tires that can change shape. Right?
One of many hardware advances inspired by AI workloads. That is a good space to be in.
Is it just me, or should a lot more innovation be focused on making health care better? So. Much. To. Fix. 
Did you enjoy this issue?
The most interesting news, analysis, blog posts and research in cloud computing, artificial intelligence and software engineering. Delivered daily to your inbox. Curated by Derrick Harris. Check out the Architecht site at
Carefully curated by ARCHITECHT with Revue. If you were forwarded this newsletter and you like it, you can subscribe here. If you don't want these updates anymore, please unsubscribe here.