Nvidia's agentic AI push; Snowflake cuts inference costs
Today on Product Saturday: Nvidia and Snowflake try to get more enterprises on the AI train by focusing on safety and costs, and the quote of the week.
Today: Open-source enterprise software is entering a new era and nobody feels particularly comfortable about it, Kubernetes users are probably wasting a lot of money, and the quote of the week.
Welcome to Runtime! Today: Open-source enterprise software is entering a new era and nobody feels particularly comfortable about it, Kubernetes users are probably wasting a lot of money, and the quote of the week.
(Was this email forwarded to you? Sign up here to get Runtime each week.)
Given widespread agreement that an epoch of tech history came to an abrupt conclusion in 2022 as interest rates and generative AI hype began to rise, it's a little funny that so many people in open-source software circles expected the good-old days would go on forever. Even modest attempts to subsidize the development of open-source software without breaking any licensing promises can provoke a backlash, as Buoyant CEO William Morgan has learned.
Last week Buoyant, which was created around the Linkerd service-mesh project developed by two former Twitter engineers, announced that it would no longer provide stable releases of the project for free — as in beer — to companies with more than 50 employees. Instead, companies that want a relatively turnkey version of Linkerd now have to pay for Buoyant Enterprise for Linkerd instead of getting the glue that makes open-source software work in production environments for free.
It's hard to get people to pay for something they expect to be free (ask anybody who has worked in media in the 21st century) and that's exactly what Buoyant is trying to do.
Open-source software thrived as a counter-culture alternative to the capitalist machine, but the modern reality is much different. Most enterprise open-source projects in widespread use are funded by commercial interests, whether it's a foundation, a tech giant, or a venture-capital backed startup like Buoyant.
Venture capitalists funded hundreds of companies built around open-source projects over the last decade, believing that the open nature of the software was the top of a marketing funnel. Those companies will continue to attract funding over the next few years, but it's clear the business models are going through some changes.
As enterprises rush to embrace AI, CIOs are grappling with how to merge their enterprise’s IT past and future. Increasingly, in-house technology leaders are tasked with the seemingly impossible mandate of reaping the benefits of next-generation systems while simultaneously reducing legacy technical debt and costs and managing risk. Read more about The CIO Paradox on Runtime.
Speaking of service meshes and Kubernetes, companies that have adopted those technologies tend to provision way more cloud infrastructure than they actually need, according to a new survey from Cast AI. As a result, they're throwing money out the window at a time when tech teams are being asked to cut costs as much as possible.
Companies running mid-sized Kubernetes clusters only use 13% of the CPUs they provisioned and 20% of memory, according to the report. Companies running larger clusters do a little better, technically, using 17% of their provisioned resources, but they're still defeating the whole purpose of the cloud.
Cast AI — which makes money telling people they're spending too much money on Kubernetes — attributed the overcapacity to a reluctance to rely on spot cloud instances, which can be cheaper than reserved instances. "This year’s report makes it clear that companies running applications on Kubernetes are still in the early stages of their optimization journeys and they’re grappling with the complexity of manually managing cloud-native infrastructure,” Laurent Gil, co-founder and chief product officer of Cast AI, told SiliconAngle.
"If upper leadership doesn’t support or openly contradicts the agile principles and won’t change their minds, there has to be a kind of ‘malicious compliance,’ secretly implementing agile without them knowing." — Josh Wickham, a principal engineer at Turo, describing a new era of shadow IT that embraces agile software development practices.
Dell beat Wall Street's earnings estimates despite posting an 11% decline in revenue, and enjoyed a 31% surge in its stock price Friday by implying it's about to sell a lot of servers with high-end GPUs.
Rival-from-another-time HPE saw a 13.5% decline in first-quarter revenue, and offered a less-rosy outlook based on weakness in the networking market.
JFrog's security researchers found more than 100 AI models with malicious code on Hugging Face that were designed to give attackers a back door into companies that downloaded those models.
Cohere is strictly focused on enterprise generative AI technology, President Martin Kon told CNBC: "We make F-150s."
A new survey from Canva of more than 1,360 CIOs reveals how they’re thinking about workplace tools in the AI era. Discover why CIOs are prioritizing AI to rethink workstreams and optimize workflows.
Thanks for reading — see you Tuesday!