In this episode of the AI + a16z podcast, Anyscale cofounder and CEO Robert Nishihara joins a16z General Partner Jennifer Li, as well as Derrick Harris, to discuss the challenges of training and running AI models at scale; how a focus on video models — and the huge amount of data involved — will change generative AI models and infrastructure; and the unique experience of launching a company out of the UC-Berkeley Sky Computing Lab (the successor to RISELab and AMPLab).
Here’s a sample of the discussion, where Robert explains how generative AI has turbocharged the appetite for AI capabilities within enterprise customers:
“Two years ago, we would talk to companies, prospective customers, and AI just wasn’t a priority. It certainly wasn’t a company-level priority in the way that it is today. And generative AI is the reason a lot of companies now reach out to us . . . because they know that succeeding with AI is essential for their businesses, it’s essential for their competitive advantage.
“And time to market matters for them. They don’t want to spend a year hiring an AI infrastructure team, building up a 20-person team to build all of the internal infrastructure, just to be able to start to use generative AI. That’s something they want to do today.”
At another point in the discussion, he notes on this same topic:
“One dimension where we try to go really deep is on the developer experience and just enabling developers to be more productive. This is a complaint we hear all the time with machine learning teams or infrastructure teams: They’ll say that they hired all these machine learning people, but then the machine learning people are spending all of their time managing clusters or working on the infrastructure. Or they’ll say that it takes 6 weeks or 12 weeks to get a model to transition from development to production . . . Or moving from a laptop to the cloud, and to go from single machine to scaling — these are expensive handoffs often involve rewriting a bunch of code.”
-
Robert Nishihara is cofounder and CEO of Anyscale.
-
Jennifer Li is a General Partner at Andreessen Horowitz, where she focuses on enterprise and infrastructure investments in data systems, developer tools, and AI.
-
Derrick Harris is an editor at a16z, managing the content workflow across the Infra and American Dynamism teams.
More About This Podcast
Artificial intelligence is changing everything from art to enterprise IT, and a16z is watching all of it with a close eye. This podcast features discussions with leading AI engineers, founders, and experts, as well as our general partners, about where the technology and industry are heading.