Infra

Open Models and Maturation: Assessing the Generative AI Market

Guido Appenzeller, Matt Bornstein, and Derrick Harris Posted May 17, 2024

In this episode of the AI + a16z podcast, a16z partners Guido Appenzeller and Matt Bornstein discuss the state of the generative AI market, about 18 months after it really kicked into high gear with the release of ChatGPT — everything from the emergence of powerful open source LLMs to the excitement around AI-generated music.

If there’s one major lesson to learn, it’s that although we’ve made some very impressive technological strides and companies are generating meaningful revenue, this is still a a very fluid space. As Matt puts it during the discussion:

“For nearly all AI applications and most model providers, growth is kind of a sawtooth pattern, meaning when there’s a big new amazing thing announced, you see very fast growth. And when it’s been a while since the last release, growth kind of can flatten off. And you can imagine retention can be all over the place, too . . .

“I think every time we’re in a flat period, people start to think, ‘Oh, it’s mature now,  the gold rush is over. What happens next?’ But then a new spike almost always comes, or at least has over the last 18 months or so. So a lot of this depends on your time horizon, and I think we’re still in this period of like … if you think growth has slowed, wait a month and see it change.”

They also touch on the question of training data, and whether licensing proprietary data represents a real moat. Guido doesn’t think so:

“If I license a book, that maybe gives me a fraction of a million tokens, and we want to train on 50 trillion tokens. So in order to really make a difference, I would have to find trillions of proprietary tokens. And it’s just, practically speaking, infeasible.

“Since the Renaissance, this idea had been that knowledge is publicly accessible and will be shared. And I think that’s still reverberating here where, at the end of the day, because this knowledge is probably available on the internet, everybody trains on the same data set.”

If you liked this episode and want to hear more about the state of generative AI in 2024, check out some of our earlier episodes, including Scoping the Enterprise LLM Market (featuring Databricks VP of Generative AI Naveen Rao) and Remaking the UI for AI (featuring a16z General Partner Anjney Midha).

About the Contributors
AI + a16z

Artificial intelligence is changing everything from art to enterprise IT, and a16z is watching all of it with a close eye. This podcast features discussions with leading AI engineers, founders, and experts, as well as our general partners, about where the technology and industry are heading.

Learn More
Want More a16z Infra?

Analysis and news covering the latest trends reshaping AI and infrastructure.

Learn More
Recommended For You
Infra

Performance and Passion: Fal’s Approach to AI Inference

Burkay Gur, Batuhan Taskaya, and Jennifer Li
Infra

How to Vibe Code Securely

Feross Aboukhadijeh and Joel de la Garza
Infra

AI Is Upending SaaS Pricing

Scott Woody and Martin Casado
Infra

AI’s Unsung Hero: Data Labeling and Expert Evals

Manu Sharma and Matt Bornstein
Infra

AI, Data Engineering, and the Modern Data Stack

Tristan Handy, Jennifer Li, and Matt Bornstein

Want More Infra?

Analysis and news covering the latest trends reshaping AI and infrastructure.

Sign Up On Substack

Views expressed in “posts” (including podcasts, videos, and social media) are those of the individual a16z personnel quoted therein and are not the views of a16z Capital Management, L.L.C. (“a16z”) or its respective affiliates. a16z Capital Management is an investment adviser registered with the Securities and Exchange Commission. Registration as an investment adviser does not imply any special skill or training. The posts are not directed to any investors or potential investors, and do not constitute an offer to sell — or a solicitation of an offer to buy — any securities, and may not be used or relied upon in evaluating the merits of any investment.

The contents in here — and available on any associated distribution platforms and any public a16z online social media accounts, platforms, and sites (collectively, “content distribution outlets”) — should not be construed as or relied upon in any manner as investment, legal, tax, or other advice. You should consult your own advisers as to legal, business, tax, and other related matters concerning any investment. Any projections, estimates, forecasts, targets, prospects and/or opinions expressed in these materials are subject to change without notice and may differ or be contrary to opinions expressed by others. Any charts provided here or on a16z content distribution outlets are for informational purposes only, and should not be relied upon when making any investment decision. Certain information contained in here has been obtained from third-party sources, including from portfolio companies of funds managed by a16z. While taken from sources believed to be reliable, a16z has not independently verified such information and makes no representations about the enduring accuracy of the information or its appropriateness for a given situation. In addition, posts may include third-party advertisements; a16z has not reviewed such advertisements and does not endorse any advertising content contained therein. All content speaks only as of the date indicated.

Under no circumstances should any posts or other information provided on this website — or on associated content distribution outlets — be construed as an offer soliciting the purchase or sale of any security or interest in any pooled investment vehicle sponsored, discussed, or mentioned by a16z personnel. Nor should it be construed as an offer to provide investment advisory services; an offer to invest in an a16z-managed pooled investment vehicle will be made separately and only by means of the confidential offering documents of the specific pooled investment vehicles — which should be read in their entirety, and only to those who, among other requirements, meet certain qualifications under federal securities laws. Such investors, defined as accredited investors and qualified purchasers, are generally deemed capable of evaluating the merits and risks of prospective investments and financial matters.

There can be no assurances that a16z’s investment objectives will be achieved or investment strategies will be successful. Any investment in a vehicle managed by a16z involves a high degree of risk including the risk that the entire amount invested is lost. Any investments or portfolio companies mentioned, referred to, or described are not representative of all investments in vehicles managed by a16z and there can be no assurance that the investments will be profitable or that other investments made in the future will have similar characteristics or results. A list of investments made by funds managed by a16z is available here: https://a16z.com/investments/. Past results of a16z’s investments, pooled investment vehicles, or investment strategies are not necessarily indicative of future results. Excluded from this list are investments (and certain publicly traded cryptocurrencies/ digital assets) for which the issuer has not provided permission for a16z to disclose publicly. As for its investments in any cryptocurrency or token project, a16z is acting in its own financial interest, not necessarily in the interests of other token holders. a16z has no special role in any of these projects or power over their management. a16z does not undertake to continue to have any involvement in these projects other than as an investor and token holder, and other token holders should not expect that it will or rely on it to have any particular involvement.

With respect to funds managed by a16z that are registered in Japan, a16z will provide to any member of the Japanese public a copy of such documents as are required to be made publicly available pursuant to Article 63 of the Financial Instruments and Exchange Act of Japan. Please contact compliance@a16z.com to request such documents.

For other site terms of use, please go here. Additional important information about a16z, including our Form ADV Part 2A Brochure, is available at the SEC’s website: http://www.adviserinfo.sec.gov.