Infra

Investing in Vals

Jennifer Li, Yoko Li, Raghu Raghuram, and Shangda Xu Posted August 13, 2026

We all know AI is getting smarter day by day. For the majority of the users, there’s a more important question now: is it getting better at what I need it to do?

For years, the industry has relied on academic benchmarks to track model progress. They gave us a common language for comparing models and, for a while this has been the most useful proxy for capability.

However, frontier models are increasingly acing the same tests. Public datasets get saturated, leak into training corpora, or become targets that models are explicitly optimized against. A model can look brilliant on a leaderboard and still struggle when asked to perform the messy, multi-step work that actually matters in the real world.

At the same time, the stakes are getting higher. Models are moving from “answering questions” to “doing the work”: analyzing financial documents, resolving legal cases, writing and debugging software, navigating complex enterprise workflows.The horizon of such tasks is getting longer too: agents are operating autonomously over hours and days. A bad choice of model for the task could cost not just thousands of dollars in tokens, but also time and customer satisfaction.

That’s where Vals comes in: building the trust layer between models and the people who rely on them.

Vals takes a fundamentally different approach to evaluation: test models on the work people actually want them to do, not on contrived exams. The team works with domain experts across different fields to turn real workflows into rigorous benchmarks, then builds automated grading systems that can evaluate the final work product to an expert standard. Instead of asking whether a legal model can pass the bar, Vals tests whether it can perform legal research; in finance, whether it can analyze complex documents; in coding, whether it can build a working application. The team works with domain experts to turn real workflows into rigorous benchmarks, then builds automated grading systems that can evaluate the final work product to an expert standard.

Just as importantly, Vals has built the infrastructure to run these evaluations quickly, reproducibly, and securely at scale. Private test sets are kept private and have limited runs to protect against contamination and gaming, while Vals’ evaluation stack can produce benchmark results within hours of receiving model access. The result is a grading system that is both closer to real economical work and practical enough to keep pace with frontier model releases.

Vals understands that benchmarks are perishable and adaptive. A good benchmark is supposed to become obsolete. If models have improved until every system scores nearly perfectly (so called “benchmaxing”), the benchmark has done its job, and it is time to build a harder one. Vals has been retiring saturated evaluations and continuously introducing new tasks as the frontier moves. In May, for example, the team swapped CorpFin for its new Excel Modelling Benchmark after CorpFin stopped providing enough differentiation between models.

We believe this ability to continuously define the frontier is what’s needed by the industry to keep pace and make smart, informed decisions when it comes to AI adoption.

Every market eventually needs an independent scorekeeper. When vendors grade their own homework, buyers need someone they can trust. Credit markets developed Moody’s and S&P; public markets rely on independent auditors; product manufacturers rely on UL to certify safety. These institutions emerged for the same reason: when sellers have more information than buyers – and every incentive to present themselves favorably – trusted third-party measurement makes the market work better. That’s where we’re at with AI which is evolving to be one of the biggest markets in the industry. The opportunity, and the responsibility, is enormous.

Rayan Krishnan and Langston Nashold have been remarkably tenacious and thoughtful about this problem from the very beginning. Building AI’s independent scorekeeper requires an unusual combination: technical depth, skepticism, and the patience to keep rebuilding the test as the frontier moves. Rayan and Langston have all three. At Stanford, both co-founders studied computer science, had already been collaborating on real-world measurement problems years before starting Vals. That makes them uniquely suited not just to publish another leaderboard, but to build the trusted, adaptive evaluation layer the AI market will depend on.

We’re thrilled to partner with Rayan, Langston, and the entire Vals team as they build the trust layer that will underpin the AI economy.

About the Contributors
Want More a16z Infra?

Analysis and news covering the latest trends reshaping AI and infrastructure.

Learn More
Recommended For You
Infra

new Investing in Volta

Raghu Raghuram and Shangda Xu
Infra

Investing in Neo

Zane Lackey and Joel de la Garza
Infra

Investing in Runta

Martin Casado, Yoko Li, and Guido Appenzeller
Infra

Investing in Netris

Guido Appenzeller, Raghu Raghuram, and Jason Cui
Infra

Investing in Mirendil

Matt Bornstein and Malika Aubakirova

Expert News by a16z

We have built a network of experts who are deeply rooted in technology and how it’s shaping our future. Subscribe to our newsletters to receive their perspectives.

Views expressed in “posts” (including podcasts, videos, and social media) are those of the individual a16z personnel quoted therein and are not the views of a16z Capital Management, L.L.C. (“a16z”) or its respective affiliates. a16z Capital Management is an investment adviser registered with the Securities and Exchange Commission. Registration as an investment adviser does not imply any special skill or training. The posts are not directed to any investors or potential investors, and do not constitute an offer to sell — or a solicitation of an offer to buy — any securities, and may not be used or relied upon in evaluating the merits of any investment.

The contents in here — and available on any associated distribution platforms and any public a16z online social media accounts, platforms, and sites (collectively, “content distribution outlets”) — should not be construed as or relied upon in any manner as investment, legal, tax, or other advice. You should consult your own advisers as to legal, business, tax, and other related matters concerning any investment. Any projections, estimates, forecasts, targets, prospects and/or opinions expressed in these materials are subject to change without notice and may differ or be contrary to opinions expressed by others. Any charts provided here or on a16z content distribution outlets are for informational purposes only, and should not be relied upon when making any investment decision. Certain information contained in here has been obtained from third-party sources, including from portfolio companies of funds managed by a16z. While taken from sources believed to be reliable, a16z has not independently verified such information and makes no representations about the enduring accuracy of the information or its appropriateness for a given situation. In addition, posts may include third-party advertisements; a16z has not reviewed such advertisements and does not endorse any advertising content contained therein. All content speaks only as of the date indicated.

Under no circumstances should any posts or other information provided on this website — or on associated content distribution outlets — be construed as an offer soliciting the purchase or sale of any security or interest in any pooled investment vehicle sponsored, discussed, or mentioned by a16z personnel. Nor should it be construed as an offer to provide investment advisory services; an offer to invest in an a16z-managed pooled investment vehicle will be made separately and only by means of the confidential offering documents of the specific pooled investment vehicles — which should be read in their entirety, and only to those who, among other requirements, meet certain qualifications under federal securities laws. Such investors, defined as accredited investors and qualified purchasers, are generally deemed capable of evaluating the merits and risks of prospective investments and financial matters.

There can be no assurances that a16z’s investment objectives will be achieved or investment strategies will be successful. Any investment in a vehicle managed by a16z involves a high degree of risk including the risk that the entire amount invested is lost. Any investments or portfolio companies mentioned, referred to, or described are not representative of all investments in vehicles managed by a16z and there can be no assurance that the investments will be profitable or that other investments made in the future will have similar characteristics or results. A list of investments made by funds managed by a16z is available here: https://a16z.com/investments/. Past results of a16z’s investments, pooled investment vehicles, or investment strategies are not necessarily indicative of future results. Excluded from this list are investments (and certain publicly traded cryptocurrencies/ digital assets) for which the issuer has not provided permission for a16z to disclose publicly. As for its investments in any cryptocurrency or token project, a16z is acting in its own financial interest, not necessarily in the interests of other token holders. a16z has no special role in any of these projects or power over their management. a16z does not undertake to continue to have any involvement in these projects other than as an investor and token holder, and other token holders should not expect that it will or rely on it to have any particular involvement.

With respect to funds managed by a16z that are registered in Japan, a16z will provide to any member of the Japanese public a copy of such documents as are required to be made publicly available pursuant to Article 63 of the Financial Instruments and Exchange Act of Japan. Please contact compliance@a16z.com to request such documents.

For other site terms of use, please go here. Additional important information about a16z, including our Form ADV Part 2A Brochure, is available at the SEC’s website: http://www.adviserinfo.sec.gov.