This year at CES, Jensen Huang, the CEO of NVIDIA, famously announced that Moore’s Law is dead. We’d argue that it’s not just that Moore’s Law is dead, but it’s also become largely irrelevant.
Let us explain.
Moore’s Law is the tremendously prescient observation made by Gordon Moore, which states that the number of transistors you can fit onto a single chip doubles every 18 months or so. More transistors means more processing power, and this was the trend the industry drafted on for the next four decades, to tackle bigger and bigger problems with ever more powerful applications, until a few significant events that occurred in the last decade. For one, chip manufacturing is reaching the physical limitations of silicon and has caused Moore’s Law to slow. At the same time, the demands of new workloads in the cloud, particularly around machine learning, have required massive increases in processing power. If you look at just the compute requirements for the top AI projects—from AlexNet to AlphaGo—over the last six years, they’ve required an astounding 2x increase in compute every 3.4 months! Far more than the relatively meager 2x increase every 18 months promised by Moore’s Law.
Therefore, even if Jensen is wrong and Moore’s Law isn’t dead, it still isn’t adequate.
In the effort to meet these massive increases in computing demands, the industry has taken the approach of splitting apart the application and running it on multiple chips at once instead of waiting for a single chip to get faster. This is broadly called distributed computing.
But here is the catch. Distributed computing is hard. Really hard. It’s always been a relatively elite subfield of computer science with a much higher bar to achieve than standard programming. Furthermore, distributing an application can greatly complicate a program, making it harder to improve, maintain, and debug.
This is where the open source project Ray comes in. Ray is the leading platform for allowing any developer to write distributed applications, and to do so simply and in a way that is performant, debuggable, and maintainable. Ray allows developers to easily scale up Python applications, and then under the hood, Ray does the heavy lifting around parceling up the work and farming it out to distributed clusters.
Take for example a developer who knows more about machine learning than distributed programming. That developer would build a Python machine learning application as they would a prototype on their laptop. And then with Ray, they would run it across a massive cluster of cloud computing nodes, producing world-class results.
Ray is one of the fastest-growing open source projects we’ve ever tracked, and it’s being used in production at many of the largest and most sophisticated companies on the planet including Ant Financial, Intel, and AWS. While Ray is particularly well-suited for AI and ML workloads, it is used for a wide range of applications across many different industries.
This massive popularity is both a testament to the importance of the problem it is tackling and how well the team behind it has executed on building a product that works and does what it claims.
Ray was developed at UC Berkeley by Robert Nishihara and Philipp Moritz, under the guidance of Ion Stoica and Michael Jordan, and the four of them have co-founded Anyscale, a company to support the development and commercialization of Ray. We’re exceptionally excited to be investors in Anyscale, leading their Series A, and taking a seat on the board.
There is no better team in the world to be tackling this problem. Ion Stoica, a professor at Berkeley, is a world expert in many areas, from core networking and theory, to data processing and distributed systems. He’s a serial entrepreneur, and the cofounder and original CEO of Databricks, another company we’re delighted to be investors in. Robert and Philipp did their PhD with Ion and Michael Jordan. Both are experts in distributed systems and machine learning, and have made major contributions to both the literature in the space as well as architecting, developing, and operating the Ray platform.
Moore’s Law is not going to be the vehicle that keeps the industry apace with the growing compute demands for the next few decades. Traditional approaches to distributed systems, however, just aren’t accessible enough for the general need for more and more compute. We think Ray is the answer and Anyscale is the team to build it. We’re so incredibly excited to be along for the ride.
The views expressed here are those of the individual AH Capital Management, L.L.C. (“a16z”) personnel quoted and are not the views of a16z or its affiliates. Certain information contained in here has been obtained from third-party sources, including from portfolio companies of funds managed by a16z. While taken from sources believed to be reliable, a16z has not independently verified such information and makes no representations about the enduring accuracy of the information or its appropriateness for a given situation.
This content is provided for informational purposes only, and should not be relied upon as legal, business, investment, or tax advice. You should consult your own advisers as to those matters. References to any securities or digital assets are for illustrative purposes only, and do not constitute an investment recommendation or offer to provide investment advisory services. Furthermore, this content is not directed at nor intended for use by any investors or prospective investors, and may not under any circumstances be relied upon when making a decision to invest in any fund managed by a16z. (An offering to invest in an a16z fund will be made only by the private placement memorandum, subscription agreement, and other relevant documentation of any such fund and should be read in their entirety.) Any investments or portfolio companies mentioned, referred to, or described are not representative of all investments in vehicles managed by a16z, and there can be no assurance that the investments will be profitable or that other investments made in the future will have similar characteristics or results. A list of investments made by funds managed by Andreessen Horowitz (excluding investments and certain publicly traded cryptocurrencies/ digital assets for which the issuer has not provided permission for a16z to disclose publicly) is available at https://a16z.com/investments/.
Charts and graphs provided within are for informational purposes solely and should not be relied upon when making any investment decision. Past performance is not indicative of future results. The content speaks only as of the date indicated. Any projections, estimates, forecasts, targets, prospects, and/or opinions expressed in these materials are subject to change without notice and may differ or be contrary to opinions expressed by others. Please see https://a16z.com/disclosures for additional important information.