General

Scaling Your Technical Org

Caroline Horn, Charles Hubbard, Jenna Zucker, and Jason Rosenthal Posted June 14, 2023

Before we discuss hiring the right engineering or product leader for your company, it’s worthwhile to step back and ask some questions about how you’re scaling your technical organization. 

As your company grows and your technical org headcount increases, the structure of your technical teams is increasingly reflected in the products you ship—your company “ships its org chart.” One of the most important questions facing CEOs at the growth stage then becomes: how should I structure the relationship between my engineering and product leaders and their functions? (We’ve seen a recent trend where companies try to combine these leadership roles into a single chief product and technology officer (CPTO). However, in our experience, finding someone with the right combination of experience to both roles can be very difficult.)

While you could architect your technical org in a number of ways, generally, companies balance two considerations:

TABLE OF CONTENTS

    Will you structure around your product units or your functions? 

    A technical org structured around different product units embeds product managers, designers, and data analysts within the engineering teams. Each team has its own engineering leader with the latitude to make decisions quickly on their area of the product. These leaders then typically report to a senior technical leader, such as a chief product officer (CPO) or chief technology officer (CTO), who focuses on coordinating the different units into a cohesive product. While the upside is that teams can make decisions and build quickly on their product area, the challenge becomes finding a senior leader who can integrate the work of each team into a cohesive product suite. 

    In functional org structures, each functional unit has its own chain of command: engineers report to an engineering leader, product managers report to a product leader, and so on. For companies with especially complex products, this structure allows teams to develop the specialized knowledge for running and shipping code. It also gives different teams the same context for how different functions are solving business problems across the unit. But it can be very difficult to make progress because those teams need to get buy-in from various leaders in order to move their work forward. 

    How will you balance sustaining engineering on the existing product with building new products and features? 

    As you reach the growth stages and have a product out in the market, you’ll need to balance maintaining your existing product with building net-new features or even new products. Engineers in Silicon Valley and other tech hotspots often want to work on newer, flashier products, so we often see companies add engineering teams in new locations, such as India or Eastern Europe, to sustain engineering on core products. 

    Broader trends to consider

    Two broader trends may impact how you structure your org or the types of leaders you’ll need to bring on in the coming years:

    Product drives revenue, especially in enterprise. In the past, enterprise companies could sell high value, multiyear contracts and leave it to customers to figure out how to implement their products. Now, however, more enterprise software is adopted in the same way as consumer software: someone downloads and starts using it. For both consumer and enterprise software, customers expect an intuitive user experience. The best products allow users to self-onboard and get immediate value, then, over time, add more complex features that provide additional value. This means hiring product and engineering leaders who can build products with great design and user experience (UX), adding features, security, and reliability as the product scales to more end users. 

    It’s very hard for an incumbent to lock out a startup with account control. The decisions have been federated to the edge now. Everyone is a buyer.
    —Martin Casado, a16z Infra #3: What Microsoft Can Teach Us about Technical Product Leadership at Scale 

    Customers have more options than ever, more buying and budget authority lower in the organization, and CIOs are less willing to buy a wall-to-wall solution unless it’s proven with internal champions. All of this means the product not only needs to be easy to use, at first—but that the most enduring enterprise products earn the right to be complex. These products provide immediate value to a user and then deliver “a crescendo of value” to the enterprise with new capabilities.
    —David Ulevitch

    AI is poised to deliver a seismic change in what products are built and how. With the advent of generative AI, AI can write and troubleshoot code, and already we’ve seen companies use it to automate lower-level engineering tasks, increase engineering efficiency, and even build APIs in a fraction of the time it used to take. Engineering and product teams who successfully integrate AI into their workflows are likely to be able to build faster and better than companies that are slower to adopt generative AI coding tools. Some questions to consider when implementing AI include:

    • Engineering: how does AI best integrate with your current engineers? Does it shift the number of engineers you need to build the best code base? How could it change your process for writing and QAing code? 
    • Product: does AI fall on your product roadmap? What AI-driven features might be big value-adds for your product? Should you be building your own language learning model (LLM)? If not, what set of architectural decisions are you making in order to use other LLMs? 

    Next, let’s look at how to approach Hiring a Chief Product Officer and Hiring a Senior Vice President of Engineering.

    About the Contributors
    Recommended For You
    Growth

    Good news: AI Will Eat Application Software

    Alex Immerman and Santiago Rodriguez
    Growth

    Leaders, gainers and unexpected winners in the Enterprise AI arms race

    Sarah Wang, Justin Kahl, and Shangda Xu
    General

    Forward-deployed Job Titles

    Tom Hollands
    Growth

    State of Markets

    David George
    Growth

    Alex Immerman

    David George

    Expert News by a16z

    We have built a network of experts who are deeply rooted in technology and how it’s shaping our future. Subscribe to our newsletters to receive their perspectives.

    Views expressed in “posts” (including podcasts, videos, and social media) are those of the individual a16z personnel quoted therein and are not the views of a16z Capital Management, L.L.C. (“a16z”) or its respective affiliates. a16z Capital Management is an investment adviser registered with the Securities and Exchange Commission. Registration as an investment adviser does not imply any special skill or training. The posts are not directed to any investors or potential investors, and do not constitute an offer to sell — or a solicitation of an offer to buy — any securities, and may not be used or relied upon in evaluating the merits of any investment.

    The contents in here — and available on any associated distribution platforms and any public a16z online social media accounts, platforms, and sites (collectively, “content distribution outlets”) — should not be construed as or relied upon in any manner as investment, legal, tax, or other advice. You should consult your own advisers as to legal, business, tax, and other related matters concerning any investment. Any projections, estimates, forecasts, targets, prospects and/or opinions expressed in these materials are subject to change without notice and may differ or be contrary to opinions expressed by others. Any charts provided here or on a16z content distribution outlets are for informational purposes only, and should not be relied upon when making any investment decision. Certain information contained in here has been obtained from third-party sources, including from portfolio companies of funds managed by a16z. While taken from sources believed to be reliable, a16z has not independently verified such information and makes no representations about the enduring accuracy of the information or its appropriateness for a given situation. In addition, posts may include third-party advertisements; a16z has not reviewed such advertisements and does not endorse any advertising content contained therein. All content speaks only as of the date indicated.

    Under no circumstances should any posts or other information provided on this website — or on associated content distribution outlets — be construed as an offer soliciting the purchase or sale of any security or interest in any pooled investment vehicle sponsored, discussed, or mentioned by a16z personnel. Nor should it be construed as an offer to provide investment advisory services; an offer to invest in an a16z-managed pooled investment vehicle will be made separately and only by means of the confidential offering documents of the specific pooled investment vehicles — which should be read in their entirety, and only to those who, among other requirements, meet certain qualifications under federal securities laws. Such investors, defined as accredited investors and qualified purchasers, are generally deemed capable of evaluating the merits and risks of prospective investments and financial matters.

    There can be no assurances that a16z’s investment objectives will be achieved or investment strategies will be successful. Any investment in a vehicle managed by a16z involves a high degree of risk including the risk that the entire amount invested is lost. Any investments or portfolio companies mentioned, referred to, or described are not representative of all investments in vehicles managed by a16z and there can be no assurance that the investments will be profitable or that other investments made in the future will have similar characteristics or results. A list of investments made by funds managed by a16z is available here: https://a16z.com/investments/. Past results of a16z’s investments, pooled investment vehicles, or investment strategies are not necessarily indicative of future results. Excluded from this list are investments (and certain publicly traded cryptocurrencies/ digital assets) for which the issuer has not provided permission for a16z to disclose publicly. As for its investments in any cryptocurrency or token project, a16z is acting in its own financial interest, not necessarily in the interests of other token holders. a16z has no special role in any of these projects or power over their management. a16z does not undertake to continue to have any involvement in these projects other than as an investor and token holder, and other token holders should not expect that it will or rely on it to have any particular involvement.

    With respect to funds managed by a16z that are registered in Japan, a16z will provide to any member of the Japanese public a copy of such documents as are required to be made publicly available pursuant to Article 63 of the Financial Instruments and Exchange Act of Japan. Please contact compliance@a16z.com to request such documents.

    For other site terms of use, please go here. Additional important information about a16z, including our Form ADV Part 2A Brochure, is available at the SEC’s website: http://www.adviserinfo.sec.gov.