Enterprise

Owning the Workflow in B2B AI Apps

Zeya Yang Posted May 22, 2024

Owning the Workflow in B2B AI Apps Table of Contents

Last year, Kristina Shen and I expressed our anticipation for a “Wave 2” of B2B AI applications focused on synthesizing information, which we referred to as “SynthAI.” If the first wave of generative AI applications was about creating new content — like emails, lists, or marketing copy — this second wave focuses on condensing information in a manner that saves users time. The crux of this is to own the workflow by getting users to do more of their work in your application. This is important because it leads to stickiness with customers, and facilitates expanding to additional use cases over time.

A year later, we are indeed seeing the shift toward Wave 2, with more startups focused on using AI capabilities to capture these end to end workflows. I wanted to follow up to share some observations and thoughts for how startups can more deliberately target workflows.

Owning the workflow

What is a workflow, anyway? A workflow is a sequence of steps that someone performs to complete a task or do a part of their job. In knowledge work, the person needs to gather some information, apply context, and process it into a desired output – perhaps an insight or a decision. Application software strives to help us perform these workflows faster.

One way it saves us time is by capturing, storing, and representing information in a way that’s easy to work with. The other is performing the work for us. The ultimate promise of software and automation is that it could complete the entire workflow for us. We don’t actually want to do the job ourselves; we’d prefer to just click a button to, and then we’re done!

How do we think about this in the context of AI and large language models (LLMs)? The prompting mechanism that has popularized LLMs is anchored in the modality of input→output. For example, we refer to categories of foundation models as “text to speech” or “text to video” or “image to video,” etc. — literally describing what input we’re providing and the output we expect. This paradigm maps to workflows quite well. We are essentially trying to go from an input of context and information to an output of action/insights/decision. The workflow is the process in between.

However, a key challenge with these prompting mechanisms in the context of B2B applications is that B2B applications have already been designed with a workflow in mind. This is where the chat UX / prompting mechanism breaks down. If the user needs to “chat” with the AI system to maneuver or manipulate the context and information, it creates an alternative set of work that disrupts an otherwise native workflow.  

So the question becomes how do we build this input→output natively into a product. Arguably, the ideal outcome is for the workflow process to become a click of a button. This is how AI can really “own” the workflow: by converting it into a feature or capability within the product. This is the exact potential that we believe SynthAI yields.

Indeed, we are already seeing products that encapsulate this process. 

Example: FigJam

Consider a team brainstorming exercise where everyone’s ideas are being written on sticky notes. Typically, the output is to identify major themes, as well as some specific takeaways under each. The workflow is:

  1. Sort similar or repetitive sticky notes near each other.
  2. Define and identify what the clusters represent.
  3. Summarize themes and takeaways within the clusters in a succinct document.

Traditionally, each of these steps needs to be done manually because the context around the exercise and what’s written on the sticky notes is idiosyncratic to the exercise. Thus, a rote algorithm or script won’t work. 

However, it turns out these are all steps that LLMs are particularly good at. They are all different varieties of synthesis (ergo, SynthAI) that, theoretically, could be accomplished with the click of a button. And that’s exactly what FigJam — Figma’s online whiteboard for teams to brainstorm, meet, and work together — has done. 

A product manager or researcher could have easily spent up to an hour summarizing the results of the brainstorming exercise, and now they can do it with a few clicks in FigJam.

Example: Macro

Another example is an editing process where there are multiple parties suggesting edits and adding comments to the same doc. For much of knowledge work — especially in high-stakes negotiations — this is still done on Word docs, meaning each person is submitting their changes asynchronously. Typically, the desired output is a summary of all the changes, incorporated into a single document. Someone needs to coalesce all the different versions, and their workflow is like this:

  1. For each version, identify the changes.
  2. If there are multiple changes on the same portion of the document, identify how the changes differ from each other.
  3. Summarize the impact of the changes, as well as how changes from different versions might conflict with each other.

Again, traditionally, each of these steps must be done manually because the context and information is idiosyncratic to not only the original document, but also the different parties submitting new versions. And, again, it turns out these are all steps that LLMs are particularly good at. Enter Macro, a next-gen document editor with built-in AI and redlining tools. Macro has built an “AI Compare” feature that automates all these steps.

This series of comparison tasks could take a lawyer hours to complete. Now they can do it with a few clicks in Macro.

Example: Claygent

A common task in sales (and many professions) is researching specific attributes about a company or lead. For example: Who are their competitors? How do they price their product? What do they use as their POS provider? The output can be as simple as a table with a list of leads and a column tracking the attribute. The workflow is less simple, however, as someone needs navigate the website and be able to identify when they’ve found what they’re looking for: 

  1. Navigate to company website.
  2. Look through headers and/or sitemap to see if there’s a page that might have what you’re looking for. Navigate to it.
  3. If page doesn’t have it, repeat step 2.
  4. Write down the attribute in table.
  5. In the case of a lead list, repeat steps 1-4 for each lead.

This type of information scavenger hunt was traditionally difficult for a rote algorithm or script because the ways in which the information appears on company websites can be highly idiosyncratic. It could be further complicated by the company not having the information on their website, but perhaps in a third-party article that one would find with a Google search. That said, LLMs are particularly good at being guided to find information — SynthAI is essentially tracking down the output we’re looking for.

Claygent is Clay’s AI-powered web scraper that automates this type of research. In its current form, users provide guidance on the task and the desired output format. Over time, one could easily see this upfront process becoming simpler. For example, for common attributes (e.g., “pricing model” or “competitors”), Claygent can simply provide them as field options, already trained on how to retrieve this information. Further, Claygent can learn common question types, so that even if a user provides poor guidance, the product can still provide the optimal results.

It’s not uncommon to have lead lists that are thousands of companies in length. The time savings from being able to automate this with a few configurations in Clay are enormous.

Where will the trend continue?

It’s evident that AI will only get better at automating workflows, and companies will build more AI-enabled features and capabilities natively in their products. We see two natural evolutions of this trend:

  1. AI automations will execute workflows more proactively.
  2. AI automations will reimagine user experiences.

More proactive

As suggested at the beginning of this piece, the ideal outcome is for the workflow process to be turned into a click of a button. Let’s push this idea further. If we trust the AI solution will perform the workflow accurately, and the system can recognize when the workflow is needed, then the AI solution can proactively perform the workflow without needing any user action. We may still want to know that the AI solution performed the workflow on its own, and, in this case, delivering a notification will be sufficient. 

But what if we are OK with not even knowing? For example, if a customer mentions a specific objection during a sales call, the AI agent could automatically ask someone on the solutions engineering team to reach out; the account executive doesn’t need to be involved in the workflow at all.

This idea naturally allows the scope of the AI-automated workflows to expand. Since the AI solution is trusted with smaller steps, it can take on an extended workflow or a more complex input→output scenario before a human needs a notification. One example is that an AI solution could proactively surface relevant work being done by another team in the company, based on the early progress you make on a project, and propose ways for the different teams to collaborate. Another example is an AI avatar that could actively participate in a meeting alongside a teammate; instead of the account executive chatting with a copilot on the side, the AI avatar would join the call and proactively answer questions when it knows its human counterpart might not know the answer.

New user experiences

Taking this even a step further, having reliable, proactive AI capabilities should change how we interact with products at a more fundamental level. One of our favorite thought experiments on the team is to imagine how an AI-powered CRM would manifest. In the most extreme case, an AI CRM would not at all resemble a CRM as we know it today.

Today, we imagine accounts in a relational database, with static objects and fields housing information, and deals moving through pre-defined stages. However, the emerging design of AI-native apps is to ingest all the contextual data (e.g., all sales activities taking place across all SaaS apps) and represent these relationships in embeddings. This allows AI systems to capture nuance and context that’s hard to represent in a tabular or linear mapping. AI features optimized for a relational database, such as automatically populating fields in a traditional CRM structure, may quickly become outdated.

An AI CRM will continually improve its understanding of the company’s relationships with each customer by constantly ingesting the most up-to -date data and context. The objective would be for the AI CRM to have an opinion on the unique state of any prospect or customer. It should encourage the right action from an account executive or account manager (or perform it proactively), and surface relevant information to leadership at the right time. In such a paradigm, information doesn’t need to be viewed by the user in account- or stage-oriented views. Instead, the UX might look like a combination of summary dashboards and notifications. A relational table might merely be a way to summarize information for easier digestion by a human, or a translation layer for moving data into other applications that are not AI-native.

Another reason to believe we’ll see workflows we can’t even imagine today is that AI solutions will recognize more patterns as workflows. When we design software, we can only do so around what we, as humans, recognize as workflows. In reality, we could be performing repetitive actions in our jobs, via patterns we don’t even realize. AI solutions with more complete context could identify such patterns and define workflows around them (think about, for example, how earlier generations of AI systems mastered complex games such as Go or Dota 2). 

This will be especially true as AI systems become multi-modal by default, and we improve the techniques for these systems to seamlessly tie together context across different modes of information, whereas humans may be limited to seeing patterns within a single medium. In this world, AI would be designing automations that the user previously couldn’t fathom.

Conclusion

We’re still in the early innings of B2B AI applications. Wave 2 is certainly playing out, though, with companies exerting a clear ethos around owning the workflow. In turn, products will increasingly feature capabilities that can drive proactive automation. These nearer-term innovations will ultimately become the building blocks that allow products to layer on more complexity and perform broader automations. We’re excited to see what’s to come!

We also love meeting startups who are building products to own their respective workflows. If you’re working on one, feel free to reach out to zyang at a16z dot com. 

Thanks to Kristina Shen for being a thought partner during the early drafting for this piece. Many thanks to Conor Woods and Shannon Toliver at Figma; Jacob Beckerman at Macro; and Kareem Amin and Adam Eldefrawy at Clay for your engagement and feedback on your respective examples.

Want More a16z Enterprise?

News and resources for navigating the world of B2B technology, from AI and data, to security and SaaS, and more.

Learn More
Recommended For You
Enterprise

Can AI Help Save Lives?

Kimberly Tan and Michael Chime
Enterprise

The Palantirization of everything

Marc Andrusko

Want More Enterprise?

News and resources for navigating the world of B2B technology, from AI and data, to security and SaaS, and more.

Sign Up On Substack

Views expressed in “posts” (including podcasts, videos, and social media) are those of the individual a16z personnel quoted therein and are not the views of a16z Capital Management, L.L.C. (“a16z”) or its respective affiliates. a16z Capital Management is an investment adviser registered with the Securities and Exchange Commission. Registration as an investment adviser does not imply any special skill or training. The posts are not directed to any investors or potential investors, and do not constitute an offer to sell — or a solicitation of an offer to buy — any securities, and may not be used or relied upon in evaluating the merits of any investment.

The contents in here — and available on any associated distribution platforms and any public a16z online social media accounts, platforms, and sites (collectively, “content distribution outlets”) — should not be construed as or relied upon in any manner as investment, legal, tax, or other advice. You should consult your own advisers as to legal, business, tax, and other related matters concerning any investment. Any projections, estimates, forecasts, targets, prospects and/or opinions expressed in these materials are subject to change without notice and may differ or be contrary to opinions expressed by others. Any charts provided here or on a16z content distribution outlets are for informational purposes only, and should not be relied upon when making any investment decision. Certain information contained in here has been obtained from third-party sources, including from portfolio companies of funds managed by a16z. While taken from sources believed to be reliable, a16z has not independently verified such information and makes no representations about the enduring accuracy of the information or its appropriateness for a given situation. In addition, posts may include third-party advertisements; a16z has not reviewed such advertisements and does not endorse any advertising content contained therein. All content speaks only as of the date indicated.

Under no circumstances should any posts or other information provided on this website — or on associated content distribution outlets — be construed as an offer soliciting the purchase or sale of any security or interest in any pooled investment vehicle sponsored, discussed, or mentioned by a16z personnel. Nor should it be construed as an offer to provide investment advisory services; an offer to invest in an a16z-managed pooled investment vehicle will be made separately and only by means of the confidential offering documents of the specific pooled investment vehicles — which should be read in their entirety, and only to those who, among other requirements, meet certain qualifications under federal securities laws. Such investors, defined as accredited investors and qualified purchasers, are generally deemed capable of evaluating the merits and risks of prospective investments and financial matters.

There can be no assurances that a16z’s investment objectives will be achieved or investment strategies will be successful. Any investment in a vehicle managed by a16z involves a high degree of risk including the risk that the entire amount invested is lost. Any investments or portfolio companies mentioned, referred to, or described are not representative of all investments in vehicles managed by a16z and there can be no assurance that the investments will be profitable or that other investments made in the future will have similar characteristics or results. A list of investments made by funds managed by a16z is available here: https://a16z.com/investments/. Past results of a16z’s investments, pooled investment vehicles, or investment strategies are not necessarily indicative of future results. Excluded from this list are investments (and certain publicly traded cryptocurrencies/ digital assets) for which the issuer has not provided permission for a16z to disclose publicly. As for its investments in any cryptocurrency or token project, a16z is acting in its own financial interest, not necessarily in the interests of other token holders. a16z has no special role in any of these projects or power over their management. a16z does not undertake to continue to have any involvement in these projects other than as an investor and token holder, and other token holders should not expect that it will or rely on it to have any particular involvement.

With respect to funds managed by a16z that are registered in Japan, a16z will provide to any member of the Japanese public a copy of such documents as are required to be made publicly available pursuant to Article 63 of the Financial Instruments and Exchange Act of Japan. Please contact compliance@a16z.com to request such documents.

For other site terms of use, please go here. Additional important information about a16z, including our Form ADV Part 2A Brochure, is available at the SEC’s website: http://www.adviserinfo.sec.gov.