Posts

The patois of data teams has become a dialect of modern engineering teams because the commonalities in the stack.

This convergence signals how far data teams have evolved into core engineering teams. Machine learning’s demand for data has accelerated this movement because AI needs data to function.

Data teams receive tickets from their internal customers & develop data products that serve both internal & external users, much like a classic product management & engineering team.

On Thursday, November 2nd at 9:30 AM Pacific, Office Hours welcomes Raj Sarkar to talk about Unleashing Outbound Marketing Fury.

Raj started his career as a marketing manager at Cisco focused on the SMB market. He then jooined Google to become the lead product marketing manager on Google Cloud Platform (GCP). Next, he headed marketing at Atlassian for Trello, Confluence, Jira for Business Teams & other products. Last a short stint at Palo Alto Networks before becoming CMO at 1Password.

Within the last few weeks, we’ve seen two significant exits in Startupland, the first new pricing information we received in many quarters.

Klaviyo was the first half for IPO in at least a year. Atlassian’s acquisition of Loom is also the first unicorn sale in about the same time frame.

Naturally, many of the first analyses compared the last round valuation in the private markets to the exit value. In both cases, the exit values amounted to less than the last private round - discounts of 36% & 20%.

Last week, Office Hours hosted Oliver Jay, former CRO at Asana to talk about Avoiding the PLG Trap. More than 900 people registered for the event.

The full recording is here or embedded below on the web.

Oliver shared some trenchant insights about his experience leading the GTM teams to success. These are three of the lessons that stood out to me espcially managing the transition from product to sales-led growth (PLG -> SLG).

Over the last few weeks I’ve been experimenting with chaining together large language models.

I dictate emails & blog posts often. Recently, I started using Whisper for drafting emails and documents. (Initially there were some issues with memory management, but I’ve since found a compiled version that works well on my Mac called whisper.cpp)

After tying Google’s Duet I wondered if I could replicate something similar. I’ve been chaining the Whisper dictation model together with LLaMA 2 model from Facebook. When drafting an email, I can dictate a response to LLaMA 2, which will then generate a reply using the context from my original email.

Eliciting product feedback elegantly is a competitive advantage for LLM-software.

Over the weekend, I queried Google’s Bard, & noticed the elegant feedback loop the product team has incorporated into their product.

I asked Bard to compare the 3rd-row leg room of the leading 7-passenger SUVs.

At the bottom of the post is a little G button, which double-checks the response using Google searches.

Last week, Harvard Business School released its analysis of LLMs on 758 consultants’ performance when using AI. Three key insights emerged.

In the first experiment (inside AI’s capability frontier), consultants randomly assigned access to GPT-4 AI completed 12.2% more tasks on average & 25.1% faster. Quality improved by 40%.

Lower performing consultants benefit the most from AI augmentation, increasing performance by 43% compared to 17% for higher performers.

This rising-tide effect seems common across AI applications. The benefit to the lower quartiles is dramatic across sales, customer support, & consulting. This has broader implications, something I aim to write about later this week.

Artisanal chocolate, artisanal candles, artisanal silk scarves. What about an artisanal email?

LLM’s powerful content generation abilities will soon automate many emails we send. Sales teams have started using software that identifies leads, researches them, identifies commonalities (a shared university affiliation or a passion for a sports team), drafts the email, & sends it. Then it tracks the email for follow up.

New product launches will bring similar tools to everyone.

On October 5th at 9:30am Pacific time, Office Hours will host Oliver Jay, former CRO at Asana & executive at Dropbox. Having worked at two of the most successful bottoms-up SaaS companies, Oliver understands the product-led growth motion better than most.

Recently, he’s written about the PLG trap. “Although the PLG approach yields rapid initial adoption and growth, scaling a PLG company is a different story.”

Yesterday at TechCrunch Disrupt, Harrison Chase, founder of LangChain, Ashe Magalhaes founder of Hearth, & Henry Scott-Green, founder of Context.ai, & I discussed the future of building LLM-enabled applications.

We assembled the panel as a three layer cake : Hearth, the application ; Langchain, the infrastructure ; Context.ai, the product analytics. Here are my takeaways from the conversation.

First, it’s very early in LLM application development in every sense of the word. Few applications are managing significant user volumes. Many remain in testing & are working to develop quality scores for LLM performance before launch. The state of the art is using “vibes” ; how much better did the model feel?