Refactoring

Refactoring

🧡 Essays

How to Build AI into Tech Products πŸ”¨

Lessons learned from 10+ AI-first companies

Luca Rossi's avatar
Barr Yaron's avatar
Luca Rossi and Barr Yaron
Oct 29, 2025
βˆ™ Paid
Upgrade to paid to play voiceover

Hey! With all the AI craze happening right now, there are two questions tech teams usually ask themselves about it: 1) should we use more AI at work? and 2) should we integrate AI into our product?

We talk pretty often about the first one, while I feel the second is a bit underrepresented. It is a complex question, one that leads to an obvious follow up: how?

β€œHow” questions are tricky because they can always be exploded into multiple angles, and this makes not exception:

  • How do we build AI from a tech perspective? β€” It’s a cascade of buy vs build decisions.

  • How do we measure that it’s doing well? β€” How to make sure it’s actually improving?

  • How do we structure our team to make it happen? β€” Do we need to hire PhDs? What do AI engineers actually do?

To explore all of this, today I am bringing in Barr Yaron from Amplify, who has a unique vantage point on this.

Amplify is a peculiar VC fund, which focuses specifically on technical founders, backing the likes of Datadog, Temporal, and Runway, and are very opinionated about what is happening right now in tech.

Barr also runs a podcast, where she talks every week to CEOs and CTOs of technical products in the AI space, so she is perfectly positioned to connect the dots and tell us about some good practices!



Hey, Barr here!

Everyone is racing to build AI into their products. What makes some teams succeed while others fail?

Thanks to the podcast and to our work with founders we have the chance to go deep into what it really takes to build lasting AI products, from technical aspects like evals and data stacks to business decisions like team building and structuring.

In this post I’m going to talk about 3 themes I’ve seen from these leaders in AI that have helped them successfully build AI products (and organizations) for technical audiences – and how you can do the same:

  1. πŸ” Getting evals right β€” by integrating domain expertise

  2. βš–οΈ Building vs buying models β€” how to think through the dilemma

  3. πŸ—οΈ Structuring AI teams β€” do you need researchers, engineers, or both?

Let’s dive in!



This post is for paid subscribers

Already a paid subscriber? Sign in
Β© 2026 Refactoring ETS Β· Privacy βˆ™ Terms βˆ™ Collection notice
Start your SubstackGet the app
Substack is the home for great culture