Linear Digressions

Latest Episodes:

Reasoning Models: When LLMs Went Beyond Fancy Autocomplete Aug 03, 2026

Show notes

Reasoning models don't just answer your question — they *think out loud* first. In this episode we dig into the class of AI models that generate intermediate chains of thought before arriving at a final answer, exploring how the internal reasoning process works. Are these models genuinely "thinking," or is something else going on under the hood?

Distillation, or, How to Steal a Model Jul 27, 2026

Show notes

This week we’re covering model distillation: the technique of using a large "teacher" model's outputs to train a smaller, cheaper "student" model that mimics it. They cover the two big reasons labs do this — making lighter, faster, more focused models for specific tasks, and the more contentious use case of effectively copying a rival's flagship model by hammering its API with questions (with a callback to the old Bing/Google search controversy). They also get into why it's so hard to prove distillation happened, why some models occasionally introduce themselves as "Claude," and a surprisingly old idea: a 2015 paper by Geoffrey Hinton, Jeff Dean, and Oriol Vinyals on distilling knowledge using the full probability distribution over a model's outputs — not just its single most likely answer — and what that "soft label" approach captures about how a model relates concepts to each other.

Invisible LLM Failures and AI Fluency with Chris Potts (Stanford) Jul 20, 2026

Show notes

What happens when a Stanford linguistics professor turns his attention to AI chatbots — and the surprisingly invisible ways humans misunderstand them? Chris Potts joins the show to unpack the hidden failure modes in how we interact with AI, what it really means to become a more fluent user, and why these language-wielding systems are genuinely alien in ways we're only beginning to reckon with. His perspective sits at a rare intersection of linguistics, cognition, and machine learning — and it shows.

Still summer break: back next week Jul 13, 2026

Show notes

Still summer break: back next week by Katie Malone

Summer break: back soon Jul 06, 2026

Show notes

Summer break: back soon by Katie Malone

Interviewing the Linear Digressions Agents (The Agents Season, Episode 11) Jun 28, 2026

Show notes

After a five-year hiatus, the podcast that burned out partly over the tedium of writing episode descriptions is back — and using AI agents to handle exactly that task. The season-11 finale turns the lens on the podcast itself, putting the AI agents built throughout the season to work on real production tasks. It's a fitting, self-referential close to a season spent dissecting how agents actually function — and a honest look at what they can (and can't) take off your plate.

Agent Economics (The Agents Season, Episode 10) Jun 22, 2026

Show notes

What if building more highways made your commute *slower*? That's the paradox at the heart of AI agent economics: even as per-token inference costs have plummeted dramatically over the past two years, total LLM spending keeps climbing. Drawing on a surprising lesson from Robert Moses's mid-century New York infrastructure projects, this episode unpacks why cheaper compute doesn't necessarily mean cheaper AI — and what's really driving the economics of running agents at scale.

Agent Trust, Oversight and Control (The Agents Season, Episode 9) Jun 15, 2026

Show notes

Capabilities get all the attention when it comes to AI agents — but what happens when a highly capable agent makes a bad decision in the real world? Trust, oversight, and control are the unglamorous but critically important flip side of the agentic AI story. This episode digs into the security concerns that emerge when you combine powerful models with real-world tool access, and why judgment (or the lack of it) might matter just as much as raw capability. --- Website: https://lineardigressions.com Apple Podcasts: https://podcasts.apple.com/us/podcast/linear-digressions/id941219323 Spotify: https://open.spotify.com/show/1JdkD0ZoZ52KjwdR0b1WoT Substack: https://substack.com/@lineardigressions

Many Agents, Many Problems (The Agents Season, Episode 8) Jun 08, 2026

Show notes

Whether you work best solo or thrive in a team, you know collaboration is complicated — and it turns out AI agents face the same tensions. This episode dives into multi-agent systems, exploring how networks of AI agents can overcome the individual limitations of a single model, and what the research says about when collaboration actually helps versus when it just adds noise. Think scaling laws, but for teamwork. --- Website: https://lineardigressions.com Apple Podcasts: https://podcasts.apple.com/us/podcast/linear-digressions/id941219323 Spotify: https://open.spotify.com/show/1JdkD0ZoZ52KjwdR0b1WoT Substack: https://substack.com/@lineardigressions

How Do You Evaluate An AI Agent? (The Agents Season, Episode 7) Jun 01, 2026

Show notes

Knowing when an AI agent has failed sounds straightforward — until it isn't. Agents have a frustrating habit of finishing confidently while quietly doing the wrong thing, or looping endlessly without ever crashing in an obvious way. This episode tackles one of the thorniest problems in the agentic world: evaluation. If failure is hard to see, how do you measure it systematically? And how do you know when your agent is actually working?

Our TOPPODCAST Picks

Follow Us

Stay Connected

Related Podcasts

Links

Stay Connected