Welcome to Mixture of Experts, your weekly deep dive into the ever-evolving landscape of artificial intelligence—bringing you insightful discussions on the latest AI trends, innovations, and their impact on business.
From breakthrough research to practical applications, each episode offers a balanced blend of expertise and analysis. Explore how AI is reshaping industries, driving efficiency, and unlocking new opportunities for growth. Whether you’re a seasoned professional seeking to stay ahead of the curve or an enthusiast curious about the future of technology, Mixture of Experts delivers the perfect mix of insights and practical knowledge. Tune in and stay informed as we navigate the dynamic intersection of AI and business.
Visit the podcast page: https://www.ibm.com/think/podcasts/mixture-of-experts
Paris AI Summit, Altman's "Three Observations," and Anthropic's Economic Index
Feb 14, 2025
Show notes
Live from Paris, Tim Hwang is at the AI Action Summit 2025. In episode
42 of Mixture of Experts, we welcome Anastasia Stasenko, CEO and
Co-Founder of pleias along with our veteran experts Marina Danilevsky
and Chris Hay. Last week, we touched on some potential conversations at
the Paris AI Summit, this week we recap what actually happened. Is AI
safety improving Globally? Next, for our paper of the week, we breakdown
s1: Simple test-time scaling. Then, Sam Altman is back with another
blog, “Three Observations,” what do our experts have to say? Finally,
what can we learn from Anthropic’s Economic Index? All that and more on
today’s Mixture of Experts. 00:01 – Intro 00:42 – Paris AI Summit 11:10 – s1: Simple test-time scaling 19:32 – Sam Altman’s “Three Observations” 30:41 – Anthropic’s Economic Index The
opinions expressed in this podcast are solely those of the participants
and do not necessarily reflect the views of IBM or any other
organization or entity. Resources: Read the paper about s1: Simple test-time scaling: https://arxiv.org/abs/2501.19393 Read Sam Altman's "Three Observations": https://blog.samaltman.com/three-observations Read Anthropic's Economic Index: https://www.anthropic.com/economic-index Read more about AGI: https://www.ibm.com/think/topics/artificial-general-intelligence
OpenAI deep research, o3-mini, AI Action Summit, and Anthropic’s Constitutional Classifiers
Feb 07, 2025
Show notes
What does Sam Altman have up his sleeve? In episode 41 of Mixture of
Experts, join host Tim Hwang along with experts Nathalie Baracaldo,
Marina Danilevsky and Chris Hay. Last week, we covered all things
DeepSeek, and this week OpenAI has some new releases to share. Today,
the experts dissect deep research and o3-mini. Next, our host Tim Hwang
is travelling to AI Action Summit, he asks our experts what we can
expect coming out of the event. Then, we talk about Anthropic’s
Constitutional Classifiers. Finally, Microsoft is creating a unit to
study AI’s impact, what does this mean? Find out all this and more on
Mixture of Experts. 00:01 – intro 00:41 – Open AI deep research and o3-mini 13:51 – AI Action Summit 20:17 – Anthropic’s Constitutional Classifiers 28:54 – Microsoft AI Impact team The
opinions expressed in this podcast are solely those of the participants
and do not necessarily reflect the views of IBM or any other
organization or entity. Subscribe for AI updates Learn more about artificial intelligence DeepSeek's reasoning AI shows power of small models, efficiently trained Visit Mixture of Experts podcast page to learn more AI content
DeepSeek facts vs hype, model distillation, and open source competition
Jan 31, 2025
Show notes
Let’s bust some early myths about DeepSeek. In episode 40 of Mixture of
Experts, join host Tim Hwang along with experts Aaron Baughman, Chris
Hay and Kate Soule. Last week, we covered the release of DeepSeek-R1;
now that the entire world is up to speed, let’s separate the facts from
the hype. Next, what is model distillation and why does it matter for
competition in AI? Finally, Sam Altman among other tech CEOs shared his
response to DeepSeek. Will R1 radically change the open-source strategy
of other tech giants? Find out all this and more on Mixture of Experts. 00:01 – Intro 00:41 – DeepSeek facts vs hype 21:00 – Model distillation 31:21 – Open source and OpenAI The
opinions expressed in this podcast are solely those of the participants
and do not necessarily reflect the views of IBM or any other
organization or entity.
DeepSeek-R1, Mistral IPO, FrontierMath controversy, and IDC code assistant report
Jan 24, 2025
Show notes
What does the future hold for DeepSeek? In episode 39 of Mixture of
Experts, join host Tim Hwang along with experts Abraham Daniels, Kaoutar
El Maghraoui and Skyler Speakman to discuss the release of DeepSeek-R1.
Next, Mistral indicates going IPO. Then, FrontierMath’s new benchmark
is particularly difficult, the experts debrief. Finally, IDC released a
report on code assistants, what do we need to know about generalist and
specialized coding assistants? Tune-in to this week’s episode to find
out. 00:01 – Intro 01:08 – DeepSeek-R1 14:08 – Mistral indicates IPO 20:54 – FrontierMath controversy 30:04 -- IDC code assistants report The
opinions expressed in this podcast are solely those of the participants
and do not necessarily reflect the views of IBM or any other
organization or entity.
Anthropic valuation rumors, Microsoft CoreAI, NotebookLM upgrades, and AI agents in finance
Jan 17, 2025
Show notes
What would you do with $2 billion? In episode 38 of Mixture of Experts, join host Tim Hwang along with experts Chris Hay, Kaoutar El Maghraoui and Vyoma Gajjar to discuss the Anthropic valuation rumors. Next, Microsoft CEO Nadella created a new CoreAI group to build and run apps for customers. Then, NotebookLM upgraded some of its features, including podcast intervention. Finally, AI agents are making their way into the financial services industry. Can an agent invest all of your money? Tune-in to this week’s episode to find out. 00:01 -- What would you do with $2 billion? 00:51 -- Anthropic valuation 12:14 -- Microsoft CoreAI 25:01 -- NotebookLM upgrades 35:17 -- AI agents in finance The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
EP Pub Date
CES 2025, NVIDIA DIGITS, Apple Intelligence fails, and Sam Altman’s reflections
Jan 10, 2025
Show notes
What’s the most exciting CES AI announcement? In episode 37 of Mixture of Experts, host Tim Hwang is joined by Skyler Speakman, Volkmar Uhlig and Shobhit Varshney to debrief CES 2025. Specifically, the experts dive into NVIDIA’S Project DIGITS, among other announcements from the AI hardware giant. Next, a new enterprise AI development survey came out that detailing how developers really feel about AI implementation. Then, Apple Intelligence experienced some major hallucination fails, what does this tell us about Apple’s stake in the AI game? Finally, Sam Altman of OpenAI released a reflection blog, what does he say about the future of AI? All that and more on today’s Mixture of Experts. The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
OpenAI o3, DeepSeek-V3, and the Brundage/Marcus AI bet
Jan 03, 2025
Show notes
Is deep learning hitting a wall? It’s 2025 and Mixture of Experts is back and better than ever. In episode 36, host Tim Hwang is joined by Chris Hay, Kate Soule and Kush Varshney to debrief one of the biggest releases of 2024, OpenAI o3. Next, DeepSeek-V3 is here! Finally, will AI exist in 2027? The experts dissect the AI bet between Miles Brundage and Gary Marcus. All that and more on the first Mixture of Experts of 2025. 00:00 — Intro 00:49 — OpenAI o3 14:40 — DeepSeek-V3 28:00 — The Brundage/Marcus bet The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
2024 Rewind: Breakthroughs in AI models, agents, hardware and products
Dec 27, 2024
Show notes
Will 2025 be the year of AI agents? In Episode 35 of Mixture of Experts, host Tim Hwang is joined by some show veterans to debrief 2024 in AI. This week, we review AI models, agents, hardware and product releases with some of the top industry experts. What was the best model of 2024? Is NVIDIA king? What are some of the AI trends in 2025? All that and more on this special edition of Mixture of Experts. The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
Granite 3.1, NVIDIA Jetson, stealing AI models, and is pre-training over?
Dec 20, 2024
Show notes
Is pre-training a thing of the past? In Episode 34 of Mixture of Experts, host Tim Hwang is joined by Abraham Daniels, Vagner Santana and Volkmar Uhlig to debrief this week in AI. First, OpenAI cofounder Ilya Sutskever said that “peak data” was achieved, does this mean there is no longer a need to model pre-training? Next, IBM released Granite 3.1 with a slew of features, we cover them all. Then, there is a new way to steal AI models, how do we protect against model exfiltration. Finally, can NVIDIA Jetson for AI developers really increase hardware accessibility? Tune-in for more! 00:01 — Intro 00:49— Is pre-training over? 10:25 — Granite 3.1 22:23 — AI model stealing 33:38—NVIDIA Jetson The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
12 Days of OpenAI, NeurIPS, ARC Prize, and Llama 3.3 70B
Dec 13, 2024
Show notes
Is o1 Pro worth the cost? In Episode 33 of Mixture of Experts, host Tim Hwang is joined by Marina Danilevsky, Kate Soule and Vyoma Gajjar. First, the experts debrief the 12 Days of OpenAI. Next, we review some of the top papers in NeurIPS, how are the experts keeping up with all these research papers? Then, we are back with another benchmark, can ARC Prize make AGI more tractable? Finally, Meta announced the launch of Llama 3.3 70B with the promise of 405B performance, can we have our cake and eat it too? Find out more on today’s Mixture of Experts! The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.
Our TOPPODCAST Picks 
Stay Connected
