Data Brew by Databricks

Latest Episodes:

Mixture of Memory Experts (MoME) | Data Brew | Episode 36 Jan 10, 2025

Show notes

In this episode, Sharon Zhou, Co-Founder and CEO of Lamini AI, shares her expertise in the world of AI, focusing on fine-tuning models for improved performance and reliability.
Highlights include:
- The integration of determinism and probabilism for handling unstructured data and user queries effectively.
- Proprietary techniques like memory tuning and robust evaluation frameworks to mitigate model inaccuracies and hallucinations.
- Lessons learned from deploying AI applications, including insights from GitHub Copilot’s rollout.
Connect with Sharon Zhou and Lamini:
https://www.linkedin.com/in/zhousharon/
https://x.com/realsharonzhou
https://www.lamini.ai/

Mixed Attention & LLM Context | Data Brew | Episode 35 Nov 21, 2024

Show notes

In this episode, Shashank Rajput, Research Scientist at Mosaic and Databricks, explores innovative approaches in large language models (LLMs), with a focus on Retrieval Augmented Generation (RAG) and its impact on improving efficiency and reducing operational costs.
Highlights include:
- How RAG enhances LLM accuracy by incorporating relevant external documents.
- The evolution of attention mechanisms, including mixed attention strategies.
- Practical applications of Mamba architectures and their trade-offs with traditional transformers.

Kumo AI & Relational Deep Learning | Data Brew | Episode 34 Oct 14, 2024

Show notes

In this episode, Jure Leskovec, Co-founder of Kumo AI and Professor of Computer Science at Stanford University, discusses Relational Deep Learning (RDL) and its role in automating feature engineering.
Highlights include:
- How RDL enhances predictive modeling.
- Applications in fraud detection and recommendation systems.
- The use of graph neural networks to simplify complex data structures.

LLMs: Internals, Hallucinations, and Applications | Data Brew | Episode 33 Jul 21, 2023

Show notes

Our fifth season dives into large language models (LLMs), from understanding the internals to the risks of using them and everything in between. While we're at it, we'll be enjoying our morning brew.
In this session, we interviewed Chengyin Eng (Senior Data Scientist, Databricks), Sam Raymond (Senior Data Scientist, Databricks), and Joseph Bradley (Lead Production Specialist - ML, Databricks) on the best practices around LLM use cases, prompt engineering, and how to adapt MLOps for LLMs (i.e., LLMOps).

Demonstrate–Search–Predict Framework | Data Brew | Episode 32 Jun 29, 2023

Show notes

We will dive into LLMs for our fifth season, from understanding the internals to the risks of using them and everything in between. While we’re at it, we’ll be enjoying our morning brew.

In this session, we interviewed Omar Khattab - Computer Science Ph.D. Student at Stanford, creator of DSP (Demonstrate–Search–Predict Framework), to discuss DSP, common applications, and the future of NLP.

Generative AI Risks | Data Brew | Episode 31 Jun 08, 2023

Show notes

We will dive into LLMs for our fifth season, from understanding the internals to the risks of using them and everything in between. While we’re at it, we’ll be enjoying our morning brew.
In this session, we interviewed Yaron Singer, CEO of Robust Intelligence, Professor of Computer Science at Harvard University, and guest of Data Brew Season 3 (our first repeat guest!). In this session, we discuss generative AI, the trends toward embracing LLMs, and how the surface area for vulnerabilities in generative AI is much bigger.

John Snow Labs & SparkNLP | Data Brew | Episode 30 Jun 01, 2023

Show notes

We are back and we will dive into LLMs from understanding the internals to the risks of using them and everything in between. While we’re at it, we’ll be enjoying our morning brew.
In this session, we interviewed David Talby who is the CTO at John Snow Labs; they help healthcare & life science companies put AI to good use. David's interests include natural language processing, applied artificial intelligence in healthcare, and responsible AI.

Data Brew Season 4 Episode 6: Professional Athletes Jun 09, 2022

Show notes

For our fourth season, we focus on connected health and how data & AI augment and improve our daily health. While we’re at it, we’ll be enjoying our morning brew.
Shayna Powless and Eli Ankou, professional cyclist for L39ion of Los Angeles and defensive tackle for the Buffalo Bills, respectively, provide valuable insight on how professional athletes leverage data to improve their performance and how they combine their passion for sports with the Dreamcatcher Foundation.
See more at databricks.com/data-brew

Data Brew Season 4 Episode 5: Public Health: Education, Access, and Policy May 05, 2022

Show notes

For our fourth season, we focus on connected health and how data & AI augment and improve our daily health. While we’re at it, we’ll be enjoying our morning brew.
Matt Willis, Marin County Public Health Officer, shares the three pillars of public health: education, access, and policy, and the critical role data plays in addressing the COVID-19 pandemic & opioid epidemic.
See more at databricks.com/data-brew

Data Brew Season 4 Episode 4: 1283 Days of Running (and Counting) Apr 14, 2022

Show notes

For our fourth season, we focus on connected health and how data & AI augment and improve our daily health. While we’re at it, we’ll be enjoying our morning brew.
Running the length of the US every year, Alexandra Matthiesen shares her motivational secrets for running 1,283 consecutive days (and counting!) and redefining physical and mental limits.
See more at databricks.com/data-brew

Our TOPPODCAST Picks

Follow Us

Stay Connected

Related Podcasts

Links

Stay Connected