The Data Stack Show

Latest Episodes:

166: Data Processing Fundamentals and Building a Unified Execution Engine Featuring Pedro Pedreira of Meta Nov 29, 2023

Show notes

Highlights from this week’s conversation include:

The concept of composable at a lower level of data infrastructure (1:28)
New architectures and components that allow developers to build databases (3:44)
Pedro's background and experience in data infrastructure (6:18)
The Spectrum of Latency and Analytics (12:59)
Different Query Engines for Different Use Cases (16:32)
Vectorized vs Code Gen Data Processing (19:33)
Vectorization and Code Generation (21:21)
Examples of Vectorized Engines (24:33)
Rewriting Execution Engine in C++ (27:22)
Different Organization of Presto and Spark (33:17)
Arrow and its Extensions (37:15)
The similarities between analytics and ML (44:33)
Offline feature engineering and data preprocessing for training (48:00)
Dialect and semantic differences in using Velox for different engines (50:01)
The convergence of dialects (52:23)
Challenges of substrate and semantics (53:18)
Future plans for Velox (58:09)
The discussion on evolving Parquet (1:03:38)
The integration of the relational model and the tensor model (1:07:29)

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

The PRQL: How Does Composability in Data Infrastructure Differ at Different Levels of Abstraction? Featuring Pedro Pedreira of Meta Nov 27, 2023

Show notes

In this bonus episode, Eric and Kostas preview their upcoming conversation with Pedro Pedreira of Meta. Hosted by Simplecast, an AdsWizz company. See https://pcm.adswizz.com for information about our collection and use of personal data for advertising.

165: SQL Queries, Data Modeling, and Data Visualization with Colin Zima of Omni Nov 22, 2023

Show notes

Highlights from this week’s conversation include:

Colin's Background and Starting Omni (1:48)
Defining “good” at Google search early in his career (4:42)
Looker's Unique Approach to Analytics (9:48)
The paradigm shift in analytics (10:52)
The architecture of Looker and its influence (12:04)
Combatting the challenge of unbundling in the data stack (14:26)
The evolution of analytics engineering (21:50)
Enhancing user flexibility in Omni (23:44)
The evolution of BI tools (32:53)
What does the future look like for BI tools? (35:14)
The role of Python and notebooks in BI (39:48)
The product experience of Omni and its vision (45:27)
Expectations for the future of Omni (47:52)
The relationship between algorithms and business logic (50:51)

RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

The PRQL: Building a Data Product for Data People: Looker's Vision and Omni's Future with Colin Zima Nov 20, 2023

Show notes

In this bonus episode, Eric and Kostas preview their upcoming conversation with Colin Zima of Omni. Hosted by Simplecast, an AdsWizz company. See https://pcm.adswizz.com for information about our collection and use of personal data for advertising.

164: How The GTM and Data Teams at Snowflake Work Together with Travis Henry and Hillary Carpio Nov 15, 2023

Show notes

Highlights from this week’s conversation include:

The Unique Perspective of Practitioners (2:10)
Account-based Marketing (6:30)
Sales Development Representatives (SDR) (8:05)
Descriptive, People, and Engagement Data (11:38)
Data Overload and Actionable Data (14:20)
Working with Data Teams and Internal Data (17:52)
The relationship between business and data teams (22:27)
The importance of collaboration between marketing and data teams (24:17)
Travis and Hillary writing a book (25:33)
The taxonomy of personas (34:23)
Bucketing and grouping people in data systems (35:37)
Account-based marketing and sales alignment (39:00)
The data-driven approach and reliance on technology (44:25)
Managing complexity in data and account-based marketing (45:35)
Adapting to change and evolving data artifacts (51:58)
The importance of understanding the business (54:58)
Collaboration between data and go-to-market teams (55:56)

RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

The PRQL: Navigating the World of Data Overload with Travis Henry and Hillary Carpio of Snowflake Nov 13, 2023

Show notes

In this bonus episode, Eric and Kostas preview their upcoming conversation with Travis Henry and Hillary Carpio of Snowflake. Hosted by Simplecast, an AdsWizz company. See https://pcm.adswizz.com for information about our collection and use of personal data for advertising.

163: Simplifying Real-Time Streaming with David Yaffe and Johnny Graettinger of Estuary Nov 08, 2023

Show notes

Highlights from this week’s conversation include:

Johnny and David’s background in working together (1:56)
The background story of Estuary (4:15)
The challenges of ad tech and the need for low latency (5:44)
Use cases for moving data at scale (10:35)
Real-time data replication methods (11:54)
Challenges with Kafka and the birth of Gazette (13:54)
Comparing Kafka and Gazette (20:22)
The importance of existing streaming tools (22:28)
Challenges of managing Kafka and the need for a different approach (23:40)
The role of compaction in streaming applications (26:54)
The challenge of relaxing state management (34:01)
Replication and the problem of data synchronization (36:48)
Incremental Back Fills and Risk-Free Production Database (46:03)
Estuary as a Platform and Connectors (47:45)
The challenges of real-time streaming (57:56)
Orchestration in real-time streaming (1:00:51)

RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

The PRQL: The Shortcomings of Apache Kafka with David Yaffe and Johnny Graettinger of Estuary Nov 06, 2023

Show notes

In this bonus episode, Eric and Kostas preview their upcoming conversation with David Yaffe and Johnny Graettinger of Estuary. Hosted by Simplecast, an AdsWizz company. See https://pcm.adswizz.com for information about our collection and use of personal data for advertising.

162: Accelerating Enterprise AI Transformation With Open Source LLMs Featuring Mark Huang of Gradient Nov 01, 2023

Show notes

Highlights from this week’s conversation include:

The potential of AI-driven applications (1:34)
The need for hardware infrastructure in AI experimentation (2:40)
Oligopoly on the closed side (11:50)
Advantages of private side vs. open source (13:18)
Leveraging valuable data within enterprises (16:00)
The urgency of adopting LLMs in the enterprise (24:02)
Expansion of LLMs into new business verticals (25:06)
The challenges of operationalizing LLMs (29:32)
Seamless experience with OpenAI (37:29)
Operationalizing with Gradient (38:36)
The early genesis of Gradient (48:53)
The democratization of AI through endpoints (51:44)
What is the future of language models? (54:07)

RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

The PRQL: How LLMs are Transforming Enterprise Workflows with Mark Huang of Gradient Oct 30, 2023

Show notes

In this bonus episode, Eric and Kostas preview their upcoming conversation with Mark Huang of Gradient. Hosted by Simplecast, an AdsWizz company. See https://pcm.adswizz.com for information about our collection and use of personal data for advertising.

Our TOPPODCAST Picks

Follow Us

Stay Connected

Related Podcasts

Links

Stay Connected