The Data Stack Show

Latest Episodes:

171: Machine Learning Pipelines Are Still Data Pipelines with Sandy Ryza of Dagster Jan 03, 2024

Show notes

Highlights from this week’s conversation include:

The role of an orchestrator in the lifecycle of data (1:34)
Relevance of orchestration in data pipelines (00:02:45)
Changes around data ops and MLOps (3:37)
Data Cleaning (11:42)
Overview of Dagster (13:50)
Assets vs Tasks in Data Pipeline (19:15)
Building a Data Pipeline with Dexter (25:40)
Difference between Data Asset and Materialized Dataset (28:28)
Defining Lineage and Data Assets in Dagster (29:32)
The boundaries of software and organizational structures (37:25)
The benefits of a unified orchestration framework (39:56)
Orchestration in the development phase (45:29)
The emergence of analytics engineer role (51:53)
Fluidity in data pipeline and infrastructure roles (52:40)

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

The PRQL: Does Machine Learning Need Its Own Orchestrator? Featuring Sandy Ryza of Dagster Jan 02, 2024

Show notes

In this bonus episode, Eric and Kostas preview their upcoming conversation with Sandy Ryza of Dagster. Hosted by Simplecast, an AdsWizz company. See https://pcm.adswizz.com for information about our collection and use of personal data for advertising.

170: Discussing Data Roles and Solving Data Problems with Katie Bauer of GlossGenius Dec 27, 2023

Show notes

Highlights from this week’s conversation include:

The evolution of the data scientist role (1:03)
Common problems in different companies (2:05)
Measuring and curating content on Reddit (4:29)
The challenges of working with unstructured content at Reddit and Twitter (11:03)
Lessons learned from Reddit and applying them at Twitter (13:17)
Data challenges and customer behavior analysis at GlossGenius (20:16)
How the data scientist's role has changed over time (00:25:10)
The essence of the data scientist/engineer role (29:00)
Dynamics and overlaps between different data roles (32:09)
The perfect data team for Twitter (34:19)
Building a data team at a startup like GlossGenius (36:36)
The right time to bring in a dedicated data person in a startup (38:52)
The analytics engineer role (46:25)
Challenges in implementing telemetry (50:31)
Final thoughts and takeaways (52:24)

RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

The PRQL: What is a Data Scientist? Featuring Katie Bauer of GlossGenius Dec 26, 2023

Show notes

In this bonus episode, Eric and Kostas preview their upcoming conversation with Katie Bauer of GlossGenius. Hosted by Simplecast, an AdsWizz company. See https://pcm.adswizz.com for information about our collection and use of personal data for advertising.

169: Data Models: From Warehouse to Business Impact with Tasso Argyros of ActionIQ Dec 20, 2023

Show notes

Highlights from this week’s conversation include:

The Evolution of Databases and Data Systems (2:33)
Abstracting Data for Business Users (4:31)
Building a Database for Google-like Search (7:58)
The Big Data Explosion (11:10)
Selling Myspace as First Customer (13:14)
Starting ActionIQ (16:57)
The customer-centric organization (22:46)
Transitioning to customer data focus (23:53)
Understanding business users' needs (28:30)
Supporting Arbitrary Queries and Data Models (34:42)
Unique Technical Perspective of Clickstream Data (37:01)
The value per terabyte of data (46:45)
Building a product for multiple personas (50:45)
Composability and Benefits (58:05)
Evolution of Storage and Compute (1:00:09)
Composability and Treasure Data (1:02:10)

RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

The PRQL: From Databases to Customer Data Platforms with Tasso Argyros of ActionIQ Dec 18, 2023

Show notes

In this bonus episode, Eric and Kostas preview their upcoming conversation with Tasso Argyros of ActionIQ. Hosted by Simplecast, an AdsWizz company. See https://pcm.adswizz.com for information about our collection and use of personal data for advertising.

168: Decoding Data Mesh: Principles, Practices, and Real-World Applications Featuring Paolo Platter, Zhamak Dehghani, and Melissa Logan Dec 13, 2023

Show notes

Highlights from this week’s conversation include:

Defining data mesh (6:37)
Addressing the scale of organizational complexity and usage (9:04)
The shift from monolithic to microservices (12:24)
The sociological structure in data mesh (13:59)
Data product generation and sharing in data mesh (17:27)
Data Mesh: Simplifying Data Work (24:09)
Getting Started with Data Mesh (29:14)
Building products for Data Mesh (36:42)
Building a customizable and extensible platform to shape data practice (39:28)
The characteristics of a data product (48:40)
Defining what a data product is not (50:45)
The origin of the term "mesh" in data mesh (53:32)

RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

The PRQL: A Data Mesh Deep Dive with Paolo Platter, Zhamak Dehghani, and Melissa Logan Dec 11, 2023

Show notes

In this bonus episode, Eric and Kostas preview their upcoming conversation regarding Data Mesh with Paolo Platter, Zhamak Dehghani, and Melissa Logan. Hosted by Simplecast, an AdsWizz company. See https://pcm.adswizz.com for information about our collection and use of personal data for advertising.

167: Data-Driven Investing and Company Building with Ben Miller of Fundrise Dec 06, 2023

Show notes

Highlights from this week’s conversation include:

Ben’s background in real estate (3:27)
Why Fundrise was Started (4:37)
Democratizing Investment Opportunities (6:35)
Investment Thesis for Venture (11:55)
Challenges with Data and Technology (12:34)
Importance of Data Model Abstraction (20:03)
Data Infrastructure and Investments (23:22)
Evolution of Data Engineering (25:12)
Closing the Tooling Gap (34:23)
The user base segmentation (36:28)
The emotional reality of investment decisions (40:50)
Data inputs for real estate investment (47:07)
The work of data infrastructure (48:28)
The limitations of underwriting analysis (49:36)
Improving accuracy with data infrastructure (52:43)

RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.

Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

The PRQL: Fundrise's Data-Driven Approach to Investment in Real Estate and Tech with Ben Miller Dec 04, 2023

Show notes

In this bonus episode, Eric and Kostas preview their upcoming conversation with Ben Miller of Fundrise. Hosted by Simplecast, an AdsWizz company. See https://pcm.adswizz.com for information about our collection and use of personal data for advertising.

Our TOPPODCAST Picks

Follow Us

Stay Connected

Related Podcasts

Links

Stay Connected

Our TOPPODCAST Picks

Follow Us

Stay Connected

The Data Stack Show

Related Podcasts

1

2

3

4

5

6