Agentic Conversations (formally mlops.community)

Latest Episodes:

The Long Tail of ML Deployment // Tuhin Srivastava // #161 Jun 13, 2023

Show notes

MLOps Coffee Sessions #161 with Tuhin Srivastava, The Long Tail of ML Deployment, co-hosted by Abi Aryan. This episode is brought to you by QuantumBlack.

// Abstract

Baseten is an engineer-first platform designed to alleviate the engineering burden for machine learning and data engineers. Tuhin's perspective, based on research with Stanford students, emphasizes the importance of engineers embracing the engineering aspects and considering them from a reproductive perspective.

// Bio

Tuhin Srivastava is the co-founder and CEO of Baseten. Tuhin has spent the better part of the last decade building machine learning-powered products and is currently working on empowering engineers to build production-grade services with machine learning.

// MLOps Jobs board

jobs.mlops.community

// MLOps Swag/Merch

https://mlops-community.myshopify.com/

// Related Links

QuantumBlack: https://www.mckinsey.com/capabilities/quantumblack/contact-us

Baseten: https://www.baseten.co/

Baseten Careers: https://www.baseten.co/careers

--------------- ✌️Connect With Us ✌️ -------------

Join our Slack community: https://go.mlops.community/slack

Catch all episodes, blogs, newsletters, and more: https://mlops.community/

Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/

Connect with Abi on LinkedIn: https://www.linkedin.com/in/goabiaryan/

Connect with Tuhin on LinkedIn: https://www.linkedin.com/in/tuhin-srivastava-60601114/

Timestamps:

[00:00] Partnership with QuantumBlack

[00:16] Nayur Khan presenting QuantumBlack

[03:35] QuantumBlack is hiring!

[03:47] Tuhin's preferred coffee

[05:03] Takeaways

[07:00] Please share this episode with a friend!

[07:12] Comments/Reviews

[08:49] Tuhin's background

[10:13] Finance and Law common complaint culture

[11:40] Doing Machine Learning in 2010 - 2011

[14:31] Gum broad or the next company shape?

[16:33] Engineers need to learn machine learning

[20:18] Software engineers need to dig deeper

[24:49] Cambrian Explosion

[27:53] The Holy Trifecta

[28:54] Objective truth and prompting

[31:23] Limitations of LLMs

[35:37] Documentation challenges

[38:25] Baseten creating valuable models

[40:37] Advocate for Microservices or API-based solution

[42:54] Learning Git pains

[44:16] Baseten back ups

[48:00] Baseten is hiring!

[49:32] Wrap up

Clean Code for Data Scientists // Matt Sharp // # 160 Jun 07, 2023

Show notes

MLOps Coffee Sessions #160 with Matt Sharp, Data Developer at Shopify, Clean Code for Data Scientists, co-hosted by Abi Aryan.

// Abstract

Let's delve into Shopify's real-time serving platform, Merlin, which enables features like recommender systems, inbox classification, and fraud detection. Matt shares his insights on clean coding and the new book he is writing about LLMs in production.

// Bio

Matt is a Chemical Engineer turned Data scientist turned Data Engineer. Self-described "Recovering Data Scientist", Matt got tired of all the inefficiencies he faced as a Data Scientist and made the switch to Data Engineering. At Matt's last job, he ended up building the entire MLOps platform from scratch for a fintech startup called MX. Matt gives tips to data scientists on LinkedIn on how to level up their careers and has started to be known for my clean code tips in particular. Matt recently started a new job at Shopify.

// MLOps Jobs board

jobs.mlops.community

// MLOps Swag/Merch

https://mlops-community.myshopify.com/

// Related Links

--------------- ✌️Connect With Us ✌️ -------------

Join our Slack community: https://go.mlops.community/slack

Catch all episodes, blogs, newsletters, and more: https://mlops.community/

Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/

Connect with Abi on LinkedIn: https://www.linkedin.com/in/goabiaryan/

Connect with Matt on LinkedIn: https://www.linkedin.com/in/matthewsharp/

Timestamps:

[00:00] Matt's preferred drink

[00:54] Takeaways

[03:04] Watch out for Matt's LLMs in Production book coming up!

[03:29] Please like, share, subscribe, and join the upcoming LLMs in Production Conference Part 2!

[05:07] Raising awareness about the fundamental problems of writing clean code

[07:57] Definition of clean code[09:46] Communicable clean code

[13:52] Getting out of Jupyter notebooks at the end of their life

[17:21] Exploratory data analysis

[21:22] Most popular post on LinkedIn

[26:41] Zilliz Ad

[27:44] Best practices on production-level software engineering

[29:41] Merlin

[33:51] Upcoming Shopify projects

[39:10] Matt's upcoming LLMs in Production book

[45:06] LLMs in Production book Early Access

[46:00] Wrap up

Why is MLOps Hard in an Enterprise? // Maria Vechtomova & Basak Eskili // #159 May 30, 2023

Show notes

MLOps Coffee Sessions #159 with Maria Vechtomova, Lead ML engineer, and Basak Eskili, Machine Learning Engineer, at Ahold Delhaize. Why is MLOps Hard in an Enterprise? co-hosted by Abi Aryan.

// Abstract

MLOps is particularly challenging to implement in enterprise organizations due to the complexity of the data ecosystem, the need for collaboration across multiple teams, and the lack of standardization in ML tooling and infrastructure. In addition to these challenges, at Ahold Delhaize, there is a requirement for the reusability of models as our brands seek to have similar data science products, such as personalized offers, demand forecasts, and cross-sell.

// Bio

Maria Vechtomova

Maria is a Machine Learning Engineer at Ahold Delhaize. Maria is bridging the gap between data scientists, infra, and IT teams at different brands and focuses on standardization of machine learning operations across all the brands within Ahold Delhaize. During nine years in Data&Analytics, Maria tried herself in different roles, from data scientist to machine learning engineer, was part of teams in various domains, and has built broad knowledge. Maria believes that a model only starts living when it is in production. For this reason, last six years, her focus has been on the automation and standardization of processes related to machine learning.

Basak Eskili

Basak Eskili is a Machine Learning Engineer at Ahold Delhaize. She is working on creating new tools and infrastructure that enable data scientists to quickly operationalize algorithms. She is bridging the space between data scientists and platform engineers while improving the way of working in accordance with MLOps principles. In her previous role, she was responsible for bringing models to production. She focused on NLP projects and building data processing pipelines. Basak also implemented new solutions by using cloud services for existing applications and databases to improve time and efficiency.

// MLOps Jobs board

jobs.mlops.community

// MLOps Swag/Merch

https://mlops-community.myshopify.com/

// Related LinksMLOps Maturity Assessment Blog: https://mlops.community/mlops-maturity-assessment/

The Minimum Set of Must-Haves for MLOps Blog: https://mlops.community/the-minimum-set-of-must-haves-for-mlops/

Traceability & Reproducibility Blog: https://mlops.community/traceability-reproducibility/

--------------- ✌️Connect With Us ✌️ -------------

Join our Slack community: https://go.mlops.community/slack

Catch all episodes, blogs, newsletters, and more: https://mlops.community/

Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/

Connect with Abi on LinkedIn: https://www.linkedin.com/in/goabiaryan/

Connect with Maria on LinkedIn: https://www.linkedin.com/in/maria-vechtomova/

Connect with Basak on LinkedIn: https://www.linkedin.com/in/ba%C5%9Fak-tu%C4%9F%C3%A7e-eskili-61511b58/

Timestamps:

[00:00] Maria & Basak's preferred coffee

[00:59] LLMs in Production Conference Part 2 coming up on June 15-16!

[02:08] Maria & Basak's background

[02:47] Takeaways

[04:52] A colorful history

[06:59] 4 levels of evolution

[08:15] Standardization and Model Registry Evolution

[11:52] Ahold Delhaize Standard task

[15:05] Ahold Delhaize Workflow

[25:19] Avoiding tooling sprawl

[28:10] Guardrails

[29:50] Secret sharing and credential sharing sloppy processes

[32:23] Distrust between DevOps engineers and data scientists

[33:29] MLOps vs DevOps

[35:31] Monitoring pieces heroes

[38:32] Future accumulative cost issues

[40:09] Exploratory phase in notebooks

Large Language Models at Cohere // Nils Reimers // #158 May 16, 2023

Show notes

MLOps Coffee Sessions #158 with Nils Reimer, MLOps Build or Buy, Large Language Model at Scale, co-hosted by Abi Aryan.

// Abstract

Large Language Models with billions of parameters have the possibility to change how we work with textual data. However, running them on scale at potentially hundreds of millions of texts a day is a massive challenge. Nils talks about finding the right model size for respective tasks, model distillation, and promising new ways of transferring knowledge from large to smaller models.

// Bio

Nils Reimers is highly recognized throughout the AI community for creating and maintaining the now-famous Sentence Transformers library (www.SBERT.net) used to develop, train, and use state-of-the-art LLMs. The project has 900+ stars on GitHub and 30M+ installations. Nils is currently the Director of Machine Learning at Cohere, where he leads the team that develops and trains Large Language Models (LLMs) with billions of parameters. Prior to Cohere, Nils created and led the science team for Neural Search at HuggingFace. Nils holds a Ph.D. in Computer Science from UKP in Darmstadt.

// MLOps Jobs board

jobs.mlops.community

// MLOps Swag/Merch

https://mlops-community.myshopify.com/

// Related Links

(www.SBERT.net)

https://www.nils-reimers.de/

--------------- ✌️Connect With Us ✌️ -------------

Join our Slack community: https://go.mlops.community/slack

Catch all episodes, blogs, newsletters, and more: https://mlops.community/

Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/

Connect with Abi on LinkedIn: https://www.linkedin.com/in/goabiaryan/

Connect with Nils on LinkedIn: https://www.linkedin.com/in/reimersnils/

Timestamps:

[00:00] Nils' preferred coffee

[00:45] Nils' background

[01:30] Takeaways

[06:47] Subscribe to our Newsletters and IRL Meetups, and leave your reviews!

[07:32] Nils' history

[10:39] From IT Security to Machine Learning

[13:22] Tangibility of IT and Security

[14:46] NLP transition

[15:55] Bad augmentation to new capabilities of LLMs

[16:59] Nils' concern during his PH.D.

[19:55] Making Money from Machine Learning

[22:06] Catastrophic forgetting

[26:34] Updating solutions

[28:42] Neural search space and building adaptive models

[31:23] Filtering models

[32:32] Latency issues

[36:53] Models running in parallel

[37:54] Generative models problems

[38:43] Nils' role at Cohere

[41:41] To build or not to build API

[43:00] Search models

[45:38] Large use cases

[46:43] Open source discussion within Cohere

[50:48] Competitive Edge

[55:27] Future world of API

[58:14] LLMs in Production Conference Part 2 announcement!

[1:00:17] Hopeful direction of Cohere's future

[1:02:33] Data silos

[1:04:34] Where to update the database and code

[1:05:24] Nils' focus

[1:08:49] Make money or save money

[1:10:30] Cohere's upcoming project

[1:12:37] Time spent red teaming the models

[1:14:05] Wrap up

Data Privacy and Security // LLMs in Production Conference Panel Discussion May 12, 2023

Show notes

We are having another LLMs in-production Virtual Conference. 50+ speakers combined with in-person activities around the world on June 15 & 16. Sign up free here: https://home.mlops.community/home/events/llm-in-prod-part-ii-2023-06-20 // Abstract This panel discussion is centered around a crucial topic in the tech industry - data privacy and security in the context of large language models and AI systems. The discussion highlights several key themes, such as the significance of trust in AI systems, the potential risks of hallucinations, and the differences between low and high-affordability use cases. The discussion promises to be thought-provoking and informative, shedding light on the latest developments and concerns in the field. We can expect to gain valuable insights into an issue that is becoming increasingly relevant in our digital world. // Bio Diego Oppenheimer Diego Oppenheimer is an entrepreneur, product developer, and investor with an extensive background in all things data. Currently, he is a Partner at Factory a venture fund specializing in AI investments as well as interim head of product at two LLM startups. Previously he was an executive vice president at DataRobot, Founder, and CEO at Algorithmia (acquired by DataRobot), and shipped some of Microsoft’s most used data analysis products including Excel, PowerBI, and SQL Server. Diego is active in AI/ML communities as a founding member and strategic advisor for the AI Infrastructure Alliance and MLops.Community and works with leaders to define ML industry standards and best practices. Diego holds a Bachelor's degree in Information Systems and a Masters degree in Business Intelligence and Data Analytics from Carnegie Mellon University Gevorg Karapetyan Gevorg Karapetyan is the co-founder and CTO of ZERO Systems where he oversees the company's product and technology strategy. He holds a Ph.D. in Computer Science and is the author of multiple publications, including a US Patent. Vin Vashishta C-level Technical Strategy Advisor and Founder of V Squared, one of the first data science consulting firms. Our mission is to provide support and clarity for our clients’ complete data and AI monetization journeys. Over a decade in data science and a quarter century in technology building and leading teams and delivering products with $100M+ in ARR. Saahil Jain Saahil Jain is an engineering manager at You.com. At You.com, Saahil builds search, ranking, and conversational AI systems. Previously, Saahil was a graduate researcher in the Stanford Machine Learning Group under Professor Andrew Ng, where he researched topics related to deep learning and natural language processing (NLP) in resource-constrained domains like healthcare. Prior to Stanford, Saahil worked as a product manager at Microsoft on Office 365. He received his B.S. and M.S. in Computer Science at Columbia University and Stanford University respectively. Shreya Rajpal Shreya is the creator of Guardrails AI, an open-source solution designed to establish guardrails for large language models. As a founding engineer at Predibase, she helped build the Applied ML and ML infra teams. Previously, she worked at Apple's Special Projects Group on cross-functional ML, and at Drive.ai building computer vision models.

MLOps Build or Buy, Startup vs. Enterprise? // Aaron Maurer & Katrina Ni # 157 May 09, 2023

Show notes

MLOps Coffee Sessions #157 with Katrina Ni & Aaron Maurer, MLOps Build or Buy, Startup vs. Enterprise? co-hosted by Jake Noble of tecton.ai.

This episode is sponsored by Tecton - Check out their feature store to get your real-time ML journey started.

// Abstract

There are a bunch of challenges with building useful machine learning at a B2B software company like Slack, but we've built some cool use cases over the years, particularly around recommendations. One of the key challenges is how to train powerful models while being prudent stewards of our clients' essential business data, and how to do so while respecting the increasingly complex landscape of international data regulation.

// Bio

Katrina Ni

Katrina is a Machine Learning Engineer in Slack ML Services Team, where they build ML platforms and integrate ML, e.g., Recommend API, Spam Detection, across product functionalities. Prior to Slack, she was a Software Engineer in Tableau's Explain Data Team, where they built tools that utilize statistical models and propose possible explanations to help users inspect, uncover, and dig deeper into the viz. Aaron MaurerAaron is a senior engineering manager in the infra organization at Slack, managing both the machine learning team and the real-time services team. In six years at Slack, most of which Aaron spent as an engineer, He worked on the search ranking, recommendation, spam detection, performance anomaly detection, and many other ML applications. Aaron is also an advisor to Eppo, an experimentation platform. Prior to Slack, Aaroon worked as a data scientist at Airbnb, earned a Master's in statistics at the University of Chicago, and helped develop econometric models projecting the Obamacare rollout at Acumen LLC.

// MLOps Jobs board

jobs.mlops.community

// MLOps Swag/Merch

https://mlops-community.myshopify.com/

// Related Links

--------------- ✌️Connect With Us ✌️ -------------

Join our Slack community: https://go.mlops.community/slack

Catch all episodes, blogs, newsletters, and more: https://mlops.community/

Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/

Connect with Jake on LinkedIn: https://www.linkedin.com/in/jakednoble/

Connect with Katrina on LinkedIn: https://www.linkedin.com/in/katrina-ni-660b2590/

Connect with Aaron on LinkedIn: https://www.linkedin.com/in/aaron-maurer-4003b638/

Timestamps:

[00:00] Aaron and Katrina's preferred coffee

[00:41] Recommender and System and Jake

[02:06] Takeaways

[05:38] Introduction to Aaron Maurer & Katrina Ni

[06:53] Aaron Maurer & Katrina Ni's Recommend API blog post

[08:36] 10-pole machine learning use case and Rex's use case

[10:14] Genesis of Slack's recommender system framework

[11:47] The Special Sauce

[12:58] Speaking the same language

[15:23] Use case sources

[17:08] Slack's feature engineering

[17:52] Main CTR models

[18:40] Data privacy

[21:33] Slack's recommendations problem

[22:09] Fine-tuning the generative models

[23:30] Cold start problem

[26:02] Underrated

[28:24] Baseline

[28:55] Cold sore space

[30:15] LLMs in Production Conference Part 2 announcement!

[32:32] Data scientists transition to ML

[33:35] Unicorns do exist!

[34:43] Diversity of skill set

[36:02] The future of ML

[38:34] Model Serving

[40:11] MLOps Maturity level

[43:06] AWS Analogy

[45:05] Primary difficulty

[48:07] Wrap up

Cost/Performance Optimization with LLMs [Panel] May 06, 2023

Show notes

Watch all the talks from the first conference: https://go.mlops.community/llmconfpart1

// Abstract In this panel discussion, the topic of the cost of running large language models (LLMs) is explored, along with potential solutions. The benefits of bringing LLMs in-house, such as latency optimization and greater control, are also discussed. The panelists explore methods such as structured pruning and knowledge distillation for optimizing LLMs. OctoML's platform is mentioned as a tool for the automatic deployment of custom models and for selecting the most appropriate hardware for them. Overall, the discussion provides insights into the challenges of managing LLMs and potential strategies for overcoming them. // Bio Lina Weichbrodt Lina is a pragmatic freelancer and machine learning consultant that likes to solve business problems end-to-end and make machine learning or a simple, fast heuristic work in the real world. In her spare time, Lina likes to exchange with other people on how they can implement best practices in machine learning, talk to her at the Machine Learning Ops Slack: shorturl.at/swxIN. Luis Ceze Luis Ceze is Co-Founder and CEO of OctoML, which enables businesses to seamlessly deploy ML models to production making the most out of the hardware. OctoML is backed by Tiger Global, Addition, Amplify Partners, and Madrona Venture Group. Ceze is the Lazowska Professor in the Paul G. Allen School of Computer Science and Engineering at the University of Washington, where he has taught for 15 years. Luis co-directs the Systems and Architectures for Machine Learning lab (sampl.ai), which co-authored Apache TVM, a leading open-source ML stack for performance and portability that is used in widely deployed AI applications. Luis is also co-director of the Molecular Information Systems Lab (misl.bio), which led pioneering research in the intersection of computing and biology for IT applications such as DNA data storage. His research has been featured prominently in the media including New York Times, Popular Science, MIT Technology Review, and the Wall Street Journal. Ceze is a Venture Partner at Madrona Venture Group and leads their technical advisory board. Jared Zoneraich Co-Founder of PromptLayer, enabling data-driven prompt engineering. Compulsive builder. Jersey native, with a brief stint in California (UC Berkeley '20) and now residing in NYC. Daniel Campos Hailing from Mexico Daniel started his NLP journey with his BS in CS from RPI. He then worked at Microsoft on Ranking at Bing with LLM(back when they had 2 commas) and helped build out popular datasets like MSMARCO and TREC Deep Learning. While at Microsoft he got his MS in Computational Linguistics from the University of Washington with a focus on Curriculum Learning for Language Models. Most recently, he has been pursuing his Ph.D. at the University of Illinois Urbana Champaign focusing on efficient inference for LLMs and robust dense retrieval. During his Ph.D., he worked for companies like Neural Magic, Walmart, Qualtrics, and Mendel.AI and now works on bringing LLMs to search at Neeva. Mario Kostelac Currently building AI-powered products in Intercom in a small, highly effective team. I roam between practical research and engineering but lean more towards engineering and challenges around running reliable, safe, and predictable ML systems. You can imagine how fun it is in LLM era :). Generally interested in the intersection of product and tech, and building a differentiation by solving hard challenges (technical or non-technical). Software engineer turned into Machine Learning engineer 5 years ago.

Machine Learning Education at Uber // Melissa Barr & Michael Mui // MLOps Podcast #156 May 02, 2023

Show notes

MLOps Coffee Sessions #156 with Melissa Barr & Michael Mui, Machine Learning Education at Uber, co-hosted by Lina Weichbrodt.

// Abstract

Melissa and Michael discuss the education program they developed for Uber's machine learning platform service, Michelangelo, during a guest appearance on a podcast. The program teaches employees how to use machine learning both in general and specifically for Uber. The platform team can obtain valuable feedback from users and use it to enhance the platform. The course was designed using engineering principles, making it applicable to other products as well.

// Bio

Melissa Barr

Melissa is a Technical Program Manager for ML & AI at Uber. She is based in New York City. She drives projects across Uber’s ML platform, delivery, and personalization teams. She also built out the first version of the ML Education Program in 2021.

Michael Mui

Michael is a Staff Technical Lead Manager on Uber AI's Machine Learning Platform team. He leads the Distributed ML Training team, which focuses on building elastic, scalable, and fault-tolerant distributed machine learning libraries and systems used to power machine learning development productivity across Uber. He also co-leads Uber’s internal ML Education initiatives. Outside of Uber, Michael also teaches ML at the Parsons School of Design in NYC as an Adjunct Faculty (mostly for the museum passes!) and guest lectures at the University of California, Berkeley.

// MLOps Jobs board

jobs.mlops.community

// MLOps Swag/Merch

https://mlops-community.myshopify.com/

// Related Links

https://www.uber.com/blog/ml-education-at-uber-program-design-and-outcomes

/https://www.uber.com/blog/ml-education-at-uber/

https://www.uber.com/en-PH/blog/ml-education-at-uber/

--------------- ✌️Connect With Us ✌️ -------------

Join our Slack community: https://go.mlops.community/slack

Catch all episodes, blogs, newsletters, and more: https://mlops.community/

Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/

Connect with Melissa on LinkedIn: https://www.linkedin.com/in/melissabarr1/

Connect with Michael on LinkedIn: https://www.linkedin.com/in/michael-c-mui/

Connect with Lina on LinkedIn: https://www.linkedin.com/in/lina-weichbrodt-344a066a/

Timestamps:

[00:00] Melissa and Michael's preferred coffee

[01:51] Takeaways

[05:40] Please subscribe to our newsletters and leave reviews on our podcasts!

[06:18] Machine learning at Uber education program

[07:45] The Uber courses

[10:03] Tailoring the Uber education system

[12:27] Growing out of the ML-Ed platform efforts

[14:14] Expanding the ML Market Size

[15:23] Relationship evolution

[17:36] Reproducibility best practices

[21:46] Learning development timeline

[26:29] Courses' effectiveness evaluation

[29:57] Tracking Progress Challenge

[31:25] ML platforms for internal tools

[35:07] Impact of ML Education at Uber

[39:30] Recommendations to companies that want to start an ML-Ed platform

[41:12] Early ML Adoption Program

[42:11] Homegrown or home-built platform

[42:54] Feature creation for a course

[45:24] ML Education at Uber: Frameworks Inspired by Engineering Principles

[49:42] The Future of ML Education at Uber

[52:28] Unclear ways to spread ML knowledge

[54:20] Module for Generative AI and ChatGPT

[55:05] Measurement of success

[56:39] Wrap up

The Birth and Growth of Spark: An Open Source Success Story // Matei Zaharia // MLOps Podcast #155 Apr 25, 2023

Show notes

MLOps Coffee Sessions #155 with Matei Zaharia, The Birth and Growth of Spark: An Open Source Success Story, co-hosted by Vishnu Rachakonda.

// Abstract

We dive deep into the creation of Spark, with the creator himself, Matei Zaharia, Chief Technologist at Databricks. This episode also explores the development of Databricks' other open source home run, ML Flow, and the concept of "lake house ML". As a special treat, Matei talked to us about the details of the "DSP" (Demonstrate Search Predict) project, which aims to enable building applications by combining LLMs and other text-returning systems.

// About the guest:

Matei has the unique advantage of being able to see different perspectives, having worked in both academia and the industry. He listens carefully to people's challenges and excitement about ML and uses this to come up with new ideas. As a member of Databricks, Matei also has the advantage of applying ML to Databricks' own internal practices. He is constantly asking the question, "What's a better way to do this?"

// Bio

Matei Zaharia is an Associate Professor of Computer Science at Stanford and Chief Technologist at Databricks. He started the Apache Spark project during his Ph.D. at UC Berkeley, and co-developed other widely used open-source projects, including MLflow and Delta Lake, at Databricks. At Stanford, he works on distributed systems, NLP, and information retrieval, building programming models that can combine language models and external services to perform complex tasks. Matei’s research work was recognized through the 2014 ACM Doctoral Dissertation Award for the best Ph.D. dissertation in computer science, an NSF CAREER Award, and the US Presidential Early Career Award for Scientists and Engineers (PECASE).

// MLOps Jobs board

jobs.mlops.community

// MLOps Swag/Merch

https://mlops-community.myshopify.com/

// Related Links

https://cs.stanford.edu/~matei/https://spark.apache.org/

--------------- ✌️Connect With Us ✌️ -------------

Join our Slack community: https://go.mlops.community/slack

Catch all episodes, blogs, newsletters, and more: https://mlops.community/

Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/

Connect with Vishnu on LinkedIn: https://www.linkedin.com/in/vrachakonda/

Connect with Matei on LinkedIn: https://www.linkedin.com/in/mateizaharia/

Timestamps:

[00:00] Matei's preferred coffee

[01:45] Takeaways

[05:50] Please subscribe to our newsletters, join our Slack, and subscribe to our podcast channels!

[06:52] Getting to know Matei as a person

[09:10] Spark

[14:18] Open and freewheeling cross-pollination

[16:35] Actual formation of Spark

[20:05] Spark and MLFlow Similarities and Differences

[24:24] Concepts in MLFlow

[27:34] DJ Khalid of the ML world

[30:58] Data Lakehouse

[33:35] Stanford's unique culture of the Computer Science Department

[36:06] Starting a company

[39:30] Unique advice to grad students

[41:51] Open source project

[44:35] LLMs in the New Revolution

[47:57] Type of company to start with

[49:56] Emergence of Corporate Research Labs

[53:50] LLMs size context

[54:44] Companies to respect

[57:28] Wrap up

ML Scalability Challenges // Waleed Kadous // MLOps Podcast # 154 Apr 18, 2023

Show notes

MLOps Coffee Sessions #154 with Waleed Kadous, ML Scalability Challenges, co-hosted by Abi Aryan.

// Abstract

Dr. Waleed Kadous, Head of Engineering at Anyscale, discusses the challenges of scalability in machine learning and his company's efforts to solve them. The discussion covers the need for large-scale computing power, the importance of attention-based models, and the tension between big and small data.

// Bio

Dr. Waleed Kadous leads engineering at Anyscale, the company behind the open-source project Ray, the popular scalable AI platform. Prior to Anyscale, Waleed worked at Uber, where he led overall system architecture, evangelized machine learning, and led the Location and Maps teams. He previously worked at Google, where he founded the Android Location and Sensing team, responsible for the "blue dot" as well as ML algorithms underlying products like Google Fit.

// MLOps Jobs board

jobs.mlops.community

// MLOps Swag/Merch

https://mlops-community.myshopify.com/

// Related Links

Website: anyscale.com https://www.youtube.com/watch?v=hzW0AKKqew4

https://www.anyscale.com/blog/WaleedKadous-why-im-joining-anyscale

Ray Summit: https://raysummit.anyscale.com/

Anyscale careers: https://www.anyscale.com/careers

Learning Ray O'Reilly's book. It's free to anyone interested. https://www.anyscale.com/asset/book-learning-ray-oreilly

--------------- ✌️Connect With Us ✌️ -------------

Join our Slack community: https://go.mlops.community/slack