In this episode of Emergent Behavior, @8teapi talks with Justin Junyang Lin, Chief Evangelist Officer of Alibaba Qwen Project. Joined by guest host Eugene Cheah, CEO of Recursal.AI, they talk about how Alibaba's Qwen 2 tackles multilingual challenges, including code-switching and the unique complexities of Chinese data.
🔥 Apply to join over 400 founders and Execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj
Explore the impact of open-source LLMs like Alibaba's Qwen 2, and how it's driving innovation in AI development.
--
RECOMMENDED PODCASTS:
🎙️ 1 to 100 | Hypergrowth Companies Worth Joining
Every week we sit down with the founder of a hyper-growth company you should consider joining. Our goal is to give you the inside story behind breakout, early stage companies potentially worth betting your career on. This season, discover how the founders of Modal Labs, Clay, Mercor, and more built their products, cultures, and companies.
Spotify:https://open.spotify.com/show/70NOWtWDY995C8qDqojxGw
Apple: https://podcasts.apple.com/podcast/id1762756034
-
🎙️ History 102 with WhatifAltHist
Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.
Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm
Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913
YouTube: https://www.youtube.com/@History102-qg5oj
–
FOLLOW ON X:
@8teAPi (Ate)
@JustinLin610 (Junyang)
@picocreator (Eugene)
@TurpentineMedia
--
LINKS:
Alibaba Qwen Project:
https://www.alibabacloud.com/en/solutions/generative-ai/qwen?_p_lc=1
--
TIMESTAMPS:
(00:00) Introduction
(04:36) Qwen's Development Journey
(08:00) Data Curation & Coding Capabilities
(11:00) The Role of Evaluation
(14:00) Evolution of Pre-training and Evaluation
(17:00) Open Source vs. Commercial Groups
(22:00) Data Contamination
(24:00) Model Sizing and Computational Constraints
(28:00) Multi-lingual Capabilities
(31:00) Tokenizers and Language-Specific Considerations
(34:00) Code Switching and Data Filtering
(38:00) Code Switching, Dialects, and Model Size
(42:00) User Feedback and Model Development
(46:00) Challenges with Chinese Datasets
(52:00) Language Variation and Team Development
(58:00) Hiring and Team Dynamics
(1:03:00) Diversity and Production Considerations
(1:07:00) Production Impact and Collaboration
(1:13:00) Wrap