TopPodcast.com
Menu
  • Home
  • Top Charts
  • Top Networks
  • Top Apps
  • Top Independents
  • Top Podfluencers
  • Top Picks
    • Top Business Podcasts
    • Top True Crime Podcasts
    • Top Finance Podcasts
    • Top Comedy Podcasts
    • Top Music Podcasts
    • Top Womens Podcasts
    • Top Kids Podcasts
    • Top Sports Podcasts
    • Top News Podcasts
    • Top Tech Podcasts
    • Top Crypto Podcasts
    • Top Entrepreneurial Podcasts
    • Top Fantasy Sports Podcasts
    • Top Political Podcasts
    • Top Science Podcasts
    • Top Self Help Podcasts
    • Top Sports Betting Podcasts
    • Top Stocks Podcasts
  • Podcast News
  • About Us
  • Podcast Advertising
  • Contact
Not in our directory?
Add Show Here
Podcast Equipment
Center

toppodcastlogoOur TOPPODCAST Picks

  • Comedy
  • Crypto
  • Sports
  • News
  • Politics
  • True Crime
  • Business
  • Finance

Follow Us

toppodcastlogoStay Connected

    View Top 200 Chart
    Back to Rankings Page
    Technology

    “The Cognitive Revolution”

    A biweekly podcast where hosts Nathan Labenz and Erik Torenberg interview the builders on the edge of AI and explore the dramatic shift it will unlock in the coming years.
    The Cognitive Revolution is part of the Turpentine podcast network. To learn more: turpentine.co

    Advertise

    Copyright: © 2023

    • Apple Podcasts
    • Google Play
    • Spotify

    Latest Episodes:
    Robotics Research Update, with Keerthana Gopalakrishnan and Ted Xiao of Google DeepMind Apr 22, 2024
    Show notes

    Google DeepMind researchers Keerthana Gopalakrishnan and Ted Xiao discuss their latest breakthroughs in AI robotics. Including models that enable robots to understand novel objects, learn from human demonstrations, and operate under ethical constraints. The conversation covers six groundbreaking papers that showcase rapid progress towards general-purpose robotics.


    SPONSORS:

    The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR


    Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/


    Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.


    Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.


    CHAPTERS :

    (00:00) Introduction

    (04:44) The Future of Robotics

    (14:40) Sponsors : Brave / Omneky

    (16:04) Inputs and Outputs

    (24:03) A Leap Towards Generalist Robots

    (32:08) Sponsors : Plumb / Squad

    (33:52) Learning in Robotics

    (41:12) Learning from On-the-Fly Examples

    (41:57) Annotating Robot Actions

    (50:17) Scaling and Safety

    (01:03:05) Learning to Learn Faster

    (01:08:43) Zero-Shot Learning

    (01:15:15) Future Directions


    AI Inference: Good, Fast, and Cheap, with Lin Qiao & Dmytro Ivchenko of Fireworks AI Apr 20, 2024
    Show notes

    In this episode, we delve into the intricate world of AI inference with cofounders of Firework AI. Discover the strategies behind optimizing AI performance, the importance of balancing latency and throughput, and the nuances of different AI architectures from GPT-3 to Stable Diffusion. Learn about their partnership with Stability AI, their unique focus on reducing total cost of ownership, and their vision for a seamless developer experience.


    RECOMMENDED PODCAST:

    How Do You Use ChatGPT with Dan Shipper.

    Dan Shipper talks to programmers, writers, founders, academics, tech executives, and others to walk through all of their ChatGPT use cases (including Nathan!). They even use ChatGPT together, live on the show. Listen to How Do You Use ChatGPT? from Dan Shipper and the team at Every, wherever you get your podcasts: https://link.chtbl.com/hdyuchatgpt


    SPONSORS:

    Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/


    The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR


    Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.


    Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.


    CHAPTERS :

    (00:00:00) Introduction

    (00:08:34) Compute Stack

    (00:19:23) Fireworks Product Philosophy

    (00:24:11) Sponsors : Brave / Omneky

    (00:25:40) Fine-tuning Strategy

    (00:38:40) Sponsors : Plumb / Squad

    (00:40:33) NVIDIA Stack Overview

    (00:47:14) TensorFlow Triton Service

    (00:55:25) Reduced Precision Advantages

    (01:03:57) Different Deployment Scenarios

    (01:08:27) Seeking Intuition on Sharding

    (01:19:28) Announcing Stability AI Partnership

    (01:32:00) Closing Remarks


    Reading Minds from Shared Latent Space Apr 17, 2024
    Show notes

    In this episode, we explore the cutting-edge world of AI-powered brain imaging with the MindEye2 Project. Discover how researchers are reconstructing images from fMRI data, offering unprecedented insights into the human mind. We discuss the implications for neuroscience, clinical diagnosis, and the future of AI-assisted brain decoding.


    RECOMMENDED PODCAST:

    How Do You Use ChatGPT with Dan Shipper.

    Dan Shipper talks to programmers, writers, founders, academics, tech executives, and others to walk through all of their ChatGPT use cases (including Nathan!). They even use ChatGPT together, live on the show. Listen to How Do You Use ChatGPT? from Dan Shipper and the team at Every, wherever you get your podcasts : https://link.chtbl.com/hdyuchatgpt


    SPONSORS:

    Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/


    The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR


    Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.


    Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.


    CHAPTERS:

    (00:00) Introduction

    (07:24) Evolution of Brain Decoding Tech

    (10:33) From MindEye1 to MindEye2

    (14:12) Sponsor: Omneky

    (14:43) Foundation Models for Enhanced AI

    (26:49) Future of Image Reconstruction from Brain Data

    (34:10) Sponsors: Brave / Plumb / Squad

    (44:23) Evaluating AI-Generated Reconstructions

    (48:10) Understanding Semantic Info in the Brain

    (51:47) Potential and Ethics of Brain Data Usage

    (57:13) Foundation Models in Neuroscience

    (01:02:46) Future of Brain-Computer Interfaces


    Interfacing with AI, with Linus Lee of Notion Apr 15, 2024
    Show notes

    In this episode, Linus Lee, AI product leader at Notion, joins us to discuss his groundbreaking projects and unique approach to exploring AI systems. He shares his toolkit and insights on language model capabilities, along with his vision for the future of AI, which is centered on amplifying human intelligence. Linus inspires listeners to engage deeply with AI and to steer its development in ways that enhance human creativity and agency.


    RECOMMENDED PODCAST:

    How Do You Use ChatGPT Dan Shipper talks to programmers, writers, founders, academics, tech executives, and others to walk through all of their ChatGPT use cases (including Nathan!). They even use ChatGPT together, live on the show. Listen to How Do You Use ChatGPT? from Dan Shipper and the team at Every, wherever you get your podcasts. https://link.chtbl.com/hdyuchatgpt


    SPONSORS:

    Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/


    The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR


    Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.


    Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.


    CHAPTERS :

    (00:00) Introduction

    (10:16) AI and Creativity

    (14:37) Sponsor: Omneky

    (14:57) AI Research Development

    (20:05) Bridging Modalities

    (32:38) Sponsor: Brave / Plumb / Squad

    (35:36) Transformer Models and Techniques

    (52:32) Personal AI Research Setup

    (58:55) Leveraging Language Models for Coding

    (01:02:05) AI Model Development and Notion AI

    (01:22:05) Future of AI Models and App Development

    (01:32:51) Emerging Trends in AI


    Data, data, everywhere - enough for AGI? Apr 13, 2024
    Show notes

    In this podcast, Nathan and Nick dive deep into the data requirements for achieving Artificial General Intelligence. They explore the current paradigms, the role of data in approximating intelligence, and the scaling trends for GPT models. The discussion covers various datasets, from email and Twitter to YouTube and genomic data, as they analyze the feasibility of reaching the target of 100 trillion high-quality tokens. While the bull case suggests an abundance of data, the bear case highlights the limits on high-quality data, prompting a fascinating exploration of what makes data good for AI and the potential for AI to generate its own data.


    Sponsors

    Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/


    The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR


    Head to Squad to access global engineering without the headache and at a fraction of the cost: head to http://choosesquad.com/ and mention “Turpentine” to skip the waitlist.


    Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.


    Chapters

    (00:00) Introduction

    (05:04) Scaling Hypothesis of Intelligence

    (07:32) Is There Enough High Quality Data?

    (10:19) Algorithms Impacting Data Requirements

    (17:42) Sponsor : Omneky

    (18:04) Estimating High Quality Token Requirements

    (24:07) Astronomy and YouTube Data Scale

    (29:42) Genomics Data

    (37:58) Sponsors : Brave / Plumb / Squad

    (41:16) Code Datasets and Synthetic Data

    (45:48) The Bear Case: Quality and Usability of Data

    (50:54) Investment Trends and Compute Efficiency

    (54:19) Training Run

    (57:21) Synthetic Data Generation and Self-Play


    Inside China's AI Ecosystem: A View From Beijing Apr 10, 2024
    Show notes

    In this episode, we explore the Chinese AI ecosystem with 'L-squared,' an anonymous tech worker based in Beijing. We discuss major players, model quality, public engagement, regulation, and the US 'chip ban.' Discover the similarities and differences between US and Chinese AI landscapes, and gain a nuanced perspective on the current state of AI in China.


    USEFUL RESOURCES:

    Testing Chinese models: Yi-34B-Chat (made by Kai-Fu Lee's team 01.AI) can be tried out via Replicate (https://replicate.com/01-ai/yi-34b-chat) or Hugging Face. You can also use the ChatGLM playground (https://open.bigmodel.cn/trialcenter) and Baidu's ERNIE (https://yiyan.baidu.com/) without a Chinese SIM card.


    Benchmarking models: SuperCLUE is one of the most prominent benchmarks - the latest results are on GitHub (https://github.com/CLUEbenchmark/SuperCLUE) and the paper explaining the methodology is here (https://arxiv.org/abs/2307.15020).


    Regulation: Explainer (https://carnegieendowment.org/2023/07/10/china-s-ai-regulations-and-how-they-get-made-pub-90117) from Matt Sheehan; piece (https://www.chinatalk.media/p/how-tight-ai-regs-hurt-chinese-firms) on how genAI regs are affecting Chinese companies.


    US-China competition: Jeff Ding's work (https://www.tandfonline.com/doi/full/10.1080/09692290.2023.2173633) on the diffusion deficit in S&T; Bloomberg piece (https://www.bloomberg.com/graphics/2023-china-huawei-semiconductor/) on Huawei's semiconductor development efforts.


    Staying up to date: Sign up to alerts from CSET's Scout tool (https://scout.eto.tech/); subscribe to Concordia AI's AI safety (https://aisafetychina.substack.com/) in China newsletter (disclaimer: I used to work at Concordia!)


    A 2016 profile (https://chinai.substack.com/p/chinai-37-happy-20th-anniversary) on Microsoft Research Asia by Wang Jingjing, covered in Jeff Ding's ChinAI newsletter


    SPONSORS:

    Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, instead of...does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive


    Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off http://www.omneky.com/


    The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR


    Head to Squad to access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist.


    Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.


    TIMESTAMPS:

    (00:00) Introduction

    (07:24) China's AI Ecosystem

    (13:40) Public AI Engagement

    (17:33) Sponsors : OCI / Omneky

    (18:50) AI Tools Comparison

    (35:37) Sponsors : Brave / Squad / Plumb

    (39:14) AI Regulatory Maze

    (51:02) AI Performance, Censorship

    (55:28) Chinese AI Regulations

    (01:04:37) Tech, Research Role

    (01:12:11) Global AI Ecosystem

    (01:23:22) Cultural AI Perspectives

    (01:29:14) AI Safety, Cooperation




    The AI Email Assistant I've Been Waiting for, with Andrew Lee of Shortwave Apr 08, 2024
    Show notes

    In this episode, Nathan sits down with Andrew Lee, founder of Shortwave, an AI-powered email app that describes itself as “the smartest email app on planet earth.” They discuss Shortwave’s RAG stack, how the AI assistant works, the models Shortwave is using, and much more. This is truly a masterclass in RAG app development.


    Sponsors :

    Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive


    The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR


    Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.


    Head to Squad to access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist.


    TIMESTAMPS:

    (00:00) - Intro

    (01:07) - Shortwave: AI-Powered Email

    (06:22) - Genesis of Shortwave

    (15:25) - Sponsors: Oracle / Omneky

    (16:46) - Data Processing Pipeline

    (21:57) - Choosing a Vector Database

    (26:34) - How the AI Assistant Works

    (36:24) - Sponsors: Brave / Plumb / Squad

    (40:53) - Fine-Tuning & Hosting Models

    (45:11) - Email Automation

    (47:55) - Email Retrieval

    (51:44) - Optimizing AI Performance

    (53:20) - Safety & Embedded Ethics

    (01:04:51) - Strategic Product Launches

    (01:09:58) - Inbox Management

    (01:12:24) - The Future of Collaborative AI

    (01:18:54) - Scaling Personalized Outreach

    (01:26:04) - Closing Thoughts & What's Next


    Opening AI's Black Box with Prof. David Bau, Koyena Pal, and Eric Todd of Northeastern University Apr 05, 2024
    Show notes

    In this episode, we dive deep into the inner workings of large language models with Professor David Bau and grad students Koyena Pal and Eric Todd from Northeastern University. Koyena shares insights from her Future Lens paper, which shows that even mid-sized language models think multiple tokens ahead. Eric discusses the fascinating concept of Function Vectors - complex patterns of activity spread across transformer layers that enable in-context learning. Professor Bau connects the dots between these projects and the lab's broader interpretability research agenda, identifying key abstractions that link low-level computations to higher-level model behaviors.


    SPONSORS:


    Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive


    ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more.


    Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com


    The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR


    Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.


    Head to Squad to access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist.


    TIMESTAMPS:

    (00:00) Intro

    (04:03) Reverse Engineering AI

    (10:10) Factual Knowledge Localization

    (16:34) Sponsors: Oracle | Omneky | On Deck

    (18:27) Future Lens Paper Intro

    (23:54) Choosing GPT-J

    (26:54) Vocabulary Prediction

    (30:36) Sponsors: Brave | Plumb | Squad

    (33:13) Fixed Prompt

    (35:57) Soft Prompt

    (41:32) Future Lens Results Analysis

    (51:50) Tooling & Open Source Code

    (56:07) Larger Models & Mamba Probes

    (1:04:10) Function Vectors Paper

    (1:09:39) Extracting & Patching Vectors

    (1:13:30) Encoding Task Understanding

    (1:15:36) Expert Models Implications

    (1:18:09) Conclusion


    Unbounded AI-Assisted Research with Elicit Founders Andreas Stuhlmüller and Jungwon Byun Apr 03, 2024
    Show notes

    In this episode, Nathan sits down with Elicit co-founders Andreas Stuhlmüller and Jungwon Byun to discuss their mission to make AI-assisted research more accessible and reliable. Learn about their unique approach to task decomposition, which allows language models to accurately tackle complex research questions. We delve into the company's tech stack, their transition from nonprofit to startup, and their dedication to creating trustworthy AI tools for high-stakes applications. Join us for an exploration of the future of AI in research.


    The Cognitive Revolution is part of the Turpentine podcast network. Learn more: www.turpentine.co


    HELPFUL LINKS:

    Elicit : https://elicit.com/

    Andreas Stuhlmüller : https://twitter.com/stuhlmueller

    Jungwon Byun : https://twitter.com/jungofthewon


    SPONSORS:


    Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive


    ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more.


    Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com


    The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR


    Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.


    Head to Squad to access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist.


    TIMESTAMPS:

    (00:00:30) Intro

    (00:05:05) What is Elicit?

    (00:06:03) Vision for Elicit

    (00:10:10) Making research transparent

    (00:11:58) How to use it?

    (00:15:27) Sponsors: Oracle | On Deck | Omneky

    (00:18:21) Task Decomposition

    (00:23:48) Defining the task

    (00:26:30) Eliciting fine-grained evaluations

    (00:28:06) Hallucination rates

    (00:30:22) Models in play

    (00:31:30) Sponsors: Brave | Plumb | Squad

    (00:34:26) Shipping a new feature every week

    (00:36:10) What was not possible a year ago?

    (00:38:26) Chain of thought

    (00:43:47) Tactically, how to structure the chain of thought

    (00:45:21) Data sets and fine-tuning

    (00:51:23) Scaffolding

    (00:53:22) Translating structure into more compute

    (00:54:27) Infrastructure for investigating papers in detail

    (00:59:50) Emphasis on high-value use cases over speed

    (01:00:33) Balancing long-term safety and misuse concerns

    (01:02:36) Monitoring research progress for negative impact

    (01:06:05) Evolving user base and usage patterns

    (01:06:52) Biomedicine as a key domain for Elicit

    (01:08:57) Expanding results and depth of processing

    (01:11:40) Reorganizing information for better understanding

    (01:13:12) Habit formation and frequency of use

    (01:14:43) The concept of an AI bundle subscription

    (01:18:09) Nonprofit to Commercial Venture

    (01:20:08) Nonprofit Team and Commercial Mission

    (01:20:39) Hiring Needs at Elicit


    Mamba-Palooza: 90 Days of Mamba-Inspired Research with Jason Meaux: Part 2 Mar 30, 2024
    Show notes

    In this second part of a two episode series, Nathan and AI scout Jason Meaux provide a sweeping overview of the first 90 days of Mamba-inspired research. They discusstMamba's application to computer vision, experiments in extending effective context length, the potential problem of internal rotting states, and the use of hybrid SSMs in biology.Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api


    LINKS:

    Show Notes and Paper Links: https://docs.google.com/document/d/1NK_a3deVL_aczORmSRw8LyujNPotpO7Kd90sIRj9Qx0/edit?usp=sharing

    Nathan's original Mamba Deep Dive

    • Spotify: https://open.spotify.com/episode/3b3zeDVU6fE2yV9vdNVLqX?si=dc7a885d601d4a58
    • Apple: https://podcasts.apple.com/us/podcast/emergency-pod-mamba-memory-and-the-ssm-moment/id1669813431?i=1000639397566


    X/SOCIAL:

    @labenz (Nathan)


    SPONSORS: ORACLE | OMNEKY | BRAVE | ON DECK | SQUAD

    Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive


    Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com


    The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api


    ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more.


    💥 Access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist.


    TIMESTAMPS:

    (00:00) - Episode Start

    (00:01:14) - Nathan and Jason’s Bet

    (00:04:51) - U-Mamba

    (00:15:10) - Sponsors: Oracle | Omneky

    (00:06:08) - Swin U-Mamba

    (00:18:59) - Vision Mamba

    (00:24:30 - VMamba

    (00:27:26) - VM-UNet

    (00:30:37) - Sponsors: Brave | On Deck

    (00:35:15) - SegMamba

    (00:36:59) - Vivim

    (00:37:31) - Mamba Morph

    (00:39:01) - Graph Mamba

    (00:43:15) - Long Mamba

    (00:59:54) - Evo and StripedHyena


    The Cognitive Revolution is produced by Turpentine: a media network covering technology, business, and culture.

    Producer: Vivian Meng

    Editor: Graham Bessellieu

    For sponsor or guest inquiries, email: vivian@turpentine.co


    Previous 1 26 27 28 29 30 40 Next

    Related Podcasts

    Reply All

    1

    Reply All Games & Hobbies
    Inside VR & AR

    2

    Inside VR & AR Gadgets
    Note to Self

    3

    Note to Self News
    BrainStuff

    4

    BrainStuff Natural Sciences
    This Week in Tech (Audio)

    5

    This Week in Tech (Audio) News
    Hands-On Tech (Audio)

    6

    Hands-On Tech (Audio) Technology
    footer-logo

    Contact Us

    Toll Free: 844-670-7747

    Links

    • Home
    • Top Charts
    • Networks
    • Apps
    • Independents Podcasts
    • Podcast Advertising
    • Podcast News
    • Contact Us
    • About Us
    • Analytics & Insights

    Stay Connected

      Privacy, Terms of Use & Our Code of Ethics Protecting Content Creators Copyrights