Technology

Doom Debates!

It’s time to talk about the end of the world. With your host, Liron Shapira.

lironshapira.substack.com

Latest Episodes:

I talked to Dr. Phil about AI extinction risk! Sep 10, 2024

Show notes

It's finally here, the Doom Debates / Dr. Phil crossover episode you've all been asking for 😂

The full episode is called “AI: The Future of Education?"

While the main focus was AI in education, I'm glad the show briefly touched on how we're all gonna die. Everything in the show related to AI extinction is clipped here.

Join the conversation at DoomDebates.com or youtube.com/@DoomDebates, suggest topics or guests, and help us spread awareness about the urgent risk of AI extinction. Thanks for watching.

Get full access to Doom Debates at lironshapira.substack.com/subscribe

Debate with Roman Yampolskiy: 50% vs. 99.999% P(Doom) from AI Sep 06, 2024

Show notes

Dr. Roman Yampolskiy is the director of the Cyber Security Lab at the University of Louisville. His new book is called AI: Unexplainable, Unpredictable, Uncontrollable.

Roman’s P(doom) from AGI is a whopping 99.999%, vastly greater than my P(doom) of 50%. It’s a rare debate when I’m LESS doomy than my opponent!

This is a cross-post from the For Humanity podcast hosted by John Sherman. For Humanity is basically a sister show of Doom Debates. Highly recommend subscribing!

00:00 John Sherman’s Intro

05:21 Diverging Views on AI Safety and Control

12:24 The Challenge of Defining Human Values for AI

18:04 Risks of Superintelligent AI and Potential Solutions

33:41 The Case for Narrow AI

45:21 The Concept of Utopia

48:33 AI's Utility Function and Human Values

55:48 Challenges in AI Safety Research

01:05:23 Breeding Program Proposal

01:14:05 The Reality of AI Regulation

01:18:04 Concluding Thoughts

01:23:19 Celebration of Life

This episode on For Humanity’s channel: https://www.youtube.com/watch?v=KcjLCZcBFoQ

For Humanity on YouTube: https://www.youtube.com/@ForHumanityPodcast

For Humanity on X: https://x.com/ForHumanityPod

Buy Roman’s new book: https://www.amazon.com/Unexplainable-Unpredictable-Uncontrollable-Artificial-Intelligence/dp/103257626X

Join the conversation at DoomDebates.com or youtube.com/@DoomDebates, suggest topics or guests, and help us spread awareness about the urgent risk of AI extinction. Thanks for watching.

Get full access to Doom Debates at lironshapira.substack.com/subscribe

Jobst Landgrebe Doesn't Believe In AGI | Liron Reacts Sep 04, 2024

Show notes

Jobst Landgrebe, co-author of Why Machines Will Never Rule The World: Artificial Intelligence Without Fear, argues that AI is fundamentally limited in achieving human-like intelligence or consciousness due to the complexities of the human brain which are beyond mathematical modeling.

Contrary to my view, Jobst has a very low opinion of what machines will be able to achieve in the coming years and decades.

He’s also a devout Christian, which makes our clash of perspectives funnier.

00:00 Introduction

03:12 AI Is Just Pattern Recognition?

06:46 Mathematics and the Limits of AI

12:56 Complex Systems and Thermodynamics

33:40 Transhumanism and Genetic Engineering

47:48 Materialism

49:35 Transhumanism as Neo-Paganism

01:02:38 AI in Warfare

01:11:55 Is This Science?

01:25:46 Conclusion

Source podcast: https://www.youtube.com/watch?v=xrlT1LQSyNU

Join the conversation at DoomDebates.com or youtube.com/@DoomDebates, suggest topics or guests, and help us spread awareness about the urgent risk of AI extinction. Thanks for watching.

Get full access to Doom Debates at lironshapira.substack.com/subscribe

Arvind Narayanan's Makes AI Sound Normal | Liron Reacts Aug 29, 2024

Show notes

Today I’m reacting to the 20VC podcast with Harry Stebbings and Princeton professor Arvind Narayanan.

Prof. Narayanan is known for his critical perspective on the misuse and over-hype of artificial intelligence, which he often refers to as “AI snake oil”. Narayanan’s critiques aim to highlight the gap between what AI can realistically achieve, and the often misleading promises made by companies and researchers.

I analyze Arvind’s takes on the comparative dangers of AI and nuclear weapons, the limitations of current AI models, and AI’s trajectory toward being a commodity rather than a superintelligent god.

00:00 Introduction

01:21 Arvind’s Perspective on AI

02:07 Debating AI's Compute and Performance

03:59 Synthetic Data vs. Real Data

05:59 The Role of Compute in AI Advancement

07:30 Challenges in AI Predictions

26:30 AI in Organizations and Tacit Knowledge

33:32 The Future of AI: Exponential Growth or Plateau?

36:26 Relevance of Benchmarks

39:02 AGI

40:59 Historical Predictions

46:28 OpenAI vs. Anthropic

52:13 Regulating AI

56:12 AI as a Weapon

01:02:43 Sci-Fi

01:07:28 Conclusion

Original source: https://www.youtube.com/watch?v=8CvjVAyB4O4

Follow Arvind Narayanan: x.com/random_walker

Follow Harry Stebbings: x.com/HarryStebbings

Join the conversation at DoomDebates.com or youtube.com/@DoomDebates, suggest topics or guests, and help us spread awareness about the urgent risk of AI extinction. Thanks for watching.

Get full access to Doom Debates at lironshapira.substack.com/subscribe

Bret Weinstein Bungles It On AI Extinction | Liron Reacts Aug 27, 2024

Show notes

Today I’m reacting to the Bret Weinstein’s recent appearance on the Diary of a CEO podcast with Steven Bartlett. Bret is an evolutionary biologist known for his outspoken views on social and political issues.

Bret gets off to a promising start, saying that AI risk should be “top of mind” and poses “five existential threats”. But his analysis is shallow and ad-hoc, and ends in him dismissing the idea of trying to use regulation as a tool to save our species from a recognized existential threat.

I believe we can raise the level of AI doom discourse by calling out these kinds of basic flaws in popular media on the subject.

00:00 Introduction

02:02 Existential Threats from AI

03:32 The Paperclip Problem

04:53 Moral Implications of Ending Suffering

06:31 Inner vs. Outer Alignment

08:41 AI as a Tool for Malicious Actors

10:31 Attack vs. Defense in AI

18:12 The Event Horizon of AI

21:42 Is Language More Prime Than Intelligence?

38:38 AI and the Danger of Echo Chambers

46:59 AI Regulation

51:03 Mechanistic Interpretability

56:52 Final Thoughts

Original source: youtube.com/watch?v=_cFu-b5lTMU

Follow Bret Weinstein: x.com/BretWeinstein

Follow Steven Bartlett: x.com/StevenBartlett

Join the conversation at DoomDebates.com or youtube.com/@DoomDebates, suggest topics or guests, and help us spread awareness about the urgent risk of AI extinction. Thanks for watching.

Get full access to Doom Debates at lironshapira.substack.com/subscribe

SB 1047 AI Regulation Debate: Holly Elmore vs. Greg Tanaka Aug 26, 2024

Show notes

California's SB 1047 bill, authored by CA State Senator Scott Wiener, is the leading attempt by a US state to regulate catastrophic risks from frontier AI in the wake of President Biden's 2023 AI Executive Order.

Today’s debate:

Holly Elmore, Executive Director of Pause AI US, representing Pro- SB 1047

Greg Tanaka, Palo Alto City Councilmember, representing Anti- SB 1047

Key Bill Supporters: Geoffrey Hinton, Yoshua Bengio, Anthropic, PauseAI, and about a 2/3 majority of California voters surveyed.

Key Bill Opponents: OpenAI, Google, Meta, Y Combinator, Andreessen Horowitz

Links

Greg mentioned that the "Supporters & Opponents" tab on this page lists organizations who registered their support and opposition. The vast majority of organizations listed here registered support against the bill: https://digitaldemocracy.calmatters.org/bills/ca_202320240sb1047

Holly mentioned surveys of California voters showing popular support for the bill:1. Center for AI Safety survey shows 77% support: https://drive.google.com/file/d/1wmvstgKo0kozd3tShPagDr1k0uAuzdDM/view2. Future of Life Institute survey shows 59% support: https://futureoflife.org/ai-policy/poll-shows-popularity-of-ca-sb1047/

Follow Holly: x.com/ilex_ulmus

Follow Greg: x.com/GregTanaka

Join the conversation on DoomDebates.com or youtube.com/@DoomDebates, suggest topics or guests, and help us spread awareness about the urgent risk of extinction. Thanks for watching.

Get full access to Doom Debates at lironshapira.substack.com/subscribe

David Shapiro Part II: Unaligned Superintelligence Is Totally Fine? Aug 22, 2024

Show notes

Today I’m reacting to David Shapiro’s response to my previous episode, and also to David’s latest episode with poker champion & effective altruist Igor Kurganov.

I challenge David's optimistic stance on superintelligent AI inherently aligning with human values. We touch on factors like instrumental convergence and resource competition. David and I continue to clash over whether we should pause AI development to mitigate potential catastrophic risks. I also respond to David's critiques of AI safety advocates.

00:00 Introduction

01:08 David's Response and Engagement

03:02 The Corrigibility Problem

05:38 Nirvana Fallacy

10:57 Prophecy and Faith-Based Assertions

22:47 AI Coexistence with Humanity

35:17 Does Curiosity Make AI Value Humans?

38:56 Instrumental Convergence and AI's Goals

46:14 The Fermi Paradox and AI's Expansion

51:51 The Future of Human and AI Coexistence

01:04:56 Concluding Thoughts

Join the conversation on DoomDebates.com or youtube.com/@DoomDebates, suggest topics or guests, and help us spread awareness about the urgent risk of extinction. Thanks for listening.

Get full access to Doom Debates at lironshapira.substack.com/subscribe

Maciej Ceglowski, Pinboard Founder, Says the Idea of Superintelligence “Eats Smart People” | Liron Reacts Aug 19, 2024

Show notes

Maciej Ceglowski is an entrepreneur and owner of the bookmarking site Pinboard. I’ve been a long-time fan of his sharp, independent-minded blog posts and tweets.

In this episode, I react to a great 2016 talk he gave at WebCamp Zagreb titled Superintelligence: The Idea That Eats Smart People. This talk was impressively ahead of its time, as the AI doom debate really only heated up in the last few years.

---

00:00 Introduction

02:13 Historical Analogies and AI Risks

05:57 The Premises of AI Doom

08:25 Mind Design Space and AI Optimization

15:58 Recursive Self-Improvement and AI

39:44 Arguments Against Superintelligence

45:20 Mental Complexity and AI Motivations

47:12 The Argument from Just Look Around You

49:27 The Argument from Life Experience

50:56 The Argument from Brain Surgery

53:57 The Argument from Childhood

58:10 The Argument from Robinson Crusoe

01:00:17 Inside vs. Outside Arguments

01:06:45 Transhuman Voodoo and Religion 2.0

01:11:24 Simulation Fever

01:18:00 AI Cosplay and Ethical Concerns

01:28:51 Concluding Thoughts and Call to Action

---

Follow Maciej: x.com/pinboard

Follow Doom Debates:

* youtube.com/@DoomDebates

* DoomDebates.com

* x.com/liron

* Search “Doom Debates” in your podcast player

Get full access to Doom Debates at lironshapira.substack.com/subscribe

David Shapiro Doesn't Get PauseAI | Liron Reacts Aug 16, 2024

Show notes

Today I’m reacting to David Shapiro’s latest YouTube video: “Pausing AI is a spectacularly bad idea―Here's why”.

In my opinion, every plan that doesn’t evolve pausing frontier AGI capabilities development now is reckless, or at least every plan that doesn’t prepare to pause AGI once we see a “warning shot” that enough people agree is terrifying.

We’ll go through David’s argument point by point, to see if there are any good points about why maybe pausing AI might actually be a bad idea.

00:00 Introduction

01:16 The Pause AI Movement

03:03 Eliezer Yudkowsky’s Epistemology

12:56 Rationalist Arguments and Evidence

24:03 Public Awareness and Legislative Efforts

28:38 The Burden of Proof in AI Safety

31:02 Arguments Against the AI Pause Movement

34:20 Nuclear Proliferation vs. AI

34:48 Game Theory and AI

36:31 Opportunity Costs of an AI Pause

44:18 Axiomatic Alignment

47:34 Regulatory Capture and Corporate Interests

56:24 The Growing Mainstream Concern for AI Safety

Follow David:

* youtube.com/@DaveShap

* x.com/DaveShapi

Follow Doom Debates:

* DoomDebates.com

* youtube.com/@DoomDebates

* x.com/liron

Get full access to Doom Debates at lironshapira.substack.com/subscribe

David Brooks's Non-Doomer Non-Argument in the NY Times | Liron Reacts Aug 15, 2024

Show notes

John Sherman and I go through David Brooks’s appallingly bad article in the New York Times titled “Many People Fear AI. They Shouldn’t.”

For Humanity is basically the sister podcast to Doom Debates. We have the same mission to raise awareness of the urgent AI extinction threat, and build grassroots support for pausing new AI capabilities development until it’s safe for humanity.

Subscribe to it on YouTube: https://www.youtube.com/@ForHumanityPodcast

Follow it on X: https://x.com/ForHumanityPod

Get full access to Doom Debates at lironshapira.substack.com/subscribe

Our TOPPODCAST Picks

Follow Us

Stay Connected

Doom Debates!

Related Podcasts

Links

Stay Connected