Mystery AI Hype Theater 3000

Latest Episodes:

The UK's Misplaced Enthusiasm (with Gina Neff), 2025.01.20 Feb 05, 2025

Show notes

In January, the United Kingdom's new Labour Party prime minister, Keir Starmer, announced a new initiative to go all in on AI in the hopes of big economic returns, with a promise to “mainline” it into the country’s veins: everything from offering public data to private companies, to potentially fast-tracking miniature nuclear power plants to supply energy to data centers. UK-based researcher Gina Neff helps explain why this flashy policy proposal is mostly a blank check for big tech, and has little to offer either the economy or working people.

Gina Neff is executive director of the Minderoo Centre for Technology and Democracy at the University of Cambridge, and a professor of responsible AI at Queen Mary University of London.

References:

The AI Opportunities Action Plan

‘Mainlined into UK’s veins’: Labour announces huge public rollout of AI

Gina Neff: Can democracy survive AI?

Labour's AI Action Plan - a gift to the far right

Fresh AI Hell:

"AI" tool for predicting how Parliament will react to policy proposals

"AI" detects age based on hand movements

Apple Intelligence misleading summaries of news

Book simplification as a service

CEO doesn't understand why kid turned AI features of toy off

Check out future streams on Twitch. Meanwhile, send us any AI Hell you see.

Find our book The AI Con here, and MAIHT3k merch here.

Subscribe to our newsletter via Buttondown.

Emily

Bluesky: emilymbender.bsky.social
Mastodon: dair-community.social/@EmilyMBender

Alex

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Ozzy Llinas Goodman.

Sam Altman's Fever Dream, 2025.01.13 Jan 22, 2025

Show notes

Not only is OpenAI's new o3 model allegedly breaking records for how close an LLM can get to the mythical "human-like thinking" of AGI, but Sam Altman has some, uh, reflections for us as he marks two years since the official launch of ChatGPT. Emily and Alex kick off the new year unraveling these truly fantastical stories.

References:

OpenAI o3 Breakthrough High Score on ARC-AGI-Pub

From the blog of Sam Altman: Reflections

More about the ARC Prize

o3's environmental impact

The brain is a computer is a brain
Fresh AI Hell:

"Time to Edit" as a metric predicting the singularity (Contributed by Warai Otoko)

AI 'tasting' colors

An AI...faucet??

Seattle Public Schools calls ChatGPT a "transformative technology"

A GitHub pull request closed because change would have been unfriendly to "AI" chat interface

Cohere working with Palantir

Elsevier rewrites papers with "AI" without telling authors, editors

The UK: mainlining AI straight into their veins

Check out future streams on Twitch. Meanwhile, send us any AI Hell you see.

Find our book The AI Con here, and MAIHT3k merch here.

Subscribe to our newsletter via Buttondown.

Emily

Bluesky: emilymbender.bsky.social
Mastodon: dair-community.social/@EmilyMBender

Alex

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Ozzy Llinas Goodman.

Episode 47: Hell is Other People's AI Hype, December 9 2024 Dec 30, 2024

Show notes

It’s been a long year in the AI hype mines. And no matter how many claims Emily and Alex debunk, there's always a backlog of Fresh AI Hell. This week, another whirlwind attempt to clear it, with plenty of palate cleansers along the way.
Fresh AI Hell:
Part I: Education
Medical residency assignments
"AI generated" UCLA course
"Could ChatGPT get an engineering degree?"
AI letters of recommendation
Chaser: 'AI' isn't Tinkerbell and we don’t have to clap
Part II: Potpourri, as in really rotten
AI x parenting
Et tu, Firefox?
US military tests AI machine gun
"Over-indexing" genAI failings
AI denying social benefits
Chaser: AI 'granny' vs scammers
Part III: The Endangered Information Ecosystem
Fake Emily quote in LLM-written article
Protecting Wikipedia
AI: the new plastic
Google AI on 'dressing'
"AI" archaeology
Misinfo scholar used ChatGPT
OpenAI erases lawsuit evidence
LAT "AI" bias meter
WaPo AI search: The Washington Post burns its own archive

Chaser: ShotSpotter as art

Part IV: Surveillance, AI in science/medicine
Apple patents "body data"
Chatbots "defeat" doctors
Algorithm for healthcare "overuse"
"AI friendships"
"Can LLMs Generate Novel Research Ideas?"
Another LLM for science
Chaser: FTC vs Venntel

Part V: They tell us to believe the hype

Thomas Friedman: AGI is coming
Matteo Wong on o1's 'reasoning'
WIRED editor: believe the hype
Salesforce CEO: The "unlimited age"

Chaser: Emily and Alex's forthcoming book! Pre-order THE AI CON: How to Fight Big Tech’s Hype and Create the Future We Want at TheCon.AI.

Check out future streams on Twitch. Meanwhile, send us any AI Hell you see.

Find our book The AI Con here, and MAIHT3k merch here.

Subscribe to our newsletter via Buttondown.

Emily

Bluesky: emilymbender.bsky.social
Mastodon: dair-community.social/@EmilyMBender

Alex

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Ozzy Llinas Goodman.

Episode 46: AGI Funny Business (Model), with Brian Merchant, December 2 2024 Dec 18, 2024

Show notes

Once upon a time, artificial general intelligence was the only business plan OpenAI seemed to have. Tech journalist Brian Merchant joins Emily and Alex for a time warp to the beginning of the current wave of AI hype, nearly a decade ago. And it sure seemed like Elon Musk, Sam Altman, and company were luring investor dollars to their newly-formed venture solely on the hand-wavy promise that someday, LLMs themselves would figure out how to turn a profit.

Brian Merchant is an author, journalist in residence at the AI Now Institute, and co-host of the tech news podcast System Crash.

References:

Elon Musk and partners form nonprofit to stop AI from ruining the world

How Elon Musk and Y Combinator Plan to Stop Computers From Taking Over

Elon Musk's Billion-Dollar AI Plan Is About Far More Than Saving the World

Brian’s recent report on the business model of AGI, for the AI Now Institute: AI Generated Business: The rise of AGI and the rush to find a working revenue model

Previously on MAIHT3K: Episode 21: The True Meaning of 'Open Source' (feat. Sarah West and Andreas Liesenfeld)

Fresh AI Hell:

OpenAI explores advertising as it steps up revenue drive

If an AI company ran Campbell's Soup with the same practices they use to handle data

Humans are the new 'luxury item'

Itching to write a book? AI publisher Spines wants to make a deal

A company pitched Emily her own 'verified avatar'

Don't upload your medical images to chatbots

A look at a pilot program in Georgia that uses 'jailbots' to track inmates

Check out future streams on Twitch. Meanwhile, send us any AI Hell you see.

Find our book The AI Con here, and MAIHT3k merch here.

Subscribe to our newsletter via Buttondown.

Emily

Bluesky: emilymbender.bsky.social
Mastodon: dair-community.social/@EmilyMBender

Alex

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Ozzy Llinas Goodman.

Episode 45: Billionaires, Influencers, and Ed Tech (feat. Adrienne Williams), November 18 2024 Nov 26, 2024

Show notes

From Bill Gates to Mark Zuckerberg, billionaires with no education expertise keep using their big names and big dollars to hype LLMs for classrooms. Promising ‘comprehensive AI tutors', or just ‘educator-informed’ tools to address understaffed classrooms, this hype is just another round of Silicon Valley pointing to real problems -- under-supported school systems -- but then directing attention and resources to their favorite toys. Former educator and DAIR research fellow Adrienne Williams joins to explain the problems this tech-solutionist redirection fails to solve, and the new ones it creates.

Adrienne Williams started organizing in 2018 while working as a junior high teacher for a tech owned charter school. She expanded her organizing in 2020 after her work as an Amazon delivery driver, where many of the same issues she saw in charter schools were also in evidence. Adrienne is a Public Voices Fellow on Technology in the Public Interest with The OpEd Project in partnership with the MacArthur Foundation, as well as a Research Fellow at both (DAIR) and Just Tech.

References:

Funding Helps Teachers Build AI Tools

Sal Khan's 2023 Ted Talk: AI in the classroom can transform education

Bill Gates: My trip to the frontier of AI education

Background: Cory Booker Hates Public Schools
Background: Cory Booker's track record on education

Book: Access is Capture: How Edtech Reproduces Racial Inequality
Book: Disruptive Fixation: School Reform and the Pitfalls of Techno-Idealism

Previously on MAIHT3K: Episode 26, Universities Anxiously Buy Into the Hype (feat. Chris Gilliard)
Episode 17: Back to School with AI Hype in Education (feat. Haley Lepp)

Fresh AI Hell:

"Streamlining" teaching

Google, Microsoft and Perplexity are promoting scientific racism in 'AI overviews'

'Whisper' medical transcription tool used in hospitals is making things up

X's AI bot can't tell the difference between a bad game and vandalism

Prompting is not a substitute for probability measurements in large language models

Yet another 'priestbot'

Self-driving wheelchairs at Seattle-Tacoma International Airpot

Check out future streams on Twitch. Meanwhile, send us any AI Hell you see.

Find our book The AI Con here, and MAIHT3k merch here.

Subscribe to our newsletter via Buttondown.

Emily

Bluesky: emilymbender.bsky.social
Mastodon: dair-community.social/@EmilyMBender

Alex

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Ozzy Llinas Goodman.

Episode 44: OpenAI's Ridiculous 'Reasoning', October 28 2024 Nov 13, 2024

Show notes

The company behind ChatGPT is back with bombastic claim that their new o1 model is capable of so-called "complex reasoning." Ever-faithful, Alex and Emily tear it apart. Plus the flaws in a tech publication's new 'AI hype index,' and some palette-cleansing new regulation against data-scraping worker surveillance.

References:

OpenAI: Learning to reason with LLMs

Fresh AI Hell:

MIT Technology Review's AI 'AI hype index'

CFPB Takes Action to Curb Unchecked Worker Surveillance

Check out future streams on Twitch. Meanwhile, send us any AI Hell you see.

Find our book The AI Con here, and MAIHT3k merch here.

Subscribe to our newsletter via Buttondown.

Emily

Bluesky: emilymbender.bsky.social
Mastodon: dair-community.social/@EmilyMBender

Alex

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Ozzy Llinas Goodman.

Episode 43: AI Companies Gamble with Everyone's Planet (feat. Paris Marx), October 21 2024 Oct 31, 2024

Show notes

Technology journalist Paris Marx joins Alex and Emily for a conversation about the environmental harms of the giant data centers and other water- and energy-hungry infrastructure at the heart of LLMs and other generative tools like ChatGPT -- and why the hand-wavy assurances of CEOs that 'AI will fix global warming' are just magical thinking, ignoring a genuine climate cost and imperiling the clean energy transition in the US.

Paris Marx is a tech journalist and host of the podcast Tech Won’t Save Us. He also recently launched a 4-part series, Data Vampires, (which features Alex) about the promises and pitfalls of data centers like the ones AI boosters rely on.

References:

Eric Schmidt says AI more important than climate goals

Microsoft's sustainability report

Sam Altman's “The Intelligence Age” promises AI will fix the climate crisis

Previously on MAIHT3K: Episode 19: The Murky Climate and Environmental Impact of Large Language Models, November 6 2023

Fresh AI Hell:

Rosetta to linguists: "Embrace AI or risk extinction" of endangered languages

A talking collar that you can use to pretend to talk with your pets

Google offers synthetic podcasts through NotebookLM

An AI 'artist' claims he's losing millions of dolalrs from people stealing his work

University hiring English professor to teach...prompt engineering

Check out future streams on Twitch. Meanwhile, send us any AI Hell you see.

Find our book The AI Con here, and MAIHT3k merch here.

Subscribe to our newsletter via Buttondown.

Emily

Bluesky: emilymbender.bsky.social
Mastodon: dair-community.social/@EmilyMBender

Alex

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Ozzy Llinas Goodman.

Episode 42: Stop Trying to Make 'AI Scientist' Happen, September 30 2024 Oct 10, 2024

Show notes

Can “AI” do your science for you? Should it be your co-author? Or, as one company asks, boldly and breathlessly, “Can we automate the entire process of research itself?”

Major scientific journals have banned the use of tools like ChatGPT in the writing of research papers. But people keep trying to make “AI Scientists” a thing. Just ask your chatbot for some research questions, or have it synthesize some human subjects to save you time on surveys.

Alex and Emily explain why so-called “fully automated, open-ended scientific discovery” can’t live up to the grandiose promises of tech companies. Plus, an update on their forthcoming book!

References:

Sakana.AI keeps trying to make 'AI Scientist' happen

The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery

Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers

How should the advent of large language models affect the practice of science?

Relevant research ethics policies:

ACL Policy on Publication Ethics

Committee On Public Ethics (COPE)

The Vancouver Recommendations for the Conduct, Reporting, Editing, and Publication of Scholarly Work

Fresh AI Hell:

Should journals allow LLMs as co-authors?

Business Insider "asks ChatGPT"

Otter.ai sends transcript of private after-meeting discussion to everyone

"Could AI End Grief?"

AI generated crime scene footage

"The first college of nursing to offer an MSN in AI"

FTC cracks down on "AI" claims

Check out future streams on Twitch. Meanwhile, send us any AI Hell you see.

Find our book The AI Con here, and MAIHT3k merch here.

Subscribe to our newsletter via Buttondown.

Emily

Bluesky: emilymbender.bsky.social
Mastodon: dair-community.social/@EmilyMBender

Alex

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Ozzy Llinas Goodman.

Episode 41: Sweating into AI Fall, September 9 2024 Sep 26, 2024

Show notes

Did your summer feel like an unending barrage of terrible ideas for how to use “AI”? You’re not alone. It's time for Emily and Alex to clear out the poison, purge some backlog, and take another journey through AI hell -- from surveillance of emotions, to continued hype in education and art.

Fresh AI Hell:

Synthetic data for Hollywood test screenings

NaNoWriMo's AI fail

AI assistant rickrolls customers

Programming LLMs with "fiduciary duty"

Canva increasing prices thank to "AI" features

Ad spending by AI companies

Clearview AI hit with largest GDPR fine yet

'AI detection' in schools harms neurodivergent kids

CS prof admits unethical ChatGPT use

College recruiter chatbot can't discuss politics

"The AI-powered nonprofits reimagining education"

Teaching AI at art schools

Professors' 'AI twins' as teaching assistants

A teacherless AI classroom

Another 'AI scientist'

LLMs still biased against African American English

AI "enhances" photo of Black people into white-appearing

Eric Schmidt: Go ahead, steal data with ChatGPT

The environmental cost of Google's "AI Overviews"

Jeff Bezos' "Grand Challenge" for AI in environment

What I found in an AI-company's e-waste

xAI accused of worsening smog with unauthorized gas turbines

Smile surveillance of workers

AI for "emotion recognition" of rail passengers

Chatbot harassment scenario reveals real victim

AI has hampered productivity

"AI" in a product description turns off consumers

Is tripe kosher? It depends on the religion of the cow.

Check out future streams on Twitch. Meanwhile, send us any AI Hell you see.

Find our book The AI Con here, and MAIHT3k merch here.

Subscribe to our newsletter via Buttondown.

Emily

Bluesky: emilymbender.bsky.social
Mastodon: dair-community.social/@EmilyMBender

Alex

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Ozzy Llinas Goodman.

Mystery AI Hype Theater 3000, Episode 40: Elders Need Care, Not 'AI' Surveillance (feat. Clara Berridge), August 19 2024 Sep 13, 2024

Show notes

Dr. Clara Berridge joins Alex and Emily to talk about the many 'uses' for generative AI in elder care -- from "companionship," to "coaching" like medication reminders and other encouragements toward healthier (and, for insurers, cost-saving) behavior. But these technologies also come with questionable data practices and privacy violations. And as populations grow older on average globally, technology such as chatbots is often used to sidestep real solutions to providing meaningful care, while also playing on ageist and ableist tropes.

Dr. Clara Berridge is an associate professor at the University of Washington’s School of Social Work. Her research focuses explicitly on the policy and ethical implications of digital technology in elder care, and considers things like privacy and surveillance, power, and decision-making about technology use.

References:

Care.Coach's 'Avatar' chat program*

For Older People Who Are Lonely, Is the Solution a Robot Friend?

Care Providers’ Perspectives on the Design of Assistive Persuasive Behaviors for Socially Assistive Robots
Socio-Digital Vulnerability

***Care.Coach's 'Fara' and 'Auger' products, also discussed in this episode, are no longer listed on their site.

Fresh AI Hell:

Apple Intelligence hidden prompts include the command "don't hallucinate"

The US wants to use facial recognition to identify migrant children as they age

Family poisoned after following fake mushroom book

It is a beautiful evening in the neighborhood, and you are a horrible Waymo robotaxi

Dynamic pricing + surveillance hell at the grocery store

Chinese social media's newest trend: imitating AI-generated videos