This week on the GeekWire Podcast: Bill Gates published a new essay warning that the AI industry is crossing the safety lines it set for itself, and that nobody is preparing for what’s coming. At age 70, he also uses AI more than most people half his age, and he finds it enthralling, as you’ll hear on this week’s show, with highlights from our interview with him.

Along the way, we dig into his three proposals: new institutions for managing the transition, a category of jobs reserved for humans, and a tax on the use and purchase of AI and robots.

The change in his own tech usage: “I joke with people that I used to have Claude-like people that I would send email to, but they were so slow, and there were some topics they didn’t actually know. … It’s three a.m. I want to understand sodium batteries, and now there’s no reason to go to sleep. Here we go. Yeah, it’s crazy.”

How he uses AI specifically: “If you’re a curious person, this is a mind-blowing time. When I’m working on malaria, nutrition, my poor humans that I work with always get these long conversations from me, where I paste in — me, Claude, me, ChatGPT. Sometimes I do it if there’s three of us: Claude, ChatGPT and me, debating these things.”

On where personal agents are headed: “We will get to a point where you won’t buy things yourself. You just won’t. … You won’t go to those applications. You’ll just go to your personal agent. … From a productivity point of view, we are in heaven.”

What has surprised him: “I was shocked by ChatGPT, and I was shocked by Claude Code. Those are both things where I went, oh my God. … I did not expect that a statistical machine would essentially learn to read, and the idea that the code is better than human code. Those are two stunning thresholds.”

On writing this essay: “It’s very unnatural for me to think that innovation may be a net negative if it’s not managed properly. The more I wrote the memo, the more I was like, Jesus, we really need to get our act together here. Even though this may come across as negative, that’s the truth. If we don’t step up, the negatives will substantially outweigh the positives.”

What AI leaders say privately: “You’re in this perverse period right now where people in the AI industry who are willing to say that AI might have some negative effects are told, ‘Hey, you’re hurting our PR while we’re trying to raise trillions of dollars.’ … I know they’re all worried. Or all of them that I know, which is basically everybody but Elon.”

On losing control of AI: “The wake-up for the memo is that the bad stuff thresholds are all being crossed. Even lack of control that I thought would be many years from now, we’re seeing lack of control. … These are people who are super expert on the thing, going, well, maybe we won’t be able to control these things. What kind of risk have we chosen to run here?”

On how fast robots are coming: “What’s weird about AI is it’s better at doing jobs across the entire economy, including physical jobs when the robots come — which you can guess when that is, but my view is it’s only a couple of years.”

Is he still an optimist? “I don’t think being pessimistic is helpful. I do think, wow, this is sure an interesting time. I’m the guy who in my 30s thought people in their 50s or 60s didn’t understand anything. So it’s kind of bizarre if a guy who’s 70 comes and writes a memo that’s actually helpful. … But I am very concerned. And honestly, when you get people one-on-one, so are they.”

Related headlines and links

• The turbulent AI era is here. The choices we make now are critical. — Bill Gates, Gates Notes
• ‘I am very concerned’: Bill Gates says the world needs a plan to deal with AI, and he has three ideas to start
• Bill Gates says there’s ‘no upper limit’ on AI, citing opportunity and risk
• Etzioni on AI: Bill Gates has the right diagnosis but the wrong prescription
• Dwarkesh Podcast: Ryan Greenblatt — What happens once AI can automate AI research?
• NPR: Trump’s new AI safety order seeks voluntary review of new models
• New York Times: Bill Gates is warning that A.I. is more dangerous than Big Tech will admit
• Wall Street Journal: Three takeaways from Bill Gates’s 5,784-word warning on AI: ‘There is no plan’
• MIT Technology Review: Bill Gates says we’ve passed AI’s danger thresholds. Now what?
• Axios: Gates confronts the Epstein questions hanging over his AI push
• Transcript: Here’s what Bill Gates told lawmakers in his recent Epstein testimony
• OpenAI: A Collective Approach to Cyber Defense

Subscribe to GeekWire in Apple Podcasts, Spotify, or wherever you listen.

Edited and produced by Curt Milton. Music by Daniel L.K. Caldwell.