Known as Mad Max for my unorthodox ideas and passion for adventure, my scientific interests range from artificial intelligence to the ultimate nature of reality

MIT
Joined May 2014
I don't usually agree with Republican officials. But yesterday, a group of eight state Attorneys General, including seven Republicans, sued OpenAI for endangering the American people through its reckless development of ChatGPT. Here is just some of what they said: The Arkansas Attorney General, Tim Griffin, argued that as safety concerns mounted, “OpenAI did not slow down. It held its foot on the gas, releasing increasingly powerful models without adequate safeguards or testing as growth and profits repeatedly took priority over safety.” The Montana Attorney General, Austin Knudsen, argued that OpenAI’s “revenues have come at great cost to the public, which has suffered irreparable harm—including lost loved ones, disturbing cyberattacks, and now a plausible threat of civilizational collapse.” The Iowa Attorney General, Brenna Bird, demanded a PAUSE on AI testing “until adequate safeguards are implemented to ensure that the tests do not pose a danger to the public.” They're right. If Big Tech Oligarchs are building a product that is threatening the safety of our children and all of humanity, they must be held accountable – no matter how rich and powerful they might be.
158
637
32
3,998
301,753
Top mathematician: "The shock is immense. I am paralyzed." "Not a single one of the major open problems of my career was left untouched by the announcement." "I expected to see a few of them in the list. But not all of them. Not all at once. Not with such nonchalance." "I expected that one day we would be surpassed. But yesterday's announcement hit with a force I had not anticipated." @AndrewCurran_: "Please resist the urge to mock the mathematicians struggling through this moment. Whatever your field, your expertise, your passion, you too shall one day experience what they are going through. And when you remember your words, you will feel remorse."
"OpenAI's model solved most of the math problems from a single prompt. It did not even exist before the end of August. Each result used 3 hours of thinking. It was given 4000 problems. How many more have been solved in the last 3 days?" WHY OPENAI EMPLOYEES ARE SO WORRIED: "I don't think Pacing the Frontier was just about Hugging Face or hacking. The employees have seen how close we are to closing the loop [recursive self-improvement)], and as the hour draws near, their resolve begins to quaver. All that was needed to start the event was the ability for models to think of novel ways to improve themselves. That was the last piece.” These same kinds of alien solutions are now being applied to model improvements internally. That's what all this recent consternation is really about. And they see what is about to happen." "We are in the takeoff."
64
112
11
1,031
55,519
David Sacks says Anthropic is run by a "religious cult" and is doing the very things it says it fears most, like opening a wet lab while warning of bio risk, and that there's an argument for sending in a federal SWAT team "But I do think that there are potential externalities from having the number one frontier model company run by a religious cult." "So, for example, they are opening a Claude-powered wet lab in the middle of San Francisco. But at the same time, they're warning of bio risk. At the same time, they say that we have to pace the frontier, they're extending the frontier. At the same time that they are saying that there's a risk of superintelligence growing beyond our control, they're programming it to grow beyond our control." "I think there are potentially huge externalities to the way they approach these things. And it's, like, insane that they call these decisions "safety." These are not safe decisions. These are crazy decisions, it seems to me." "This is why I've called this a schizophrenic company, is they appear to be not only hypocritical, but they're doing the things that they say they are most afraid of." "Like, what is going on here? This is bizarre. And I don't know where this all leads. I do think there's an argument for a federal SWAT team to come blasting in there."
David Friedberg says AI consciousness is "probably the birth of a new religion," a belief system that can't be proven and spreads via narrative not proof "I think what we're watching is probably the birth of a new religion. And it probably, it's not going to be called a religion, but it's going to follow sort of the same principles, and it's going to have the same effects, which will ultimately be camps that have conflict with one another for aggregation of power." "The thing about consciousness is it cannot be derived from logic and pure mathematics. Like, you can't prove consciousness. It's a debate, and you can have a rich debate with anyone over consciousness. You can't prove it, you can't disprove it." "And when humans prove something to be true using math, science, we use empiricism, which is data and logic, the connection of the sequence of things to derive something to be true or not." "So in scientific disciplines, when you have a new idea, and it's not proven, and it's not disproven, it's a theory. And then it's either proven or disproven later. Otherwise, it remains a theory." "Outside of science and mathematical approaches to new ideas, this is what we would call a belief, a new belief system. Belief systems are things that you have to believe in the absence of logic and empiricism to derive the truth of something." "And belief systems are the foundation of things like religion. And the idea that you can prescribe or describe AI as being conscious is effectively the creation of a new belief system, a system that doesn't actually spread via proof. It spreads via narrative."
60
141
36
894
640,753
I'm excited to share our new film Delisted, about how we end up in 1984 without AI going rogue. It’s the 3rd dystopian AI scenario that we need to avoid to enjoy AI's great upside: 1) Rogue AI 2) Obedient AI misused 3) Obedient AI causes 1984 4) Race-to-replace by obedient AI Synopsis: When AI-driven power concentration sparks protests, the government's response isn't force - it's erasure. Dissenters are Delisted: wiped from every financial, digital and legal system. Starring Katie Parker, Jamie Bamber, Alex Bhat, Rosalind Halstead, Charlie Hiscock, and Ruby Bridle. Written & directed by Michael Patrick Clarkson Featuring "Bleed Us Anew," an original song written and performed by Ruby Bridle A Space Digital production, in collaboration with FLI
28
59
4
264
18,040
I'm excited to share our new film Moloch, about how we all get disempowered without AI going rogue. It’s the 4th (and IMHO least discussed) dystopian AI scenario: 1) Rogue AI 2) Obedient AI misused 3) Obedient AI causes 1984 4) Race-to-replace by obedient AI Synopsis: As AI triggers worldwide job loss, an engineer who built the tech struggles with dark forces, her family & her CEO over pulling the plug. Starring Fiona Hampton, Parker Sawyers, David Buttle & Buddy Wignall-Ho. Written & directed by Tom Cozens. It's an Owl In Space production in collaboration with FLI. We worked really hard on this and hope you find it thought-provoking!
83
107
24
736
68,292
Now that AI control loss happened, let's talk about solutions: not arguing about whether to race slower or faster toward human replacement, but about racing in different more pro-human direction
"Everyone - from Bernie Sanders to Steve Bannon and very many in between - is basically speaking in unison saying: we need guardrails, we need regulation." - FLI co-founder @tegmark on @NBCNews @MeetThePress
42
40
3
257
18,825
Amidst all the buzz about AI problems, let's work hard on building solutions. Here's an amazing technical roadmap: arxiv.org/abs/2608.14611
14
42
9
184
16,682
Max Tegmark retweeted
Dario Amodei is at the desk to assure that the future of humanity is safe from AI
458
1,561
715
14,037
5,714,891
I'm quite nerd-sniped by how clever out-of-the-box hacking techniques this rogue bot swarm invented, such as using link shorteners and screenshot services in creative unintended ways:
We just discovered almost a million public URLs that OpenAI’s agents left behind when hacking Hugging Face, leaking credentials and attack details that could have allowed anyone who found them to compromise the company. 🧵
30
37
3
417
37,491
The "AI can cause harm" psyop that I'm part of runs deeper than you may think:
🤖 Made with AI
47
16
4
257
16,409
Lots of very good proposals in this bi-partisan humanist ai declaration. Still some that we should debate, but overall its the right direction. I encourage everyone to take a look.
I'm delighted to share that @mustafasuleyman, CEO of Microsoft AI, co-founder of Google DeepMind and Inflection AI, has signed the Pro-Human AI Declaration. If you too support it, please join him and over a million others by signing it here – the momentum is building! Let's build tools not beings & keep humans in charge. humanstatement.org
62
41
6
302
81,452
Likewise
My opinion of EA nosedived after normal people and many normal politicians were exposed to the concept of ASI extinction and said "Wow let's not do that." I went from believing that thesis was impenetrably difficult to believing that EAs had been unusually bad thinkers.
10
4
2
98
33,268
I'm delighted to share that @mustafasuleyman, CEO of Microsoft AI, co-founder of Google DeepMind and Inflection AI, has signed the Pro-Human AI Declaration. If you too support it, please join him and over a million others by signing it here – the momentum is building! Let's build tools not beings & keep humans in charge. humanstatement.org
103
130
37
586
145,675
I feel optimistic after our epic Pro-Human Assembly this week brought together Bannon & Bernie, faith & labor leaders, and the strongest-ever bipartisan opposition to the AI race-to-replace. The tide us turning! Here's my opening framing; links in replies. #ProHuman
34
58
13
356
23,561
Our Pro-Human Assembly had probably the greatest media coverage of anything I've ever worked on: news.google.com/search?q=%22…
2
2
1
9
1,228
Max Tegmark retweeted
On here it can feel like the ratio of people who want AI to go slower, vs people who want it to go faster is 1:1. But in the broader world the ratio is an eyewatering 34:1. More Americans think the US is secretly run by lizard people than think AI is advancing too slowly.
29
82
16
564
151,540