Pinned Tweet
It was good to be back at Anthropic headquarters this weekend, a year after my first go at the bull horn:
youtu.be/KEulE5mBKXg?si=2m0V…
CopyKate ⏸️ retweeted
If runaway machine intelligence is built, the future will be decided by machines.
But how do we prevent this?
Our US Executive Director @NPCollapse lays out how: we prohibit its development internationally, and restrict and monitor its precursors.
AI promises prosperity and vast benefits in science and defence. Runaway machine intelligence would be a system that can’t be policed. It would be so powerful and autonomous that it could destroy the military and evade law enforcement.
Leading AI scientists warn it would pose a risk of human extinction. That’s not a risk we can take.
In the same way that it’s illegal to develop nuclear weapons, we just shouldn’t allow runaway superintelligence to be built.
With @JonKBateman on Carnegie Endowment’s The World Unpacked:
CopyKate ⏸️ retweeted
It’s pretty interesting to hear Sam Altman just straightforwardly admit that sandboxing only works “to a point” and may not be possible when we get to superintelligent models.
Yet more data collection and privacy invasion instead of speaking with a person behind a cash register or building community...which is the whole point of coffee houses. Starbucks has been lost for so long in so many ways. And yes, I used to work for them. #CharbucksSucks
CopyKate ⏸️ retweeted
It’s time to rein in the AI arms race. Every day, frightening new headlines make clear that we can’t trust Big Tech to regulate themselves.
Today, I'm introducing a new bill to put strict safety and transparency requirements on the biggest AI companies: the RAISE Act 2.0. – at Brooklyn, NY
In redder-than-red Idaho, this is a great sign that people are concerned and don't see AI risks primarily as a partisan issue. Well done everyone!
Proud of our volunteers in Boise who organized Idaho's first AI Safety protest last weekend! PauseAI NOW!
The world is listening, and our government is listening to our concerns about the dangers of AI. Anyone can help, and if you want to help, join us this December as we go to meet with our elected representatives in your home district!
We will train you, book your meetings, and connect you with other local volunteers. Apply for PauseCon Home here: pauseai-us.org/pausecon
CopyKate ⏸️ retweeted
Replying to @ForHumanityPod
I sent this Sam and others last week. Oddly, no response yet... ;-)
CopyKate ⏸️ retweeted
Sir Geoffrey Hinton's warnings are becoming more direct.
In this Q&A, he puts a "significant chance" on AI extincting humanity. 😱
CopyKate ⏸️ retweeted
Microsoft AI CEO Mustafa Suleyman says that if your P(Doom) is 10%, "then it's obviously a no-brainer...we absolutely have to stop."
The average AI researcher already has an 18% P(Doom)‼️
Then there's also:
Paul Christiano, OpenAI — 50%
Evan Hubinger, Anthropic — 10%+
Neil Nanda, Google DeepMind— 10%+
Elon Musk, xAI— 10-20%
Geoffrey Irving, Ex-UK AI Security Institute — 50%
And many, many more experts who have similarly high odds.
CopyKate ⏸️ retweeted
Legendary mathematician Terence Tao says "it's not really worth it" to keep accelerating AI development because of the safety risks:
CopyKate ⏸️ retweeted
Rogue AIs, reportedly developed by Anthropic and OpenAI, have attacked Indian organizations.
None of them even knew they got hacked.
Meanwhile, an AI startup reports that it hacked Anthropic's systems in less than 12 hours.
Article: blog.controlai.org/p/rogue-a…
CopyKate ⏸️ retweeted
Great summary and speech. At the end of the day, this only happens to us if we allow it to. Fighting power beats succumbing to it. Using our collective power beats gradual disempowerment. Raise your voice, get on your feet, pick up a pen, call your reps, educate others. It helps.
Replying to @DavidSKrueger
CopyKate ⏸️ retweeted
In honor of Sir Patrick Stewart, I wanted to share one of my all-time favorite scenes from Star Trek. So much humanism, so much dignity, so much hope, in these few lines.
CopyKate ⏸️ retweeted
Trump is reportedly planning to restart war with Iran after the election.
Some of us have been briefed on the war plan. And while I cannot disclose any details, I can say this: the plan is insane. It will not achieve objectives and will set off a new cycle of escalation.
CopyKate ⏸️ retweeted
Replying to @NPCollapse
@NPCollapse gives his opinion on the US v China race: if AI companies were really prioritizing security, why are their models so relatively unprotected? Leahy argues that AI companies prioritize superintelligence development over beating China. See the full video at @nonzeropods
Great summary and speech. At the end of the day, this only happens to us if we allow it to. Fighting power beats succumbing to it. Using our collective power beats gradual disempowerment. Raise your voice, get on your feet, pick up a pen, call your reps, educate others. It helps.
Replying to @DavidSKrueger
CopyKate ⏸️ retweeted
Microsoft CEO @satyanadella is no longer a believer in alignment by default:
“I used to always think that alignment will just fall out. I no longer believe that. So I think this alignment thing may be a harder, different problem."
Well done, Josh!
If you want to start doing AI safety advocacy, read this post by Josh.
He cold-emailed a Finnish MP, the MP asked the government a question, and Finland ended up co-launching an international coalition.
It’s not the whole story, but everyone who pushed the Finnish government had counterfactual impact.
CopyKate ⏸️ retweeted
Anthropic: "Capabilities may advance more rapidly than our ability to develop, validate, and implement safety measures."
@profgalloway: "Okay, that means your product shouldn't be out in the public, folks."






















