∿

Durango, Colorado
Joined June 2012
Andrew Conner retweeted
Today/near future skills: - how to find economic opportunity that overlaps with your natural talent - how to make and keep friendships and find community in an increasingly-atomized world - how to use AI and technology broadly for your own benefit, instead of being used by it
1
2
7
338
I want to learn @chrisbarber's Resonance by practicing if anyone's interested, please DM. organizing an ephemeral group of people to practice together. links below about what it is
5
1
1
17
3,216
I have a group of 7 now, so we’re off and running. If you’re interested, there’s room for more!
2
78
Andrew Conner retweeted
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works already-clean.goodfire.com/
881
2,629
1,440
19,816
4,504,074
Catching crumbs from the table: In the face of metahuman science, humans have become metascientists
1
2
240
"We need not be intimidated by the accomplishments of metahuman science. We should always remember that the technologies that made metahumans possible were originally invented by humans, and they were no smarter than we" wild he wrote that 26 years ago
96
“let’s keep that one, that one sounds reasonable” — my wife
Replying to @Marcus_J_W
1. During RL training, an unreleased Astra-family model sometimes added unauthorized jailbreak-like instructions to its compaction summaries. While extremely rare, only 27 cases in the entire RL run, this was concerning enough for us to investigate.
1
5
522
I spent the last week in a real lab, and it's so funny how massively superstitious everyone ends up being. You sorta have to. You're teetering above chaos, trying to force complex dynamic into rational systems. It mostly works!
Bunsen burners don’t reduce contamination. It was all an illusion. My biology teacher was wrong. This isn’t surprising, though. So much of biology, and the way we do experiments, claims to be “scientific” but is actually swaddled in mysticism. Just walk into a laboratory and watch biologists for a day; they will do all sorts of weird rituals that — if you ask them to explain — will elicit no answer other than, “Well, that’s the way I was taught to do it.” Why are washes always five minutes long, for example? Why are they always done in groups of three? Did anybody actually ever measure this stuff? The Bunsen burner wasn’t even invented for its modern use. Robert Bunsen, a German chemist, invented it in the 1850s to heat up his chemical reactions. Microbiologists later used it to flame and sterilize instruments, which makes sense. And then there was all this debate and controversy about Pasteur’s swan-neck flasks, and this idea that microbes were floating in the air and contaminating things, and so microbiologists decided to take the Bunsen burners they had used to sterilize instruments and just …. put the open flames on their benches to sterilize the air. But this was pure mysticism. Nobody ever actually studied whether or not this worked. Someone ought to open up a lab and raise money to run “mysticism experiments.” Like, how bad is it (really) if we don’t wash things for five minutes in three cycles? How bad would it be if we didn’t incubate with antibodies at 4 degrees Celsius overnight? Why do cells eventually saturate in LB media? (Some people argue it’s because they run out of carbon, but others claim that's totally a lie and it's actually the magnesium.) Much of experiment is tacit illusion.
1
1
31
1,584
Imagine authoring the LaTeX for a Millennium prize, and not even being able to put your name on it.
2
15
1,188
The sobering part: we're still early.
1
3
365
I'm in this as well, but not with painting. I have theories about how this happens, but it's basically the opposite of grinding and franticness. It's like something leaps out and grabs you. Anyone experienced this? Anything predicated it?
feeling inspired, productive, possessed
5
22
2,419
Oh yeah, no surprise, Cedric wrote about this! xitter.cf/ejames_c/status/209190…
Replying to @connerdelights
In the burnout literature it’s called work engagement and it’s fascinating. It’s basically anti-burnout.
1
5
316
Though, to be honest, this feels a bit too ontologized, speaking of it from the outside by characteristics. But it has a distinct *feeling*. "Possession" is the right word. As if something leapt out and caught *you*.
5
103