computer hacker, alignment & safety @flockcap, part-time independent journalist opinions my own 💍 @computerphile

Seattle / San Francisco
Joined March 2020
went side questin' @NotionHQ yesterday :)
6
99
3,808
Replying to @nikunj
great message and very on point but why did you have to use AI for all of it :(
1
1
538
2024 vs 2026 (before vs after rationalism)
9
199
4,874
went to twitch HQ today
62
1,815
Replying to @r2pair
I HAVE THIS ONE LOL
4
39
7,367
posted up at the midjourney event last night ❤️❤️
Replying to @thedataroom
2/ many of my favorite minds in AI and in general @DavidSHolz @mattparlmer Celeste and Celeste @vmfunc @parafactual
3
81
2,945
we made sparse autoencoders compete with tiny softmax classifiers and the classifiers won on bits 🐐 a pure discrete code (no coefficients!) beats a top-k SAE at matched bits on SONAR, and an 800-bit hard code recovers 97.6% of gpt-2's loss paper out now! (link in replies)
2
3
3
45
6,761
sunday evening
60
1,931
→ we found what was freezing heads late in training and killed it → some things very much did not work (an HSIC bottleneck does not want to be your friend), and those go in the paper too negative results are results
1
5
270