Ian Thompson (@iantbd) header
Ian Thompson (@iantbd) profile picture

ai scaling + simplifying. founder @LatentSpaceAI spoilers from my favorite story: “Overhead, without any fuss, the stars were going out”

San Francisco, CA
Joined February 2014
Photo by Ian Thompson (@iantbd)Photo by Ian Thompson (@iantbd)Photo by Ian Thompson (@iantbd)Photo by Ian Thompson (@iantbd)Photo by Ian Thompson (@iantbd)Photo by Ian Thompson (@iantbd)Photo by Ian Thompson (@iantbd)
THRILLED to share that ChatGPT, our new model optimized for dialog, is now public, free, and accessible to everyone. chat.openai.com/
26
62
10
666
Ian Thompson retweeted
Avalon is the world's fastest 3D simulator for RL agents. All baselines train on 1 GPU in ~1 day. We want academic researchers to be able to study aspects of intelligence missing from today’s models, even w/o access to large-scale compute. Get started: generallyintelligent.com/ava…
2
38
4
186
Ian Thompson retweeted
In 2020, @michael_nielsen & I began a 2-month project to write: "how would we fund science?" 2 years & 40,000 words later, it's become: "how can the culture & institutions of science actually change, and ultimately become self-improving?" Our answer: scienceplusplus.org/metascie…
27
171
47
851
Ian Thompson retweeted
Bluesky is building a social protocol. We released “ADX” (the X stood for Experiment) in May. Now that the design is starting to solidify, we’re renaming it to the “Authenticated Transport Protocol” — the “AT Protocol.” blueskyweb.xyz/blog/10-18-20…
529
1,969
724
5,898
Ian Thompson retweeted
It takes a lot of human ratings to align language models with human preferences. We found a way to learn from language feedback (instead of ratings), since language conveys more info about human preferences. Our algo learns w just 100 samples of feedback. Check out our new paper!
Can we train LMs with *language* feedback? We found an algo for just that. We finetune GPT3 to ~human-level summarization w/ only 100 samples of feedback w/ @jaa_campos @junshernchan @_angie_chen @kchonyc @EthanJPerez Paper: https://teapaw.org/t.co/BBeQbFMtVi Talk: https://teapaw.org/t.co/48uwmwakOH
2
25
2
148
Ian Thompson retweeted
Excited to share a peek at what I've been working on recently: we're building networks of little sensors and using ML to help wind farms produce more energy!
Hello World! We are Windscape AI, and we're working to help wind farms produce more clean energy for the planet (and more revenue for their owners). More wind energy == a faster transition away from GHG-emitting fossil fuel energy sources! Quick 🧵 on how it works:
6
16
3
164
It’s technically possible for our online identities and relationships to belong to us the way an email address, phone contact book, or password keychain does. So I think it will happen, one way or another. It’s just a matter of time.
15
19
3
165
Always love a Library of Babel reference :)
Catch @DarrylBarnhart speak @NVIDIAGTC today about our exciting work @LatentSpaceAI on scaling LLM with retrieval! 📚 There’ll be an open QA in 30 mins: reg.rainfocus.com/flow/nvidi…
2
Here’s another memetic isomorphism: Crypto is more like physics, and AI is more like biology – not in “biologically inspired” sense, but in the nature of possible solutions. So using the wordcel / rotator basis, Darwin is a wordcel and Newton is the ultimate rotator. (1/4)
Replying to @VitalikButerin
16. It's fascinating how the two axes seem to imply each other: Pure tinkering is fast and effective, but it is unprincipled, so lacks large-scale legitimacy, so can only cooperate through centralization Theorycel thinking is slower, but well-suited for decentralization
1
1
5
Would Darwin/Newton gravitate more towards AI or crypto today? Newton seems like he’d be more interested in snark hunting, while Darwin would work on scaling laws. (3/4)
1
2
Ian Thompson retweeted
Excited to share a bit about what @vmcheung and I have been working on this year! At Gantry, we build infrastructure to help you go from making ML projects to shipping ML-powered products. I wrote about some of the main challenges we see here: gantry.io/blog/toward-contin… TL/DR 👇
17
73
8
359
Ian Thompson retweeted
Excited to share what I've been working on for the last few months! If you're interested in scaling laws and safety (or scaling laws *𝗳𝗼𝗿* safety) then check out our careers page: anthropic.com/#careers
7
2
56
Ian Thompson retweeted
Language models are amazing few-shot learners with the right prompt, but how do we choose the right prompt? It turns out that people use large held-out sets(!). How do models like GPT3 do in a true few-shot setting? Much worse: arxiv.org/abs/2105.11447 w/ @douwekiela @kchonyc 1/N
5
90
18
422