Ian Thompson (@iantbd) header
Ian Thompson (@iantbd) profile picture

ai scaling + simplifying. founder @LatentSpaceAI spoilers from my favorite story: “Overhead, without any fuss, the stars were going out”

San Francisco, CA
Joined February 2014
Photo by Ian Thompson (@iantbd)Photo by Ian Thompson (@iantbd)Photo by Ian Thompson (@iantbd)Photo by Ian Thompson (@iantbd)Photo by Ian Thompson (@iantbd)Photo by Ian Thompson (@iantbd)Photo by Ian Thompson (@iantbd)
THRILLED to share that ChatGPT, our new model optimized for dialog, is now public, free, and accessible to everyone. chat.openai.com/
26
62
10
666
Ian Thompson retweeted
Avalon is the world's fastest 3D simulator for RL agents. All baselines train on 1 GPU in ~1 day. We want academic researchers to be able to study aspects of intelligence missing from today’s models, even w/o access to large-scale compute. Get started: generallyintelligent.com/ava…
2
38
4
186
Ian Thompson retweeted
In 2020, @michael_nielsen & I began a 2-month project to write: "how would we fund science?" 2 years & 40,000 words later, it's become: "how can the culture & institutions of science actually change, and ultimately become self-improving?" Our answer: scienceplusplus.org/metascie…
27
171
47
851
Ian Thompson retweeted
Bluesky is building a social protocol. We released “ADX” (the X stood for Experiment) in May. Now that the design is starting to solidify, we’re renaming it to the “Authenticated Transport Protocol” — the “AT Protocol.” blueskyweb.xyz/blog/10-18-20…
529
1,969
724
5,898
Ian Thompson retweeted
It takes a lot of human ratings to align language models with human preferences. We found a way to learn from language feedback (instead of ratings), since language conveys more info about human preferences. Our algo learns w just 100 samples of feedback. Check out our new paper!
Can we train LMs with *language* feedback? We found an algo for just that. We finetune GPT3 to ~human-level summarization w/ only 100 samples of feedback w/ @jaa_campos @junshernchan @_angie_chen @kchonyc @EthanJPerez Paper: https://teapaw.org/t.co/BBeQbFMtVi Talk: https://teapaw.org/t.co/48uwmwakOH
2
25
2
148
Ian Thompson retweeted
Excited to share a peek at what I've been working on recently: we're building networks of little sensors and using ML to help wind farms produce more energy!
Hello World! We are Windscape AI, and we're working to help wind farms produce more clean energy for the planet (and more revenue for their owners). More wind energy == a faster transition away from GHG-emitting fossil fuel energy sources! Quick 🧵 on how it works:
6
16
3
164
It’s technically possible for our online identities and relationships to belong to us the way an email address, phone contact book, or password keychain does. So I think it will happen, one way or another. It’s just a matter of time.
15
19
3
165
Ian Thompson retweeted
Excited to share a bit about what @vmcheung and I have been working on this year! At Gantry, we build infrastructure to help you go from making ML projects to shipping ML-powered products. I wrote about some of the main challenges we see here: gantry.io/blog/toward-contin… TL/DR 👇
17
73
8
359
Ian Thompson retweeted
Excited to share what I've been working on for the last few months! If you're interested in scaling laws and safety (or scaling laws *𝗳𝗼𝗿* safety) then check out our careers page: anthropic.com/#careers
7
2
56
Ian Thompson retweeted
Language models are amazing few-shot learners with the right prompt, but how do we choose the right prompt? It turns out that people use large held-out sets(!). How do models like GPT3 do in a true few-shot setting? Much worse: arxiv.org/abs/2105.11447 w/ @douwekiela @kchonyc 1/N
5
90
18
422
Ian Thompson retweeted
I and @joshalbrecht wanted to hear more about other ML researchers' hunches, unpopular opinions, & research processes, so we decided to start a podcast! The first episode is out today, with the fascinating @kelvin_guu :) Let me know if you have any guest requests!
We're thrilled to release our first-ever episode of “Generally Intelligent,” a podcast made specifically for ML researchers by us folks at Untitled AI! Our first guest is the amazing @kelvin_guu from Google AI, co-author of REALM. Episode + transcript: untitled-ai.com/podcast-epis…
2
7
3
14
Showing that an AI system causes harm isn't the same as showing that we shouldn't build it or that we shouldn't deploy it. Some thoughts on AI ethics. askell.io/posts/2020/12/bad-…
47
55
18
480
What's next after open-source and open-access? We believe it's *open collaboration*. The field is fairer, more inviting, diverse and inclusive only when we make mentorship and collaborators accessible. But how? We are discussing it on Tue at #NeurIPS2020: mlcollective.org/neurips-202…
6
32
15
184
Ian Thompson retweeted
This underscores the importance of measuring likelihood in the right space, which I briefly discussed in a recent blog post (Section 6): benanne.github.io/2020/09/01… That way, we can ensure most of the model capacity is used for things that actually matter. (4/5)
1
2
16
Stayed up until 3am for the poster session for #3DReps workshop and had lots of fun! Well done to the organisers for the super cute virtual poster hall (and yes you can send ❤️ to other attendees). #ECCV2020
1
6
41
Ian Thompson retweeted
Turns out batch norm might cause contrastive learning! 🤯 Fascinating blog post demystifying @DeepMind's new BYOL approach here: untitled-ai.github.io/unders…
1
28
4
87