sarah hong ✨ (@latentcodes) header
sarah hong ✨ (@latentcodes) profile picture

pursuing the adjacent possible for the next era of human-aligned ai. cofounder @latentspaceai 👩🏻‍💻🇨🇦 @uoftcompsci

San Francisco, CA
Joined June 2009
Photo by sarah hong ✨ (@latentcodes)Photo by sarah hong ✨ (@latentcodes)Photo by sarah hong ✨ (@latentcodes)Photo by sarah hong ✨ (@latentcodes)Photo by sarah hong ✨ (@latentcodes)Photo by sarah hong ✨ (@latentcodes)Photo by sarah hong ✨ (@latentcodes)Photo by sarah hong ✨ (@latentcodes)Photo by sarah hong ✨ (@latentcodes)Photo by sarah hong ✨ (@latentcodes)
sarah hong ✨ retweeted
Thousands of startups and small businesses are at risk due to the SVB failure. We ask for depositors to be made whole, and for regulation to prevent this catastrophe. 650 founders who employ more than 22,000 people, have already signed. Please spread the word. ycombinator.com/blog/urgent-…
161
221
72
757
356,025
THRILLED to share that ChatGPT, our new model optimized for dialog, is now public, free, and accessible to everyone. chat.openai.com/
26
62
10
666
sarah hong ✨ retweeted
So excited to finally open up access to these models! Couldn't have asked for a better team to do this with: @stephenroller, @NamanGoyal21 (@myleott + @sam_shleifer at the start too)!
Today Meta AI is sharing OPT-175B, the first 175-billion-parameter language model to be made available to the broader AI research community. OPT-175B can generate creative text on a vast range of topics. Learn more & request access: ai.facebook.com/blog/democra…
16
85
6
536
Human's won't be obsoleted by AGI, we just need better tooling to stay on top.
2
1
10
sarah hong ✨ retweeted
As we kick off GR13, we’re especially proud to announce: A 🇺🇦Support for Ukraine🇺🇦 round We’ve raised $700K to go towards humanitarian aid for Ukrainians To learn more and get involved, read this 🧵
6
30
3
76
sarah hong ✨ retweeted
Here’s another memetic isomorphism: Crypto is more like physics, and AI is more like biology – not in “biologically inspired” sense, but in the nature of possible solutions. So using the wordcel / rotator basis, Darwin is a wordcel and Newton is the ultimate rotator. (1/4)
Replying to @VitalikButerin
16. It's fascinating how the two axes seem to imply each other: Pure tinkering is fast and effective, but it is unprincipled, so lacks large-scale legitimacy, so can only cooperate through centralization Theorycel thinking is slower, but well-suited for decentralization
1
1
5
sarah hong ✨ retweeted
Very cool to see Retrieval-Augmented Generation models being scaled up by @LatentSpaceAI and @awscloud. Excited to see what happens when RAG is pushed to GPT3 scale
2
10
sarah hong ✨ retweeted
I and @joshalbrecht wanted to hear more about other ML researchers' hunches, unpopular opinions, & research processes, so we decided to start a podcast! The first episode is out today, with the fascinating @kelvin_guu :) Let me know if you have any guest requests!
We're thrilled to release our first-ever episode of “Generally Intelligent,” a podcast made specifically for ML researchers by us folks at Untitled AI! Our first guest is the amazing @kelvin_guu from Google AI, co-author of REALM. Episode + transcript: untitled-ai.com/podcast-epis…
2
7
3
14
sarah hong ✨ retweeted
.@latentcodes shares a little bit about how they collaborate on and debug GANs and other large ML models at a startup app.wandb.ai/latentspace/pub…
3
8
sarah hong ✨ retweeted
Here's a snippet of how we're collaborating remotely on debugging generative models @LatentSpaceAI ! @wandb has been an invaluable tool for understanding and testing new approaches.
See how ML teams, like @LatentSpaceAI, working on cutting edge deep learning research use W&B Reports to collaborate remotely, debug models iteratively and to showcase results as mini research papers. #machinelearning #deeplearning #100daysofmlcode app.wandb.ai/latentspace/pub…
6
12
sarah hong ✨ retweeted
2 years ago, some collaborators and I introduced a neural network layer ("FiLM") for multi-input tasks. I've since gained a few takeaways about the pros/cons/tips-and-tricks of using FiLM. Check out NeurIPS retrospective/workshop paper/blog post here: ml-retrospectives.github.io/…
1
8
1
52
Unsupervised pre-training now outperforms supervised learning on ImageNet for any data regime (see figure) and also for transfer learning to Pascal VOC object detection arxiv.org/abs/1905.09272v2
4
191
11
705
sarah hong ✨ retweeted
Over the past 5 months we’ve been experimenting how to steer a mammoth without training it. Here is how. eng.uber.com/pplm/
6
103
12
375
🎉 New blog post on a better (visual!) intuition for information theoretic quantities (eg entropy and mutual information) 🎉 🔥 Lots of visualisations 🔥 👉 Based on Yeung's "A new outlook on Shannon's information measures" from 1991 📖 #oldiebutgoldie blackhc.net/blog/2019/better…
2
88
4
312
sarah hong ✨ retweeted
Learn from times iterated over time spent. Craft a thousand tweets before ten blog posts before one novel. Skim a dozen books before absorbing one. Make many small investments before a few big bets. Build many small products before starting a company. Explore, then exploit.
103
2,103
174
7,790
Replying to @PyTorch
@PyTorch conferencers. Stop writing your own training loop and easily scale to hundreds of GPUs with @PyTorchLightnin. Stop by our poster presented by @latentcodes. We’re looking for 3 more contributors to join the core team! @soumithchintala @joespeez @alfcnz @facebookai
I remember @soumithchintala said that as the field moves, the tools that enable research need to move as well. I think @PyTorchLightnin is a step in the right direction with current trends — I’ll be sharing thoughts on ⚡ at the poster session today at @PyTorch conf, drop by!
1
5
18
The next phase in facial recognition could be recognizing faces reflected in subjects' eyes. plosone.org/article/info%3Ad…