
pursuing the adjacent possible for the next era of human-aligned ai. cofounder @latentspaceai 👩🏻💻🇨🇦 @uoftcompsci
San Francisco, CA
Joined June 2009
- Tweets2.1K
- Following439
- Followers1.2K
- Likes829
sarah hong ✨ retweeted
Thousands of startups and small businesses are at risk due to the SVB failure. We ask for depositors to be made whole, and for regulation to prevent this catastrophe.
650 founders who employ more than 22,000 people, have already signed.
Please spread the word.
ycombinator.com/blog/urgent-…
sarah hong ✨ retweeted
THRILLED to share that ChatGPT, our new model optimized for dialog, is now public, free, and accessible to everyone. chat.openai.com/
Try talking with ChatGPT, our new AI system which is optimized for dialogue. Your feedback will help us improve it. openai.com/blog/chatgpt/
sarah hong ✨ retweeted
So excited to finally open up access to these models! Couldn't have asked for a better team to do this with: @stephenroller, @NamanGoyal21 (@myleott + @sam_shleifer at the start too)!
Today Meta AI is sharing OPT-175B, the first 175-billion-parameter language model to be made available to the broader AI research community. OPT-175B can generate creative text on a vast range of topics. Learn more & request access: ai.facebook.com/blog/democra…
sarah hong ✨ retweeted
Human's won't be obsoleted by AGI, we just need better tooling to stay on top.
sarah hong ✨ retweeted
As we kick off GR13, we’re especially proud to announce:
A 🇺🇦Support for Ukraine🇺🇦 round
We’ve raised $700K to go towards humanitarian aid for Ukrainians
To learn more and get involved, read this 🧵
sarah hong ✨ retweeted
Here’s another memetic isomorphism:
Crypto is more like physics, and AI is more like biology – not in “biologically inspired” sense, but in the nature of possible solutions.
So using the wordcel / rotator basis, Darwin is a wordcel and Newton is the ultimate rotator. (1/4)
Replying to @VitalikButerin
16. It's fascinating how the two axes seem to imply each other:
Pure tinkering is fast and effective, but it is unprincipled, so lacks large-scale legitimacy, so can only cooperate through centralization
Theorycel thinking is slower, but well-suited for decentralization
sarah hong ✨ retweeted
New blog post: diffusion models are autoencoders!
benanne.github.io/2022/01/31…
I take a closer look at this connection, inspired by the work of @YSongStanford, @StefanoErmon, @kjgeras, @RandomlyWalking, @gyomalin_ML and @jaschasd, among others!
sarah hong ✨ retweeted
Very cool to see Retrieval-Augmented Generation models being scaled up by @LatentSpaceAI and @awscloud. Excited to see what happens when RAG is pushed to GPT3 scale
We @LatentSpaceAI have been making exciting progress on improved neural scaling laws, accelerated by a great collaboration with Amazon!
This post is the first of many on the nuts and bolts of how we’re doing this: aws.amazon.com/blogs/machine…
sarah hong ✨ retweeted
There's a lot of work on probing models, but models are reflections of the training data. Can we probe datasets for what capabilities they require? @kchonyc @douwekiela & I introduce Rissanen Data Analysis to do just that: arxiv.org/abs/2103.03872
Code: github.com/ethanjperez/rda
1/N
sarah hong ✨ retweeted
I and @joshalbrecht wanted to hear more about other ML researchers' hunches, unpopular opinions, & research processes, so we decided to start a podcast! The first episode is out today, with the fascinating @kelvin_guu :)
Let me know if you have any guest requests!
We're thrilled to release our first-ever episode of “Generally Intelligent,” a podcast made specifically for ML researchers by us folks at Untitled AI!
Our first guest is the amazing @kelvin_guu from Google AI, co-author of REALM.
Episode + transcript: untitled-ai.com/podcast-epis…
sarah hong ✨ retweeted
.@latentcodes shares a little bit about how they collaborate on and debug GANs and other large ML models at a startup app.wandb.ai/latentspace/pub…
sarah hong ✨ retweeted
Here's a snippet of how we're collaborating remotely on debugging generative models @LatentSpaceAI ! @wandb has been an invaluable tool for understanding and testing new approaches.
See how ML teams, like @LatentSpaceAI, working on cutting edge deep learning research use W&B Reports to collaborate remotely, debug models iteratively and to showcase results as mini research papers.
#machinelearning #deeplearning #100daysofmlcode
app.wandb.ai/latentspace/pub…
sarah hong ✨ retweeted
2 years ago, some collaborators and I introduced a neural network layer ("FiLM") for multi-input tasks. I've since gained a few takeaways about the pros/cons/tips-and-tricks of using FiLM. Check out NeurIPS retrospective/workshop paper/blog post here: ml-retrospectives.github.io/…
sarah hong ✨ retweeted
Unsupervised pre-training now outperforms supervised learning on ImageNet for any data regime (see figure) and also for transfer learning to Pascal VOC object detection
arxiv.org/abs/1905.09272v2
sarah hong ✨ retweeted
Over the past 5 months we’ve been experimenting how to steer a mammoth without training it.
Here is how.
eng.uber.com/pplm/
sarah hong ✨ retweeted
🎉 New blog post on a better (visual!) intuition for information theoretic quantities (eg entropy and mutual information) 🎉
🔥 Lots of visualisations 🔥
👉 Based on Yeung's "A new outlook on Shannon's information measures" from 1991 📖 #oldiebutgoldie
blackhc.net/blog/2019/better…
sarah hong ✨ retweeted
Learn from times iterated over time spent.
Craft a thousand tweets before ten blog posts before one novel.
Skim a dozen books before absorbing one.
Make many small investments before a few big bets.
Build many small products before starting a company.
Explore, then exploit.
sarah hong ✨ retweeted
Replying to @PyTorch
@PyTorch conferencers. Stop writing your own training loop and easily scale to hundreds of GPUs with @PyTorchLightnin.
Stop by our poster presented by @latentcodes.
We’re looking for 3 more contributors to join the core team!
@soumithchintala @joespeez @alfcnz @facebookai
I remember @soumithchintala said that as the field moves, the tools that enable research need to move as well.
I think @PyTorchLightnin is a step in the right direction with current trends — I’ll be sharing thoughts on ⚡ at the poster session today at @PyTorch conf, drop by!
sarah hong ✨ retweeted
Sharing some of our learnings on ML test driven development: medium.com/latentspace/ml-be…. What have you found to work well?
sarah hong ✨ retweeted
The next phase in facial recognition could be recognizing faces reflected in subjects' eyes. plosone.org/article/info%3Ad…


























