Hyunjong Ok (@HyunjongOk) profile picture

Google PhD Fellow | PhD Student at POSTECH

Joined November 2023
Photo by Hyunjong Ok (@HyunjongOk)Photo by Hyunjong Ok (@HyunjongOk)Photo by Hyunjong Ok (@HyunjongOk)Photo by Hyunjong Ok (@HyunjongOk)Photo by Hyunjong Ok (@HyunjongOk)Photo by Hyunjong Ok (@HyunjongOk)Photo by Hyunjong Ok (@HyunjongOk)Photo by Hyunjong Ok (@HyunjongOk)Photo by Hyunjong Ok (@HyunjongOk)
🚀 Stop using Transformers for weight-space programming If you are not training with gradients on a GPU, why default to a Transformer? When an LLM writes network weights directly, letting it also design the architecture achieves: 📉 ~1,800× fewer parameters at matched accuracy on ARC (AI2 Reasoning Challenge), compared to the best Transformer the same LLM wrote. ⚡ Up to 17× faster GPU inference with a memory architecture built for these tables, compared to a Transformer of the same size. 🧵 Paper & code at the end 👇
21
47
6
343
26,803
Hyunjong Ok retweeted
We're also on Hugging Face Daily Papers & arXiv today! Check out the paper here: 🤗 Daily Papers: huggingface.co/papers/2611.2… 📄 arXiv: arxiv.org/abs/2611.22055
3
5
242
🔗 8/8 Read the paper & explore the code! 📄 Paper: alphaxiv.org/abs/2611.weight… 💻 Code & Models: github.com/effl-lab/Weight-S… 🌐 Project Page: wsp-no-transformer.github.io This is ongoing work—we're actively pushing this direction further, so stay tuned for what's next! Feedback and thoughts are very welcome. (P.S. I'm also open to research internships and collaborations—feel free to reach out via DM or email! #MachineLearning #AI)
1
2
19
1,114
🎉 I’ve been selected as a 2026 Google PhD Fellow in Natural Language Processing! My research focuses on understanding and evaluating language and multimodal models through diagnostic benchmarks and efficient evaluation methods. I’m grateful to my advisor, @jaeho_lee_, for his guidance and support, and to my collaborators for the discussions and ideas that have shaped my research. hj-ok.github.io/
Every leap in technology starts with a researcher asking a bold question. Meet the 2026 Google PhD fellows: 148 new fellows from 38 countries, advancing breakthrough research for the public good, supported by $13 million from @Googleorg: goo.gle/phd-fellows-2026
1
20
5,007
Hyunjong Ok retweeted
``Imagine to Hear: Auditory Knowledge Generation can be an Effective Assistant for Language Models,'' Suho Yoo, Hyunjong Ok, Jaeho Lee, ift.tt/czajE6R
1
9
1,152
Hyunjong Ok retweeted
``YuE: Scaling Open Foundation Models for Long-Form Music Generation,'' Ruibin Yuan, Hanfeng Lin, Shuyue Guo, Ge Zhang, Jiahao Pan, Yongyi Zang, Haohe Liu, Yiming Liang, Wenye Ma, Xingjian Du, Xinrun Du, Zhen Ye, Tianyu Zheng, Yinghao Ma, Minghao Liu, Ze… ift.tt/vipc7jq
6
20
2,011
Hyunjong Ok retweeted
``S2Cap: A Benchmark and a Baseline for Singing Style Captioning,'' Hyunjong Ok, Jaeho Lee, ift.tt/O3tqD97
2
2
473
🚨 New ICASSP 2025🇮🇳 Paper Accepted! 🚨 Do language models include auditory knowledge? 🤔 Our research says no! Language models struggle to identify animals' sounds —like "meow" with cats. 🐱❌ Check out our paper here: arxiv.org/abs/2409.08199 (1/4)
1
1
6
977
How do language models perform? Not great. As shown in Table 3, their performance falls short. To address this, we propose AudioBERT, an audio retrieval-based method that improves auditory understanding. (3/4)
1
153
Are you curious about the details of AudioBERT and how we built AuditoryBench? Dive into our paper and code repository! 📄 Paper: arxiv.org/abs/2409.08199 💾 Code: github.com/HJ-Ok/AudioBERT (more updates coming soon!) (4/4)
108