PhD student @mbzuai Interp @mint_nlp_mbzuai | Prev : MSc @mbzuai Research Intern @RIKEN_AIP EE @its_campus
Indonesia
Joined June 2023
- Tweets859
- Following855
- Followers146
- Likes9K
My very first co-first-authored paper was accepted to EMNLP 2026! 🥳
TL;DR: We observed a serial position effect in Mamba and took a peek at how it manifests internally in the model.
See you in Budapest! (Hopefully 😅)🇭🇺
Just learned that Sendai is nicknamed 杜の都, which means "City of Trees." No wonder it feels like home — it's like Jalan Bandung, but in a much upgraded version! 🤣
Memang serindang ini!
2
7
269
US now:
The burst of DeepSeek V3 has attracted attention from the whole AI community to large-scale MoE models. Concurrently, we have been building Qwen2.5-Max, a large MoE LLM pretrained on massive data and post-trained with curated SFT and RLHF recipes. It achieves competitive performance against the top-tier models, and outcompetes DeepSeek V3 in benchmarks like Arena Hard, LiveBench, LiveCodeBench, GPQA-Diamond.
📖 Blog: qwenlm.github.io/blog/qwen2.…
💬 Qwen Chat: chat.qwenlm.ai (choose Qwen2.5-Max as the model)
⚙️ API: alibabacloud.com/help/en/mod… （check the code snippet in the blog）
💻 HF Demo: huggingface.co/spaces/Qwen/Q…
In the future, we not only continue the scaling in pretraining, but also invest in the scaling in RL. We hope that Qwen is able to explore the unknown in the near future! 🔥
💗 Thank you for your support during the past year. See you next year!
91
Attending my very first conference @coling2025 ! No paper to present (thanks to my mbz 👀), but super excited to learn and connect! 🎉
5
161
