Past: Research @GoogleDeepMind (Gemini 3) | @iiit_hyderabad

MontrΓ©al
Joined October 2021
Include

Only show posts containing:

Exclude

Hide posts containing:

Time range
-
Minimum likes
Replying to @asvs_kartheek @CVPR
Thanks Kartheek!
1
45
Thanks for the recognition @CVPR πŸ™
1
33
642
Check out this amazing work by @Harman26Singh and team @AIatMeta! Traditionally, agents are evaluated on how good they are at a task. But as agents run longer, an equally important question is how efficiently they improve with experience (plasticity). Turns out capability and plasticity are pretty different things.
πŸ€– How well do agents learn from experience? We study agents that amortize experience into reusable artifacts and introduce Agent Plasticity to measure how efficiently they improve on held-out environments. Top performer β‰  most efficient learner.
9
537
Great work, important to benchmark on the right things! Happy to see that VELOCITI, our CVPR 2025 work survives! πŸŽ‰ Try it out, short 10 second videos that stump many models. katha-ai.github.io/projects/…
New research (165 pages!) We thought there were too many benchmarks for video understanding, so we squeezed the benchmarks dry and got video-index (cover inspiration: gradient canopy 😜
1
3
31
2,539
Replying to @Pragya2k
Congrats, Pragya!!
2
101
Excited to be at ICML'26 πŸ‡°πŸ‡· from July 6 onward! I'll be presenting papers on Reasoning, RL and Diffusion Language Models. Would love to chat about RL for agents, text-optimization, self-improvement, and diffusion LMs. See you in Seoul πŸš€ Paper threads and details below πŸ‘‡
1
7
60
3,063
Darshan Singh retweeted
Check out this new work by Darshan and gang! Really enjoyed working on non-western, non-english domains with such an amazing team. At CVPR this year!
Frontier models have become excellent at understanding videos. But what happens when we test them outside the comfort zone of Western, English-centric data? In our #CVPR2026 (Highlight) work, we pushed these models to their limits to see if they can function effectively in diverse global contexts. The results? They are struggling. Work done with @NagraniArsha @skawshik11 @Harman26Singh @dinesh_tewari1 @0xtob @CordeliaSchmid Anelia Angelova @shachi_dave (1/7)
1
7
1,135
Replying to @ChuhanZhang5
This is amazing! Congrats!!
1
221
Super thrilled to share that our work, SRL-CLIP, won the Best Paper Award at the CV4Smalls #CVPR2026 workshop! πŸ† Huge thanks to my amazing co-authors @zeeshank95 and @MakarandTapaswi . Also, a big thank you to the organizers (@shaydamoezzi and team) for putting together such a thoughtful workshop. With the current trend of "scaling everything," it is incredibly refreshing to focus on data inefficiency as a design opportunity rather than a limitation. Data efficiency is one of the main pillars needed to improve real-world video understanding.
Hi all! Today I will present our work, SRL-CLIP, a recipe to efficiently adapt CLIP to videos at the CV4Smalls CVPR workshop in Room 102. I have an oral talk scheduled at 2 pm followed by the poster session. Please do stop by! Work done with @zeeshank95 @MakarandTapaswi #CVPR2026
2
1
1
30
1,932
This allows us to independently assess each intermediate step of the model's thought process. πŸ” Through our graph-based error tracing, we discovered that roughly 75% of all model failures actually stem from the visual perception of cultural elements. 🀯(6/7)
1
1
241
Vanilla accuracy just tells us IF a model failed, but not WHY. To address this, we propose a novel multi-turn algorithm for fine-grained error analysis: βœ“ Leverages human reasoning traces βœ“ Builds formal "evidence graphs" βœ“ Compares graphs directly against the model's thinking traces (5/7)
1
1
1
102
These tasks demand deep multimodal reasoning across six cultural domains (Sports, Cuisine, Festivals, Tourism, Rituals, and Education) on videos ranging from one minute to over an hour in length! The performance gap is massive: human performance sits at 95%, while the best SoTA model reaches only 50%. (4/7)
1
1
94
To ensure true cultural authenticity, we didn't rely on synthetic data. Instead, we built a rigorous, multi-stage human curation pipeline: βœ“ Human Curators crafting complex questions & reasoning traces βœ“ Independent Auditors answering blindly to validate objectivity βœ“ Continuous, dialogue-driven feedback loops between both groups to resolve ambiguity and guarantee high quality (3/7)
1
1
1
129
We introduce MINERVA-Cultural: a benchmark for multicultural + multilingual long-video QA across 18 global locales. βœ“ 540 videos, 2,400 questions βœ“ Native-language questions (no machine translation) βœ“ Human-written multi-step reasoning traces βœ“ Evidence-graph based error diagnosis Humans: 95.22% | Best model: 50.33% (2/7)
1
1
2
356
Frontier models have become excellent at understanding videos. But what happens when we test them outside the comfort zone of Western, English-centric data? In our #CVPR2026 (Highlight) work, we pushed these models to their limits to see if they can function effectively in diverse global contexts. The results? They are struggling. Work done with @NagraniArsha @skawshik11 @Harman26Singh @dinesh_tewari1 @0xtob @CordeliaSchmid Anelia Angelova @shachi_dave (1/7)
1
9
3
29
5,252
Hi all! Today I will present our work, SRL-CLIP, a recipe to efficiently adapt CLIP to videos at the CV4Smalls CVPR workshop in Room 102. I have an oral talk scheduled at 2 pm followed by the poster session. Please do stop by! Work done with @zeeshank95 @MakarandTapaswi #CVPR2026
3
2
17
2,897
Grateful to be recognized as an Outstanding reviewer at #CVPR2026. Always happy to do my part and give back to the community. This CVPR is very special for me because we also have 1 Main paper (Highlight) and 1 workshop paper (Best paper candidate). See you all in Denver! πŸš€
We are grateful to all of the 17,491 reviewers who helped make #CVPR2026 possible. We are especially pleased to recognize the following Outstanding Reviewers, whose high-quality reviews (as judged by their Area Chairs) placed them among the top 5% of reviewers.
1
24
2,131
Darshan Singh retweeted
The Project Aria team is excited to be part of the Third Joint Egocentric Vision (EgoVis) Workshop at #CVPR2026! πŸ‘“βœ¨ Don’t miss the latest Project Aria updates as we dive into the future of egocentric perception. Check out the full program of invited speakers below! πŸ“… June 3, 2026 πŸ“ Colorado Convention Center | Room 704/706 πŸ”— egovis.github.io/cvpr26/ ⚑️@liuziwei7 , @mapo1 , @doughty_hazel
5
19
3,184
Darshan Singh retweeted
Spending billions to train the "best" base model? You might be optimizing the wrong thing! 🎯 We show that controlling sharpness during mid-training leads to over 35% less forgetting after fine-tuning / quantization... even when the base model itself gets worse. 🧡 Takeaways for pretraining: - Use SAM (Sharpness-Aware-Minimization) in the final steps (~10%) - Try much higher learning rates (yes, even ~10Γ— larger) 1/9
29
90
17
612
599,762