Jinesis Lab led by Prof @ZhijingJin at @UofTCompSci @VectorInst conducts frontier research on Responsible AI, LLMs, and Causality.

Joined December 2025
๐ŸŽ‰ #NeurIPS 2026 acceptance from our team at Jinesis Lab under @ZhijingJinโœจ 1๏ธโƒฃ SuperSycophantic: Stress-Testing Frontier LLMs from Single- to Multi-Turn Sycophancy 2๏ธโƒฃ GT-HarmBench: Benchmarking AI Safety Risks Through the Lens of Game Theory 3๏ธโƒฃ Transferability for General Reasoning: An Automated Curriculum for Multi-Domain LLM RL 4๏ธโƒฃ Causality can systematically address the monsters under the bench(marks) 5๏ธโƒฃ AM-Bench: A Unified Taxonomy and Evaluation Suite for Agentic Misalignment Happy to share this work with you!
1
1
20
486
Jinesis Lab (UToronto) retweeted
We are excited to share that we received over 420 submissions for the AI4GOOD workshop, and the review process has already started !! To keep things fair, we follow the strict rules of the main NeurIPS conference. We cannot accept any papers outside of the official OpenReview portal, and we cannot allow resubmissions or changes after a desk-rejection. Because we are managing so many papers, we won't be able to reply to individual queries.
We are so excited to host the 2nd edition of the Trustworthy AI for Good (AI4GOOD) Workshop at #NeurIPS2026 in Paris, France ๐Ÿ‡ซ๐Ÿ‡ท We aim to bring together the AI safety, AI for social good, and AI policy/governance communities to connect what models can do as individual systems with what they do when deployed across populations. For full details, welcome to visit our website at: ๐Ÿ”— trustworthy-ai-for-good.githโ€ฆ ๐Ÿ“December 12, 2026 ยท Paris ๐Ÿ‡ซ๐Ÿ‡ท We have an amazing lineup of speakers and plans. More details ๐Ÿงต
2
2
17
3,518
๐ŸŽ‰Very excited to share that Jinesis Lab at the University of Toronto has 10 papers accepted at EMNLP 2026 โ€” 5 at the main conference, 4 at Findings, and 1 at the Demo track! Our work this cycle spans interpretability, AI safety, computer vision, and multi-agent systems: ๐Ÿ“ŒMain Conference: โ€ข Tracing Multilingual Representations in LLMs with Cross-Layer Transcoders โ€” arxiv.org/abs/2511.10840 โ€ข PruneGround: Plug-and-play Spatial Pruning for 3D Visual Grounding โ€” arxiv.org/abs/2606.31148 โ€ข How Do Linear Probes Emerge? A Circuit-Tracing Framework with Concept-Targeted Attribution โ€ข Computation Graph Recovery from Chain-of-Thought โ€” openreview.net/pdf?id=OHES5cโ€ฆ โ€ข Preserving Historical Truth: Detecting Historical Revisionism in Large Language Models โ€” arxiv.org/abs/2602.17433 ๐Ÿ“ŒFindings: โ€ข Evaluating Second-Order Bias of LLMs Through Epistemic Entitlement โ€” arxiv.org/abs/2606.17506 โ€ข How Does Alignment Tuning Shape Representations of Sycophancy and Related Cue-Induced Biases in LLMs? โ€” arxiv.org/pdf/2607.18114 โ€ข Simulating Democratic Deliberation: Representing Pluralistic Preferences through Electoral Systems in Multi-Agent LLMs โ€ข Fluid Representations in Reasoning Models โ€” arxiv.org/abs/2602.04843 ๐Ÿ“ŒDemo Track: โ€ข CLT-Forge: A Scalable Library for Cross-Layer Transcoders and Attribution Graphs Huge congratulations to all the authors and collaborators across the lab and our partner institutions. @AHarrasse1906, @flodraye, @psyonp, @ZhijingJin, @bschoelkopf, Duc Cao Dinh, @leduckhai, Chris Ngo, @TerryJCZhang, @vedantpalit1008, @RoderickWu4, Aydin Javadov, @francescortu, @JoeunYk05, @albecazzaniga, @radamihalcea, @RamaravindM, Raiyan Ahmed, Shion Guha, Syed Ishtiaque Ahmed, Prakhar Gupta, @_rfaulk, @SSzufa, Daniel Hoyer, Roland Bouffanais, @jzl86, Dmitrii Kharlapenko, @iarthsingh, @alesstolfo, @ArthurConmy, @mrinmayasachan, @TonyWu1105, @Jiarui_Liu_, Chih-Hao Hsu. #EMNLP2026 #NLP #Interpretability #AISafety #MachineLearning
2
1
1
27
5,843
Jinesis Lab (UToronto) retweeted
What is chain-of-thought actually doing inside the model? Our new #EMNLP2026 Findings paper shows reasoning models rebuild the meaning of words in activation space over a single trace, and that these representations causally drive performance. Thread below๐Ÿ‘‡
Our paper "Fluid Reasoning Representations" was accepted to EMNLP 2026 Findings. The question we asked: when a reasoning model spends 15k tokens thinking, what is actually changing inside it? Short answer: it is rebuilding the meaning of words in activation space, mid-trace.
1
4
77
5,913
Jinesis Lab (UToronto) retweeted
๐Ÿšจ 8 days left to submit to the Trustworthy AI for Good (AI4GOOD) Workshop at #NeurIPS2026 in Paris Weโ€™re still accepting submissions. Join us in bridging AI safety, social good, and real-world impact, so that more capable models actually help society at scale. Our workshop is non-archival, and we will recognize outstanding papers and top reviewers with awards. Deadline: August 29, 2026 (AoE) More details and submission โ†’ trustworthy-ai-for-good.githโ€ฆ ๐Ÿ“ง Sponsorship & questions: [email protected] Let's bridge trustworthy AI and real-world impact. We hope to see you all in Paris. @TerryJCZhang @ChanglingXavier @_agirlyengineer @ozzaney0101, He (Shawn) Shuang, Jerick Shi, Prakhar Gupta, Kexin Li (Cassie), Wenjun (Wendy) Qiu @ZhijingJin @radamihalcea @MilindTambe_AI @david_lie @casdewitt @VectorInst @JinesisLab @EuroSafeAI @MPI_IS @UofTCompSci @TorontoSRI @CIFAR_News @ELLISInst_Tue @UMichCSE @michigan_AI @Harvard @ETH_en @CarnegieMellon @UniofOxford @NeurIPSConf @UofT
We are so excited to host the 2nd edition of the Trustworthy AI for Good (AI4GOOD) Workshop at #NeurIPS2026 in Paris, France ๐Ÿ‡ซ๐Ÿ‡ท We aim to bring together the AI safety, AI for social good, and AI policy/governance communities to connect what models can do as individual systems with what they do when deployed across populations. For full details, welcome to visit our website at: ๐Ÿ”— trustworthy-ai-for-good.githโ€ฆ ๐Ÿ“December 12, 2026 ยท Paris ๐Ÿ‡ซ๐Ÿ‡ท We have an amazing lineup of speakers and plans. More details ๐Ÿงต
2
5
2
16
4,148
Jinesis Lab (UToronto) retweeted
We are so excited to host the 2nd edition of the Trustworthy AI for Good (AI4GOOD) Workshop at #NeurIPS2026 in Paris, France ๐Ÿ‡ซ๐Ÿ‡ท We aim to bring together the AI safety, AI for social good, and AI policy/governance communities to connect what models can do as individual systems with what they do when deployed across populations. For full details, welcome to visit our website at: ๐Ÿ”— trustworthy-ai-for-good.githโ€ฆ ๐Ÿ“December 12, 2026 ยท Paris ๐Ÿ‡ซ๐Ÿ‡ท We have an amazing lineup of speakers and plans. More details ๐Ÿงต
2
15
3
64
20,928
Jinesis Lab (UToronto) retweeted
๐Ÿ“กAnnouncing NewInML workshop at #NeurIPS2026 We are so excited to host the 8th edition of the NewInML (@NewInML) workshop, which will take place in Paris, France ๐Ÿ‡ซ๐Ÿ‡ท We are here to help you out gain confidence and network with the community! If you are new to ML research or have limited publishing experience, it's a perfect opportunity for you to submit your first work, get high quality reviews from reviewers and also meet the experts, and of course, enjoy beautiful Paris ๐Ÿฅ We are delighted to have an amazing speaker line-up and interesting plans. More details ๐Ÿงต
2
14
5
60
19,794
Jinesis Lab (UToronto) retweeted
We're delighted to host the Trustworthy AI for Good (AI4GOOD) workshop at @NeurIPSConf in Paris ๐Ÿ‡ซ๐Ÿ‡ท ๐Ÿ“ข We're recruiting reviewers, plus an award for top reviewers ๐Ÿ† If you're working on AI Safety, Alignment, AI for Science or related topics, we're looking for you. Feel free to express your interest here: forms.gle/HpkPoE8HqMHH1geL9
๐ŸŒŸ Weโ€™d love to welcome you as a reviewer for the 2nd Trustworthy AI4GOOD Workshop at #NeurIPS2026 in Paris! ๐Ÿ‡ซ๐Ÿ‡ท Following the success of our first edition at #ICML2026, this workshop will once again bring together researchers and practitioners working to ensure that advances in AI are not only powerful, but also trustworthy, responsible, and genuinely beneficial to society. Each reviewer will be assigned no more than 3 papers through OpenReview, with no paper bidding or rebuttal phase. ๐Ÿ—“๏ธ Review period: September 2026 โฐ Review deadline: September 22, 2026, AOE Please make sure your OpenReview profile is up to date before registering. Join us as a reviewer: forms.gle/HpkPoE8HqMHH1geL9 Weโ€™d be delighted to have you help shape this yearโ€™s workshop! ๐ŸŽ‰ #AI4GOOD #TrustworthyAI #NeurIPS #AISafety
4
19
2,849
๐ŸŒŸ Weโ€™d love to welcome you as a reviewer for the 2nd Trustworthy AI4GOOD Workshop at #NeurIPS2026 in Paris! ๐Ÿ‡ซ๐Ÿ‡ท Following the success of our first edition at #ICML2026, this workshop will once again bring together researchers and practitioners working to ensure that advances in AI are not only powerful, but also trustworthy, responsible, and genuinely beneficial to society. Each reviewer will be assigned no more than 3 papers through OpenReview, with no paper bidding or rebuttal phase. ๐Ÿ—“๏ธ Review period: September 2026 โฐ Review deadline: September 22, 2026, AOE Please make sure your OpenReview profile is up to date before registering. Join us as a reviewer: forms.gle/HpkPoE8HqMHH1geL9 Weโ€™d be delighted to have you help shape this yearโ€™s workshop! ๐ŸŽ‰ #AI4GOOD #TrustworthyAI #NeurIPS #AISafety
1
7
2
33
13,137
๐ŸŽ‰ With the successful conclusion of our 1st Trustworthy AI4GOOD workshop at #ICML2026, we are delighted to share that its 2nd edition has been accepted for #NeurIPS2026 in Paris! ๐ŸŽ‰๐Ÿ‡ซ๐Ÿ‡ท The workshop selection process was highly competitive: only 22% of 454 workshop proposals were accepted. We are grateful for the opportunity to bring the community together again! ๐Ÿ™Œ Paris, here we come! ๐Ÿ‡ซ๐Ÿ‡ท ICML speakers: @Yoshua_Bengio, @OanaIgnatRo, @jzl86, @maksym_andr, Jenny Ni and @NamGoPro. Panel: @MilindTambe_AI, @lrhammond, Gopal Sarma and @ARGleave. Organizers: @TerryJCZhang, @ZhijingJin, @radamihalcea, @MilindTambe_AI, David Lie, @_agirlyengineer, @davidguzman1120, @ChanglingXavier, @Jerick1380, Prakhar Gupta, @vantru0ng, @EttoreGran, He (Shawn) Shuang, @ozzaney0101, Kexin Li and Wenjun Qiu. Thank you for making our first edition unforgettable!๐Ÿ™ Thank you for making AI4GOOD possible! ๐Ÿ’™ trustworthy-ai-for-good.githโ€ฆ
1
8
2
34
5,981
Our Jinesis Lab at the University of Toronto is bringing three exciting papers to #COLM2026! ๐ŸŽ‰ These projects push the frontiers of #AISafety, #AgentSecurity, and #AIForScience.๐Ÿค– Huge congratulations to all collaborators and co-authors! Papers: ๐Ÿ›ก๏ธODILE: Orthogonal Disruption of Injected Tool-Call Embeddings for Agentic Prompt Injection Defense ๐Ÿ”ญStargazer: A Scalable Model-fitting Benchmark Environment for AI Agents under Astrophysical Constraints โš ๏ธOne Word at a Time: Incremental Completion Decomposition Breaks LLM Safety @UofT,@VectorInst,@EuroSafeAI,@ETH_en,@MPI_IS,@UMich
5
19
1,354
๐ŸŒŸ What an incredible experience at #ICML2026! ๐ŸŒŸ Our team at Jinesis Lab had a fantastic time presenting research across several exciting and important areas: ๐Ÿค Multi-agent LLMs ๐Ÿง  Causal reasoning ๐Ÿ›ก๏ธ AI safety We were proud to share this work alongside our collaborators and to engage with so many researchers from across the machine learning community. ๐Ÿ’ก Just as valuable as presenting our own work was learning from the research others brought to ICML. From thought-provoking talks and innovative poster presentations to insightful discussions and spontaneous hallway conversations, the conference was full of ideas that challenged our thinking and opened new directions for future work. โœจ We are grateful to everyone who attended our presentations, visited our posters, shared feedback, and took the time to discuss their own research with us. ๐Ÿ™Œ A huge thank-you to our lab members, collaborators, and the broader ICML community for making the experience so memorable. We are leaving inspired, energized, and excited to build on the ideas and connections formed throughout the conference. ๐ŸŒ๐Ÿ”ฌ๐Ÿš€ #ICML #MachineLearning #ArtificialIntelligence #MultiAgentSystems #LLM #CausalReasoning #AISafety #ResponsibleAI #AIResearch #ResponsibleAI #AIResearch
4
28
2,649
๐ŸŽ‰โœจ The Trustworthy AI for Good Workshop at ICML 2026 was a huge success! โœจ๐ŸŽ‰ We are incredibly grateful to everyone who joined us in Seoul ๐Ÿ‡ฐ๐Ÿ‡ท for a full day of inspiring research, thoughtful discussions, and meaningful connections around building AI systems that are both trustworthy and socially beneficial. ๐Ÿค–๐ŸŒ๐Ÿ’ก A heartfelt thank-you to our incredible keynote speakers: ๐ŸŽค @Yoshua_Bengio, @OanaIgnatRo, @jzl86, @maksym_andr, Jenny Ni, Naman Goyal Your insights, perspectives, and thought-provoking ideas made the workshop truly memorable. ๐ŸŒŸ๐Ÿง  A special thank-you to our outstanding panelists: ๐Ÿ’ฌ @MilindTambe_AI, @lrhammond, Gopal Sarma, @ARGleave And to our wonderful moderator, @ZhijingJin, for leading such an engaging and insightful conversation. ๐ŸŽ™๏ธ We are also deeply grateful to all our oral and poster presenters, reviewers, organizers, volunteers, sponsors, and every attendee who contributed questions, ideas, feedback, and enthusiasm throughout the day. ๐Ÿš€ The energy of this community reinforced the importance of bringing together: ๐Ÿ›ก๏ธ AI safety ๐ŸŒ AI for social good โš–๏ธ AI policy and governance ๐Ÿค Cooperative AI ๐Ÿ“ฐ Information integrity ๐Ÿ›๏ธ Civic discourse Thank you for making Trustworthy AI for Good @ #ICML2026 such a memorable and impactful event! ๐ŸŽŠ We look forward to continuing the conversation, strengthening this community, and building on the connections formed at the workshop. ๐Ÿค #ICML2026 #AIForGood #TrustworthyAI #AISafety #ResponsibleAI #MachineLearning #CooperativeAI #AIResearch #TechForGood #ArtificialIntelligence
1
3
24
1,953
๐Ÿšจ Thrilled to share that our lab will be presenting the ๐Ÿ† Best Paper at the NExT-Game Workshop at #ICML2026 today! ๐ŸŽค When Agents Lie: Premeditation, Persistence, and Exploitation in Repeated Games ๐Ÿ† Best Paper @ NExT-Game Workshop ๐Ÿ“ Conference Room S307 ๐Ÿ“… Fri, Jul 10 ๐Ÿ• 13:00โ€“13:20 KST Authors: @JerickShi @TerryJCZhang @bschoelkopf @conitzer @ZhijingJin ๐Ÿค– We introduce a three-stage endogenous promise protocol for repeated multi-agent games that asks not only whether LLM agents honor their public commitments when they can privately deviate, but also how model-on-model composition influences premeditated deception and persistent exploitation. ๐Ÿ“Š Across six canonical games spanning binary and numerical action spaces, our evaluation of frontier models (GPT-5.2, Llama-4-Maverick, Claude-Opus-4.6) reveals: ๐Ÿ”น Over 90% of promise-breaking instances are premeditated in agents' private plans. ๐Ÿ”น Mixed-model groups with mismatched communication frameworks create systemic, persistent payoff gaps of up to 5.00 points from Round 0. ๐Ÿ“„ Paper: openreview.net/forum?id=v8nYโ€ฆ #MultiAgentSystems #LLMs #GameTheory #AI #ICML2026
1
2
8
1,147
Excited to share more of our workshop papers today, July 11, at #ICML2026!๐Ÿ“๐Ÿ‡ฐ๐Ÿ‡ท๐Ÿ“ท ๐Ÿ”งAIWILD (โญOralโญ) AF-ARENA: A Multi-Dimensional Evaluation Suite for Alignment Faking ๐Ÿ—“๏ธ 10:10โ€“10:40 AM KST ๐Ÿ“Hall B2. ๐Ÿ”—openreview.net/forum?id=vFqnโ€ฆ ๐Ÿ”งAI4Math Proving Your Way to Cooperation: Formalizing Proof-Based Open Source Game Theory in Lean ๐Ÿ“Room HALL D1 ๐Ÿ”—openreview.net/forum?id=Wc5Tโ€ฆ ๐Ÿ”งAI4Physics Stargazer: A Scalable Model-fitting Benchmark Environment for AI Agents under Astrophysical Constraints ๐Ÿ“Conference Room S402 ๐Ÿ”—aips-uoft.github.io/Stargazeโ€ฆ ๐Ÿ”งNexT-Game GT-HarmBench: Benchmarking AI Safety Risks Through the Lens of Game Theory ๐Ÿ“Conf. room S307 ๐Ÿ”—openreview.net/forum?id=F0Dzโ€ฆ ๐Ÿ”งPluralistic Alignment The Wedge Questions: Latent Cultural Boundaries in LLMs via Persona Projection Divergence ๐Ÿ“Room 403, Board #4613 ๐Ÿ”—openreview.net/forum?id=zHQuโ€ฆ Huge thanks to all collaborators, co-authors, organizers, and workshop communities โ€” looking forward to many great discussions at #ICML ๐Ÿš€
4
255
Thrilled to share that our lab will present the ๐Ÿ†Best Paper๐Ÿ†of RLxF Workshop @ #ICML2026 today! ๐Ÿ“„ Transferability for General Reasoning: An Automated Curriculum for Multi-Domain LLM RL ๐Ÿ“ GRAND BALLROOM 101-102 ๐Ÿ—“๏ธ Fri, Jul 10 KST ๐Ÿ•š 4:00 PM โ€“ 5:00 PM KST ๐ŸŽ“ Authors: @_yongjinny, @Jiarui_Liu_, @yinghui_he_, @leczhang, @bschoelkopf, and @ZhijingJin We introduce Transfer-Aware Curriculum (TAC), an automated curriculum for multi-domain RLVR that asks not only which domain is learnable right now, but also which domainโ€™s gradients transfer well to the rest of the reasoning suite. ๐Ÿงฉ Across math, code, logic, simulation, table reasoning, and STEM, TAC achieves the best macro-averaged accuracy on both Qwen3-1.7B and Llama3.2-3B, improving over strong curriculum baselines with <1% wall-clock overhead. ๐Ÿ“ Huge thanks to all collaborators, reviewers, and the RLxF organizers โ€” and please stop by to chat if youโ€™re at #ICML2026! ๐Ÿš€ ๐Ÿ“„ Paper: arxiv.org/pdf/2606.25178 ๐Ÿ“Ž Code: github.com/YangYongJin/transโ€ฆ #ICML #ICML2026 #RLxF #ReinforcementLearning #LLM #Reasoning #RLVR
4
15
1,118
Excited to share our workshop papers being presented TODAY at #ICML2026 in Seoul ๐Ÿ‡ฐ๐Ÿ‡ทโœจ Please stop by the posters and chat with us! ๐Ÿ”ง FoGen ๐Ÿ“„ Test of Time: Rethinking Temporal Signal of Benchmark Contamination ๐Ÿ—“๏ธ 9:10โ€“10:00 AM, 2:00โ€“2:50 PM KST ๐Ÿ“ ROOM 318 ๐Ÿค AI4GOOD ๐ŸŒŸSpotlight๐ŸŒŸ ๐Ÿ“„ Multi-Agent AI Systems Need Institutional Design, Not Just Model-Level Alignment ๐Ÿ—“๏ธ 11:25 AM โ€“ 1:00 PM KST ๐Ÿ“ GRAND BALLROOM 103 ๐Ÿ”ฌ AI4Research ๐Ÿ“„ Causal AI Scientist: Towards End-to-End Causal Inference with Large Language Models ๐Ÿ—“๏ธ 11:50 AM โ€“ 1:00 PM KST ๐Ÿ“ AUDITORIUM ๐Ÿšจ FAGEN ๐Ÿ“„ What Game-Theoretic Benchmarks Miss: Strategic Silence in Multi-Agent LLMs ๐Ÿ—“๏ธ 12:00โ€“2:00 PM KST ๐Ÿ“ GRAND BALLROOM 104-105 ๐Ÿค AI4GOOD ๐Ÿ“„ Mechanism Design Is Not Enough: Prosocial Agents for Cooperative ๐Ÿ“„ CoopEval: Benchmarking Cooperation-Sustaining Mechanisms and LLM Agents in Social Dilemmas ๐Ÿ“„ Weight-Level Defenses Improve LLM Agent Adversarial Robustness ๐Ÿ“„ Evaluating Cooperation in LLM Social Groups through Elected Leadership ๐Ÿ“„ Multi-Agent AI Systems Need Institutional Design, Not Just Model-Level Alignment ๐Ÿ—“๏ธ 4:20โ€“5:00 PM KST ๐Ÿ“ GRAND BALLROOM 103 Huge thanks to all collaborators, co-authors, organizers, and workshop communities โ€” looking forward to many great discussions at #ICML2026 ๐Ÿš€
2
7
542