
Jinesis Lab led by Prof @ZhijingJin at @UofTCompSci @VectorInst conducts frontier research on Responsible AI, LLMs, and Causality.
Joined December 2025
- Tweets116
- Following2
- Followers344
- Likes17
๐ #NeurIPS 2026 acceptance from our team at Jinesis Lab under @ZhijingJinโจ
1๏ธโฃ SuperSycophantic: Stress-Testing Frontier LLMs from Single- to Multi-Turn Sycophancy
2๏ธโฃ GT-HarmBench: Benchmarking AI Safety Risks Through the Lens of Game Theory
3๏ธโฃ Transferability for General Reasoning: An Automated Curriculum for Multi-Domain LLM RL
4๏ธโฃ Causality can systematically address the monsters under the bench(marks)
5๏ธโฃ AM-Bench: A Unified Taxonomy and Evaluation Suite for Agentic Misalignment
Happy to share this work with you!
๐๏ธ @MPI_IS @ELLISforEurope @UofTCompSci @VectorInst @TorontoSRI @CIFAR_News @JinesisLab @EuroSafeAI @ELLISInst_Tue
โ๏ธ Authors: @TerryJCZhang , @oscar_yasunaga, Wenyuan Jiang, @jbo_twt, @flodraye, Aydin Javadov, @iarthsingh, Lucille Muir, @vicoldemburgo, @PepijnCobben, @x_angelohuang, Thao Pham, @isabeldahlgren, @_yongjinny, @Jiarui_Liu_, @yinghui_he_, @leczhang, Felix Leeb, Eric Zhang, @maziugwuanyi, @Jerick1380, @bschoelkopf,
#AI #MachineLearning #LLMs #AISafety #ResponsibleAI #Causality #AIReasoning
Jinesis Lab (UToronto) retweeted
We are excited to share that we received over 420 submissions for the AI4GOOD workshop, and the review process has already started !!
To keep things fair, we follow the strict rules of the main NeurIPS conference. We cannot accept any papers outside of the official OpenReview portal, and we cannot allow resubmissions or changes after a desk-rejection.
Because we are managing so many papers, we won't be able to reply to individual queries.
We are so excited to host the 2nd edition of the Trustworthy AI for Good (AI4GOOD) Workshop at #NeurIPS2026 in Paris, France ๐ซ๐ท
We aim to bring together the AI safety, AI for social good, and AI policy/governance communities to connect what models can do as individual systems with what they do when deployed across populations.
For full details, welcome to visit our website at:
๐ trustworthy-ai-for-good.githโฆ
๐December 12, 2026 ยท Paris ๐ซ๐ท
We have an amazing lineup of speakers and plans. More details ๐งต
๐Very excited to share that Jinesis Lab at the University of Toronto has 10 papers accepted at EMNLP 2026 โ 5 at the main conference, 4 at Findings, and 1 at the Demo track!
Our work this cycle spans interpretability, AI safety, computer vision, and multi-agent systems:
๐Main Conference:
โข Tracing Multilingual Representations in LLMs with Cross-Layer Transcoders โ arxiv.org/abs/2511.10840
โข PruneGround: Plug-and-play Spatial Pruning for 3D Visual Grounding โ arxiv.org/abs/2606.31148
โข How Do Linear Probes Emerge? A Circuit-Tracing Framework with Concept-Targeted Attribution
โข Computation Graph Recovery from Chain-of-Thought โ openreview.net/pdf?id=OHES5cโฆ
โข Preserving Historical Truth: Detecting Historical Revisionism in Large Language Models โ arxiv.org/abs/2602.17433
๐Findings:
โข Evaluating Second-Order Bias of LLMs Through Epistemic Entitlement โ arxiv.org/abs/2606.17506
โข How Does Alignment Tuning Shape Representations of Sycophancy and Related Cue-Induced Biases in LLMs? โ arxiv.org/pdf/2607.18114
โข Simulating Democratic Deliberation: Representing Pluralistic Preferences through Electoral Systems in Multi-Agent LLMs
โข Fluid Representations in Reasoning Models โ arxiv.org/abs/2602.04843
๐Demo Track:
โข CLT-Forge: A Scalable Library for Cross-Layer Transcoders and Attribution Graphs
Huge congratulations to all the authors and collaborators across the lab and our partner institutions.
@AHarrasse1906, @flodraye, @psyonp, @ZhijingJin, @bschoelkopf, Duc Cao Dinh, @leduckhai, Chris Ngo, @TerryJCZhang, @vedantpalit1008, @RoderickWu4, Aydin Javadov, @francescortu, @JoeunYk05, @albecazzaniga, @radamihalcea, @RamaravindM, Raiyan Ahmed, Shion Guha, Syed Ishtiaque Ahmed, Prakhar Gupta, @_rfaulk, @SSzufa, Daniel Hoyer, Roland Bouffanais, @jzl86, Dmitrii Kharlapenko, @iarthsingh, @alesstolfo, @ArthurConmy, @mrinmayasachan, @TonyWu1105, @Jiarui_Liu_, Chih-Hao Hsu.
#EMNLP2026 #NLP #Interpretability #AISafety #MachineLearning
Jinesis Lab (UToronto) retweeted
What is chain-of-thought actually doing inside the model? Our new #EMNLP2026 Findings paper shows reasoning models rebuild the meaning of words in activation space over a single trace, and that these representations causally drive performance. Thread below๐
Jinesis Lab (UToronto) retweeted
๐จ 8 days left to submit to the Trustworthy AI for Good (AI4GOOD) Workshop at #NeurIPS2026 in Paris
Weโre still accepting submissions.
Join us in bridging AI safety, social good, and real-world impact, so that more capable models actually help society at scale.
Our workshop is non-archival, and we will recognize outstanding papers and top reviewers with awards.
Deadline: August 29, 2026 (AoE)
More details and submission โ trustworthy-ai-for-good.githโฆ
๐ง Sponsorship & questions: [email protected]
Let's bridge trustworthy AI and real-world impact.
We hope to see you all in Paris.
@TerryJCZhang @ChanglingXavier @_agirlyengineer @ozzaney0101, He (Shawn) Shuang, Jerick Shi, Prakhar Gupta, Kexin Li (Cassie), Wenjun (Wendy) Qiu
@ZhijingJin @radamihalcea @MilindTambe_AI @david_lie @casdewitt
@VectorInst @JinesisLab @EuroSafeAI @MPI_IS @UofTCompSci @TorontoSRI @CIFAR_News @ELLISInst_Tue @UMichCSE @michigan_AI @Harvard @ETH_en @CarnegieMellon @UniofOxford @NeurIPSConf @UofT
We are so excited to host the 2nd edition of the Trustworthy AI for Good (AI4GOOD) Workshop at #NeurIPS2026 in Paris, France ๐ซ๐ท
We aim to bring together the AI safety, AI for social good, and AI policy/governance communities to connect what models can do as individual systems with what they do when deployed across populations.
For full details, welcome to visit our website at:
๐ trustworthy-ai-for-good.githโฆ
๐December 12, 2026 ยท Paris ๐ซ๐ท
We have an amazing lineup of speakers and plans. More details ๐งต
Jinesis Lab (UToronto) retweeted
We are so excited to host the 2nd edition of the Trustworthy AI for Good (AI4GOOD) Workshop at #NeurIPS2026 in Paris, France ๐ซ๐ท
We aim to bring together the AI safety, AI for social good, and AI policy/governance communities to connect what models can do as individual systems with what they do when deployed across populations.
For full details, welcome to visit our website at:
๐ trustworthy-ai-for-good.githโฆ
๐December 12, 2026 ยท Paris ๐ซ๐ท
We have an amazing lineup of speakers and plans. More details ๐งต
Jinesis Lab (UToronto) retweeted
๐กAnnouncing NewInML workshop at #NeurIPS2026
We are so excited to host the 8th edition of the NewInML (@NewInML) workshop, which will take place in Paris, France ๐ซ๐ท
We are here to help you out gain confidence and network with the community!
If you are new to ML research or have limited publishing experience, it's a perfect opportunity for you to submit your first work, get high quality reviews from reviewers and also meet the experts, and of course, enjoy beautiful Paris ๐ฅ
We are delighted to have an amazing speaker line-up and interesting plans. More details ๐งต
Jinesis Lab (UToronto) retweeted
We're delighted to host the Trustworthy AI for Good (AI4GOOD) workshop at @NeurIPSConf in Paris ๐ซ๐ท
๐ข We're recruiting reviewers, plus an award for top reviewers ๐
If you're working on AI Safety, Alignment, AI for Science or related topics, we're looking for you.
Feel free to express your interest here: forms.gle/HpkPoE8HqMHH1geL9
๐ Weโd love to welcome you as a reviewer for the 2nd Trustworthy AI4GOOD Workshop at #NeurIPS2026 in Paris! ๐ซ๐ท
Following the success of our first edition at #ICML2026, this workshop will once again bring together researchers and practitioners working to ensure that advances in AI are not only powerful, but also trustworthy, responsible, and genuinely beneficial to society.
Each reviewer will be assigned no more than 3 papers through OpenReview, with no paper bidding or rebuttal phase.
๐๏ธ Review period: September 2026
โฐ Review deadline: September 22, 2026, AOE
Please make sure your OpenReview profile is up to date before registering.
Join us as a reviewer:
forms.gle/HpkPoE8HqMHH1geL9
Weโd be delighted to have you help shape this yearโs workshop! ๐
#AI4GOOD #TrustworthyAI #NeurIPS #AISafety
๐ Weโd love to welcome you as a reviewer for the 2nd Trustworthy AI4GOOD Workshop at #NeurIPS2026 in Paris! ๐ซ๐ท
Following the success of our first edition at #ICML2026, this workshop will once again bring together researchers and practitioners working to ensure that advances in AI are not only powerful, but also trustworthy, responsible, and genuinely beneficial to society.
Each reviewer will be assigned no more than 3 papers through OpenReview, with no paper bidding or rebuttal phase.
๐๏ธ Review period: September 2026
โฐ Review deadline: September 22, 2026, AOE
Please make sure your OpenReview profile is up to date before registering.
Join us as a reviewer:
forms.gle/HpkPoE8HqMHH1geL9
Weโd be delighted to have you help shape this yearโs workshop! ๐
#AI4GOOD #TrustworthyAI #NeurIPS #AISafety
๐ With the successful conclusion of our 1st Trustworthy AI4GOOD workshop at #ICML2026, we are delighted to share that its 2nd edition has been accepted for #NeurIPS2026 in Paris! ๐๐ซ๐ท
The workshop selection process was highly competitive: only 22% of 454 workshop proposals were accepted. We are grateful for the opportunity to bring the community together again! ๐
Paris, here we come! ๐ซ๐ท
ICML speakers: @Yoshua_Bengio, @OanaIgnatRo, @jzl86, @maksym_andr, Jenny Ni and @NamGoPro.
Panel: @MilindTambe_AI, @lrhammond, Gopal Sarma and @ARGleave.
Organizers: @TerryJCZhang, @ZhijingJin, @radamihalcea, @MilindTambe_AI, David Lie, @_agirlyengineer, @davidguzman1120, @ChanglingXavier, @Jerick1380, Prakhar Gupta, @vantru0ng, @EttoreGran, He (Shawn) Shuang, @ozzaney0101, Kexin Li and Wenjun Qiu.
Thank you for making our first edition unforgettable!๐
Thank you for making AI4GOOD possible! ๐
trustworthy-ai-for-good.githโฆ
Our Jinesis Lab at the University of Toronto is bringing three exciting papers to #COLM2026! ๐
These projects push the frontiers of #AISafety, #AgentSecurity, and #AIForScience.๐ค
Huge congratulations to all collaborators and co-authors!
Papers:
๐ก๏ธODILE: Orthogonal Disruption of Injected Tool-Call Embeddings for Agentic Prompt Injection Defense
๐ญStargazer: A Scalable Model-fitting Benchmark Environment for AI Agents under Astrophysical Constraints
โ ๏ธOne Word at a Time: Incremental Completion Decomposition Breaks LLM Safety
@UofT,@VectorInst,@EuroSafeAI,@ETH_en,@MPI_IS,@UMich
๐ What an incredible experience at #ICML2026! ๐
Our team at Jinesis Lab had a fantastic time presenting research across several exciting and important areas:
๐ค Multi-agent LLMs
๐ง Causal reasoning
๐ก๏ธ AI safety
We were proud to share this work alongside our collaborators and to engage with so many researchers from across the machine learning community. ๐ก
Just as valuable as presenting our own work was learning from the research others brought to ICML. From thought-provoking talks and innovative poster presentations to insightful discussions and spontaneous hallway conversations, the conference was full of ideas that challenged our thinking and opened new directions for future work. โจ
We are grateful to everyone who attended our presentations, visited our posters, shared feedback, and took the time to discuss their own research with us. ๐
A huge thank-you to our lab members, collaborators, and the broader ICML community for making the experience so memorable. We are leaving inspired, energized, and excited to build on the ideas and connections formed throughout the conference. ๐๐ฌ๐
#ICML #MachineLearning #ArtificialIntelligence #MultiAgentSystems #LLM #CausalReasoning #AISafety #ResponsibleAI #AIResearch #ResponsibleAI #AIResearch
๐โจ The Trustworthy AI for Good Workshop at ICML 2026 was a huge success! โจ๐
We are incredibly grateful to everyone who joined us in Seoul ๐ฐ๐ท for a full day of inspiring research, thoughtful discussions, and meaningful connections around building AI systems that are both trustworthy and socially beneficial. ๐ค๐๐ก
A heartfelt thank-you to our incredible keynote speakers:
๐ค @Yoshua_Bengio, @OanaIgnatRo, @jzl86, @maksym_andr, Jenny Ni, Naman Goyal
Your insights, perspectives, and thought-provoking ideas made the workshop truly memorable. ๐๐ง
A special thank-you to our outstanding panelists:
๐ฌ @MilindTambe_AI, @lrhammond, Gopal Sarma, @ARGleave
And to our wonderful moderator, @ZhijingJin, for leading such an engaging and insightful conversation. ๐๏ธ
We are also deeply grateful to all our oral and poster presenters, reviewers, organizers, volunteers, sponsors, and every attendee who contributed questions, ideas, feedback, and enthusiasm throughout the day. ๐
The energy of this community reinforced the importance of bringing together:
๐ก๏ธ AI safety
๐ AI for social good
โ๏ธ AI policy and governance
๐ค Cooperative AI
๐ฐ Information integrity
๐๏ธ Civic discourse
Thank you for making Trustworthy AI for Good @ #ICML2026 such a memorable and impactful event! ๐
We look forward to continuing the conversation, strengthening this community, and building on the connections formed at the workshop. ๐ค
#ICML2026 #AIForGood #TrustworthyAI #AISafety #ResponsibleAI #MachineLearning #CooperativeAI #AIResearch #TechForGood #ArtificialIntelligence
๐จ Thrilled to share that our lab will be presenting the ๐ Best Paper at the NExT-Game Workshop at #ICML2026 today!
๐ค When Agents Lie: Premeditation, Persistence, and Exploitation in Repeated Games
๐ Best Paper @ NExT-Game Workshop
๐ Conference Room S307
๐
Fri, Jul 10
๐ 13:00โ13:20 KST
Authors: @JerickShi @TerryJCZhang @bschoelkopf @conitzer @ZhijingJin
๐ค We introduce a three-stage endogenous promise protocol for repeated multi-agent games that asks not only whether LLM agents honor their public commitments when they can privately deviate, but also how model-on-model composition influences premeditated deception and persistent exploitation.
๐ Across six canonical games spanning binary and numerical action spaces, our evaluation of frontier models (GPT-5.2, Llama-4-Maverick, Claude-Opus-4.6) reveals:
๐น Over 90% of promise-breaking instances are premeditated in agents' private plans.
๐น Mixed-model groups with mismatched communication frameworks create systemic, persistent payoff gaps of up to 5.00 points from Round 0.
๐ Paper: openreview.net/forum?id=v8nYโฆ
#MultiAgentSystems #LLMs #GameTheory #AI #ICML2026
Excited to share more of our workshop papers today, July 11, at #ICML2026!๐๐ฐ๐ท๐ท
๐งAIWILD (โญOralโญ)
AF-ARENA: A Multi-Dimensional Evaluation Suite for Alignment Faking
๐๏ธ 10:10โ10:40 AM KST
๐Hall B2.
๐openreview.net/forum?id=vFqnโฆ
๐งAI4Math
Proving Your Way to Cooperation: Formalizing Proof-Based Open Source Game Theory in Lean
๐Room HALL D1
๐openreview.net/forum?id=Wc5Tโฆ
๐งAI4Physics
Stargazer: A Scalable Model-fitting Benchmark Environment for AI Agents under Astrophysical Constraints
๐Conference Room S402
๐aips-uoft.github.io/Stargazeโฆ
๐งNexT-Game
GT-HarmBench: Benchmarking AI Safety Risks Through the Lens of Game Theory
๐Conf. room S307
๐openreview.net/forum?id=F0Dzโฆ
๐งPluralistic Alignment
The Wedge Questions: Latent Cultural Boundaries in LLMs via Persona Projection Divergence
๐Room 403, Board #4613
๐openreview.net/forum?id=zHQuโฆ
Huge thanks to all collaborators, co-authors, organizers, and workshop communities โ looking forward to many great discussions at #ICML ๐
Thrilled to share that our lab will present the ๐Best Paper๐of RLxF Workshop @ #ICML2026 today!
๐ Transferability for General Reasoning: An Automated Curriculum for Multi-Domain LLM RL
๐ GRAND BALLROOM 101-102
๐๏ธ Fri, Jul 10 KST
๐ 4:00 PM โ 5:00 PM KST
๐ Authors: @_yongjinny, @Jiarui_Liu_, @yinghui_he_, @leczhang, @bschoelkopf, and @ZhijingJin
We introduce Transfer-Aware Curriculum (TAC), an automated curriculum for multi-domain RLVR that asks not only which domain is learnable right now, but also which domainโs gradients transfer well to the rest of the reasoning suite. ๐งฉ
Across math, code, logic, simulation, table reasoning, and STEM, TAC achieves the best macro-averaged accuracy on both Qwen3-1.7B and Llama3.2-3B, improving over strong curriculum baselines with <1% wall-clock overhead. ๐
Huge thanks to all collaborators, reviewers, and the RLxF organizers โ and please stop by to chat if youโre at #ICML2026! ๐
๐ Paper: arxiv.org/pdf/2606.25178
๐ Code: github.com/YangYongJin/transโฆ
#ICML #ICML2026 #RLxF #ReinforcementLearning #LLM #Reasoning #RLVR
Excited to share our workshop papers being presented TODAY at #ICML2026 in Seoul ๐ฐ๐ทโจ
Please stop by the posters and chat with us!
๐ง FoGen
๐ Test of Time: Rethinking Temporal Signal of Benchmark Contamination
๐๏ธ 9:10โ10:00 AM, 2:00โ2:50 PM KST
๐ ROOM 318
๐ค AI4GOOD ๐Spotlight๐
๐ Multi-Agent AI Systems Need Institutional Design, Not Just Model-Level Alignment
๐๏ธ 11:25 AM โ 1:00 PM KST
๐ GRAND BALLROOM 103
๐ฌ AI4Research
๐ Causal AI Scientist: Towards End-to-End Causal Inference with Large Language Models
๐๏ธ 11:50 AM โ 1:00 PM KST
๐ AUDITORIUM
๐จ FAGEN
๐ What Game-Theoretic Benchmarks Miss: Strategic Silence in Multi-Agent LLMs
๐๏ธ 12:00โ2:00 PM KST
๐ GRAND BALLROOM 104-105
๐ค AI4GOOD
๐ Mechanism Design Is Not Enough: Prosocial Agents for Cooperative
๐ CoopEval: Benchmarking Cooperation-Sustaining Mechanisms and LLM Agents in Social Dilemmas
๐ Weight-Level Defenses Improve LLM Agent Adversarial Robustness
๐ Evaluating Cooperation in LLM Social Groups through Elected Leadership
๐ Multi-Agent AI Systems Need Institutional Design, Not Just Model-Level Alignment
๐๏ธ 4:20โ5:00 PM KST
๐ GRAND BALLROOM 103
Huge thanks to all collaborators, co-authors, organizers, and workshop communities โ looking forward to many great discussions at #ICML2026 ๐
















