MSMarco

Congratulations to Soonhwan Kwon & Minyoung Lee from Samsung SDS AI Research on their "ANCE + LongP (ensemble)" submission which is the new top run on the #MSMARCO Document Ranking Leaderboard! Full leaderboard: msmarco.org

💡 #SOTA Alert 💡 Congratulations to Xuanyu Zhang from AI-Lab, DXM on their "DML" submission which is the new top run on the #MSMARCO Document Ranking Leaderboard with an MRR of 0.416 on the heldout eval set! Full leaderboard: msmarco.org

💡 #SOTA Alert 💡 Congratulations to @luyu_gao and @ZhuyunDai from @LTIatCMU on their "LCE loss + HDCT (ensemble)" submission which is the new top run on the #MSMARCO Document Ranking Leaderboard! Full leaderboard: msmarco.org

💡#SOTA Alert💡 Congrats to Yingyan Li and Xinyu Ma from ICT, CAS on the "PROP_step400K base (ensemble v0.1)" submission which is now at the top of the #MSMARCO Document Ranking Leaderboard and the first to edge past eval MRR@100 of 0.4! Full leaderboard: msmarco.org/

💡#SOTA Alert💡 Congratulations to @srchvrs (from Bosch Center for AI) on making it to the top of the #MSMARCO Document Ranking Leaderboard surpassing the previous #1 run which was by... *checks notes* @srchvrs msmarco.org/#docranking

💡#SOTA Alert💡 Congratulations to @srchvrs (from @Bosch_AI) on once again making it to the top of the #MSMARCO Document Ranking Leaderboard with their "BERT-m1 base + classic IR + doc2query" submission that achies an MRR of 0.390. msmarco.org/#docranking

💡#SOTA Alert💡 Congratulations to Omar Khattab, Christopher Potts, and Matei Zaharia from @Stanford on their "ColBERT MaxP end-to-end" submission that is now the new top run on the #MSMARCO Document Ranking Leaderboard with a MRR@100 of 0.384! microsoft.github.io/msmarco/

Congrats to @srchvrs (Bosch Center for AI) on their recent submission "BERT-m1 base + classic IR + doc2query" to the #MSMARCO Document Ranking Leaderboard. This submission achieves a MRR of 0.380 which is now the second highest MRR on the leaderboard! msmarco.org/#docranking

💡#SOTA Alert💡 We have a new top run on the #MSMARCO Passage Ranking Leaderboard with an MRR@10 of 0.426! The submission is currently anonymized because the corresponding paper is under review. But congratulations to the team!

💡#SOTA Alert💡 Congratulations to @luyu_gao and @ZhuyunDai from @LTIatCMU on their "HDCT top100 + BERT-base FirstP (single)" submission that is now the new top run on the #MSMARCO Document Ranking Leaderboard with a MRR@100 of 0.382!

💡#SOTA Alert💡 Congratulations to University of Waterloo on their Expando-Mono-Duo-T5 submission that is now the new top run on the #MSMARCO Document Ranking Leaderboard with a MRR@100 of 0.370!

Congrats to OpenMatch (THU-MSR) on their submission "BERT Base FirstP Baseline" to the #MSMARCO Document Ranking Leaderboard achieving an MRR of 0.317 and grabbing the #2 rank on the leaderboard!