Team Account for MSMARCO
Bellevue,WA
Joined December 2016
- Tweets294
- Following4
- Followers834
- Likes86
MSMarco retweeted
If you are at #TREC2023 this morning, then come down to room 3-CD for the TREC Deep Learning Track workshop and don't forget to pick up a TREC Deep Learning Track 5 year celebration sticker!
MSMarco retweeted
🔔 Reminder: The deadline for run submissions for the TREC 2023 Deep Learning Track is in 1 WEEK! #TRECDL #TREC2023DL
⌛Gentle reminder: #TREC2023DL Track run submission deadline is **JULY 31**. Get your run submissions in before the deadline! #TRECDL
Guidelines and more info: microsoft.github.io/msmarco/…
MSMarco retweeted
⌛Gentle reminder: #TREC2023DL Track run submission deadline is **JULY 31**. Get your run submissions in before the deadline! #TRECDL
Guidelines and more info: microsoft.github.io/msmarco/…
Announcing: Test queries for the TREC 2023 Deep Learning Track are now available, along with top-100s for (optional) use in reranking. #TRECDL #TREC2023DL
@MSMarcoAI microsoft.github.io/msmarco/…
MSMarco retweeted
We are pleased to announce that we have released the test queries for the TREC 2023 Deep Learning Track. This year, we have some 'synthetic' queries to explore whether we can glean insights about system performance using queries generated by LLMs.
#TREC #TREC2023DL
Are you planning to participate in the TREC 2023 Deep Learning Track? We have just released the test queries! 🙌🏽 #TRECDL #TREC2023DL
Run submission deadline is **JULY 31** (in exactly 3 weeks) 👈🏽
Guidelines and more info: microsoft.github.io/msmarco/…
MSMarco retweeted
Are you planning to participate in the TREC 2023 Deep Learning Track? We have just released the test queries! 🙌🏽 #TRECDL #TREC2023DL
Run submission deadline is **JULY 31** (in exactly 3 weeks) 👈🏽
Guidelines and more info: microsoft.github.io/msmarco/…
Announcing: Test queries for the TREC 2023 Deep Learning Track are now available, along with top-100s for (optional) use in reranking. #TRECDL #TREC2023DL
@MSMarcoAI microsoft.github.io/msmarco/…
MSMarco retweeted
Announcing: Test queries for the TREC 2023 Deep Learning Track are now available, along with top-100s for (optional) use in reranking. #TRECDL #TREC2023DL
@MSMarcoAI microsoft.github.io/msmarco/…
MSMarco retweeted
The TREC-DL Track will celebrate 5th anniversary this year.🎂 Focus will be on comprehensive passage runs judging and using those for document runs eval. Test queries to be released in June. Submission deadline: July 31st. #TRECDL #TREC2023DL
Guidelines: microsoft.github.io/msmarco/…
MSMarco retweeted
I'm co-organizing 2 TREC tracks this year: Tip-of-the-Tongue & Deep Learning. Excited that 20+ groups have already registered for each. 🙌🏽#TREC2023 #TREC2023ToT #TREC2023DL #TRECToT #TRECDL
Please Register: ir.nist.gov/trecsubmit.open/…
Also, guidelines for both tracks are now online.
MSMarco retweeted
Super excited about #TREC'23!🙌🏽 This year is the 5th anniversary🎂 of the Deep Learning Track. #TRECDL I'm also co-organizing the Tip-of-the-Tongue Track, #TRECToT the cool new track😎 at TREC w/ complex and ambiguous information needs. Please participate!
trec.nist.gov/pubs/call2023.…
MSMarco retweeted
Quick follow-up: Here's our poster summarizing the TREC 2022 Deep Learning track. #TREC2022DL #TREC2022 #TRECDL
ALT An academic poster titled "Overview of the TREC 2022 Deep Learning Track".
MSMarco retweeted
Was a pleasure to present the 4th Deep Learning Track overview at #TREC2022. We had healthy track participation and observed bigger gaps between trad. and NN based methods, and better distribution of system performances across queries. #TREC2022DL #TRECDL
microsoft.github.io/msmarco/…
ALT Slide titled "TREC Deep Learning: Ranking in the large-data regime" describing the goal and history of the track and the focus for the 2022 edition of the track.
ALT Slide presenting the participant statistics for the track this year.
ALT Plots comparing traditional IR based methods ("trad") and deep learning based methods ("nnlm" and "nn") for both the passage and document ranking tasks for TREC 2022 Deep Learning Track.
ALT Couple of boxplots showing distribution of system performances for each of the test queries in the TREC 2022 Deep Learning Track.
MSMarco retweeted
Slides from my recent invited talk @SpotifyResearch reflecting on benchmark development, community building, and robust scientific progress based on my experience working on @MSMarcoAI and TREC Deep Learning Track.
slideshare.net/BhaskarMitra3…
Thank you @CharlotteHase for hosting me!
MSMarco retweeted
TREC 2022 Deep Learning Track test queries (+ top-100 candidates for reranking subtask) has been released.📣 #TREC2022DL #TREC2022
Run submission deadline: *Aug 10*
More info: microsoft.github.io/msmarco/…
Please RT.
Announcing: Test queries for the TREC 2022 Deep Learning Track are now available, along with (optional) top-100 candidates for both document and passage ranking. #TRECDL #TREC2022DL
@MSMarcoAI microsoft.github.io/msmarco/…
MSMarco retweeted
Announcing: Test queries for the TREC 2022 Deep Learning Track are now available, along with (optional) top-100 candidates for both document and passage ranking. #TRECDL #TREC2022DL
@MSMarcoAI microsoft.github.io/msmarco/…
MSMarco retweeted
📣TREC 2022 Deep Learning Track submission guidelines are out: microsoft.github.io/msmarco/…
Submission deadline: Aug 10
This will be the second year using the V2 collection. Test queries are coming soon!
#TREC #TREC2022 #TREC2022DL #MSMARCO #DeepLearning
Announcing: TREC 2022 Deep Learning Track guidelines! Deadline: August 10. This year we'll focus on comprehensive judging of passage runs. Evaluate document runs based on presence of relevant passages. Focus on reusability of the test collection. microsoft.github.io/msmarco/…
MSMarco retweeted
@MSMarcoAI #TRECDL #TREC2022DL
DL Track Coordinators: Nick Craswell @nick_craswell, Bhaskar Mitra @UnderdogGeek, Emine Yilmaz, Daniel Campos @spacemanidol and Jimmy Lin @lintool.
MSMarco retweeted
Because systems are so good these days, we started finding too many relevant documents last year, and ran short on judging resources. Consolidating two judging tasks into one (eliminating document judging) should help us this year.
MSMarco retweeted
This is our second year with the v2 data. teapaw.org/nick_craswell/status/1…
Announcing: Both passage and document datasets are now available for the TREC 2021 Deep Learning Track. Our main focus this year is to get started on these new larger cleaner datasets. Test set queries are coming soon!
microsoft.github.io/msmarco/… @MSMarcoAI #TRECDL #TREC2021DL
MSMarco retweeted
Announcing: TREC 2022 Deep Learning Track guidelines! Deadline: August 10. This year we'll focus on comprehensive judging of passage runs. Evaluate document runs based on presence of relevant passages. Focus on reusability of the test collection. microsoft.github.io/msmarco/…