TREC Tip-of-the-Tongue Track (@TREC_ToT) header
TREC Tip-of-the-Tongue Track (@TREC_ToT) profile picture

TREC Tip-of-the-Tongue Track

@TREC_ToT

TREC Tip-of-the-Tongue Track focuses on known-item identification where the searcher cannot recall a reliable identifier (i.e., "It’s on the tip of my tongue…")

trec-tot.github.io/
Joined January 2023
  • Tweets52
  • Following3
  • Followers38
6Media
Photo by TREC Tip-of-the-Tongue Track (@TREC_ToT)Photo by TREC Tip-of-the-Tongue Track (@TREC_ToT)Photo by TREC Tip-of-the-Tongue Track (@TREC_ToT)Photo by TREC Tip-of-the-Tongue Track (@TREC_ToT)Photo by TREC Tip-of-the-Tongue Track (@TREC_ToT)Photo by TREC Tip-of-the-Tongue Track (@TREC_ToT)
Hello TREC-ToTers! 👋🏽 📆 Good news! We are extending the run submission deadline by 2 weeks. Please submit your runs by **September 10 (Wednesday)** and spread the word. More info: trec-tot.github.io/guideline… #TREC2025 #TRECToT #TREC2025ToT

TREC 2025 Tip-of-the-Tongue (ToT) Track

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

trec-tot.github.io
TREC Tip-of-the-Tongue Track (@TREC_ToT) profile pictureTREC Tip-of-the-Tongue Track@TREC_ToT4 Aug 2025
Important announcement: All run submissions for the TREC'25 Tip-of-the-Tongue (TREC-ToT) Track are due by **August 27th**. The run submission form is now open. Please submit your runs before the deadline. More information: trec-tot.github.io/guideline… #TREC2025 #TRECToT #TREC2025ToT

TREC 2025 Tip-of-the-Tongue (ToT) Track

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

trec-tot.github.io
2
1
2
843
**NTCIR Tip-of-the-Tongue Shared Task** Participate in Chinese, Japanese, Korean, and/or English. #NTCIR2026 #NTCIRToT #NTCIR2026ToT Registration deadline: June 1 Runs submission deadline: July 30 Guidelines: ntcir-tot.github.io/guidelin… Register: research.nii.ac.jp/ntcir/ntc… See 🧵...

NTCIR 2026 Tip-of-the-Tongue (ToT) Shared Task

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

ntcir-tot.github.io
NTCIR (@NTCIR) profile pictureNTCIR@NTCIRMay 19
🧵 Have you ever tried to re-find a movie you watched but cannot remember its name? Perhaps you vaguely remember the plot or a scene or the context in which you watched it. That's a Tip-of-the-Tongue (ToT) information need. Current search engines cannot solve them. #NTCIR19 (1/5)
1
2
241
It's deadline day! 🏃🏾‍♂️🏃🏾🏃🏾‍♀️ #TREC2025 #TRECToT #TREC2025ToT
Bhaskar Mitra | ভাস্কর মিত্র (@UnderdogGeek) profile pictureBhaskar Mitra | ভাস্কর মিত্র@UnderdogGeek8 Sep 2025
⏰ Gentle reminder: Run submission deadline for TREC'25 Tip-of-the-Tongue (ToT) Track is end-of-day **Wednesday (Sep 10)** Anywhere-on-Earth (AoE). Please make sure to submit your runs before the deadline. Guidelines: trec-tot.github.io/guideline… #TREC2025 #TRECToT #TREC2025ToT

TREC 2025 Tip-of-the-Tongue (ToT) Track

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

trec-tot.github.io
1
1
325
⏰ Gentle reminder: Run submission deadline for TREC'25 Tip-of-the-Tongue (ToT) Track is end-of-day **Wednesday (Sep 10)** Anywhere-on-Earth (AoE). Please make sure to submit your runs before the deadline. Guidelines: trec-tot.github.io/guideline… #TREC2025 #TRECToT #TREC2025ToT

TREC 2025 Tip-of-the-Tongue (ToT) Track

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

trec-tot.github.io
TREC Tip-of-the-Tongue Track (@TREC_ToT) profile pictureTREC Tip-of-the-Tongue Track@TREC_ToT25 Aug 2025
Hello TREC-ToTers! 👋🏽 📆 Good news! We are extending the run submission deadline by 2 weeks. Please submit your runs by **September 10 (Wednesday)** and spread the word. More info: trec-tot.github.io/guideline… #TREC2025 #TRECToT #TREC2025ToT

TREC 2025 Tip-of-the-Tongue (ToT) Track

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

trec-tot.github.io
1
1
569
TREC Tip-of-the-Tongue Track retweeted
Danny To Eun Kim (@TEKnologyy) profile picture
Danny To Eun Kim
@TEKnologyy1 Sep 2025
Tip of the Tongue retrieval shared task is coming to Tokyo!
Bhaskar Mitra | ভাস্কর মিত্র (@UnderdogGeek) profile pictureBhaskar Mitra | ভাস্কর মিত্র@UnderdogGeek1 Sep 2025
Some exciting news! 🤗 After 3 amazing years at TREC, the Tip-of-the-Tongue (ToT) shared task will be a core task at NTCIR-19 in 2026. The new track will focus on ToT information needs in English and East Asian languages. More details coming soon. See you all in Tokyo next year!
2
9
682
We are coming to Tokyo!!! ✈️
Bhaskar Mitra | ভাস্কর মিত্র (@UnderdogGeek) profile pictureBhaskar Mitra | ভাস্কর মিত্র@UnderdogGeek1 Sep 2025
Some exciting news! 🤗 After 3 amazing years at TREC, the Tip-of-the-Tongue (ToT) shared task will be a core task at NTCIR-19 in 2026. The new track will focus on ToT information needs in English and East Asian languages. More details coming soon. See you all in Tokyo next year!
2
1
290
📆 Please note the deadline extension for #TREC2025 Tip-of-the-Tongue (ToT) Track! Track guidelines: trec-tot.github.io/guideline… #TRECToT #TREC2025ToT

TREC 2025 Tip-of-the-Tongue (ToT) Track

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

trec-tot.github.io
TREC Tip-of-the-Tongue Track (@TREC_ToT) profile pictureTREC Tip-of-the-Tongue Track@TREC_ToT25 Aug 2025
Hello TREC-ToTers! 👋🏽 📆 Good news! We are extending the run submission deadline by 2 weeks. Please submit your runs by **September 10 (Wednesday)** and spread the word. More info: trec-tot.github.io/guideline… #TREC2025 #TRECToT #TREC2025ToT

TREC 2025 Tip-of-the-Tongue (ToT) Track

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

trec-tot.github.io
1
1
225
Gentle reminder 📢 All run submissions for the Tip-of-the-Tongue (ToT) Track are due next week Wednesday (Aug 27). More info: trec-tot.github.io/guideline… #TREC2025 #TRECToT #TREC2025ToT

TREC 2025 Tip-of-the-Tongue (ToT) Track

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

trec-tot.github.io
TREC Tip-of-the-Tongue Track (@TREC_ToT) profile pictureTREC Tip-of-the-Tongue Track@TREC_ToT4 Aug 2025
Important announcement: All run submissions for the TREC'25 Tip-of-the-Tongue (TREC-ToT) Track are due by **August 27th**. The run submission form is now open. Please submit your runs before the deadline. More information: trec-tot.github.io/guideline… #TREC2025 #TRECToT #TREC2025ToT

TREC 2025 Tip-of-the-Tongue (ToT) Track

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

trec-tot.github.io
2
1
364
Hello TREC-ToTers! 👋🏽 Please note that the deadline for run submissions this year is **Aug 27**. Please spread the word! 🙏🏽
TREC Tip-of-the-Tongue Track (@TREC_ToT) profile pictureTREC Tip-of-the-Tongue Track@TREC_ToT4 Aug 2025
Important announcement: All run submissions for the TREC'25 Tip-of-the-Tongue (TREC-ToT) Track are due by **August 27th**. The run submission form is now open. Please submit your runs before the deadline. More information: trec-tot.github.io/guideline… #TREC2025 #TRECToT #TREC2025ToT

TREC 2025 Tip-of-the-Tongue (ToT) Track

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

trec-tot.github.io
2
3
448
TREC Tip-of-the-Tongue Track retweeted
Danny To Eun Kim (@TEKnologyy) profile picture
Danny To Eun Kim
@TEKnologyy4 Aug 2025
This year's TREC Tip of the Tongue track will be amazing! Based on our rigorous experiments on synthetic ToT query generation presented at #SIGIR2025, we extended the track to open domain ToT queries. We provide codes for baseline systems, and submissions are due by August 27th!
TREC Tip-of-the-Tongue Track (@TREC_ToT) profile pictureTREC Tip-of-the-Tongue Track@TREC_ToT4 Aug 2025
Important announcement: All run submissions for the TREC'25 Tip-of-the-Tongue (TREC-ToT) Track are due by **August 27th**. The run submission form is now open. Please submit your runs before the deadline. More information: trec-tot.github.io/guideline… #TREC2025 #TRECToT #TREC2025ToT

TREC 2025 Tip-of-the-Tongue (ToT) Track

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

trec-tot.github.io
2
6
500
Important announcement: All run submissions for the TREC'25 Tip-of-the-Tongue (TREC-ToT) Track are due by **August 27th**. The run submission form is now open. Please submit your runs before the deadline. More information: trec-tot.github.io/guideline… #TREC2025 #TRECToT #TREC2025ToT

TREC 2025 Tip-of-the-Tongue (ToT) Track

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

trec-tot.github.io
TREC Tip-of-the-Tongue Track (@TREC_ToT) profile pictureTREC Tip-of-the-Tongue Track@TREC_ToT13 Jul 2025
Hello TREC-ToTers! We have released the test queries for the TREC 2025 Tip-of-the-Tongue (TREC-ToT) Track. Please see the guidelines for more information: trec-tot.github.io/guideline…. Run submission deadline will tentatively be in August. #TREC2025 #TRECToT #TREC2025ToT

TREC 2025 Tip-of-the-Tongue (ToT) Track

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

trec-tot.github.io
3
1
1,780
📣📣📣
TREC Tip-of-the-Tongue Track (@TREC_ToT) profile pictureTREC Tip-of-the-Tongue Track@TREC_ToT13 Jul 2025
Hello TREC-ToTers! We have released the test queries for the TREC 2025 Tip-of-the-Tongue (TREC-ToT) Track. Please see the guidelines for more information: trec-tot.github.io/guideline…. Run submission deadline will tentatively be in August. #TREC2025 #TRECToT #TREC2025ToT

TREC 2025 Tip-of-the-Tongue (ToT) Track

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

trec-tot.github.io
1
2
268
Hello TREC-ToTers! We have released the test queries for the TREC 2025 Tip-of-the-Tongue (TREC-ToT) Track. Please see the guidelines for more information: trec-tot.github.io/guideline…. Run submission deadline will tentatively be in August. #TREC2025 #TRECToT #TREC2025ToT

TREC 2025 Tip-of-the-Tongue (ToT) Track

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

trec-tot.github.io
TREC Tip-of-the-Tongue Track (@TREC_ToT) profile pictureTREC Tip-of-the-Tongue Track@TREC_ToT9 May 2025
Hello TREC-ToTers! 👋🏽 Excited to announce the release of TREC 2025 Tip-of-the-Tongue (TREC-ToT) Track guidelines: trec-tot.github.io/guideline…. We will release test queries in July and run submission deadline will be in August. #TRECToT #TREC2025ToT Please register to participate:

TREC 2025 Tip-of-the-Tongue (ToT) Track

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

trec-tot.github.io
1
2
4
646
TREC Tip-of-the-Tongue Track retweeted
Maik Fröbe (@maik_froebe) profile picture
Maik Fröbe@maik_froebe27 Jun 2025
Do not forget to participate in the #TREC2025 Tip-of-the-Tongue (ToT) Track :) The corpus and baselines (with run files) are now available and easily accessible via the ir_datasets API and the HuggingFace Datasets API. More details are available at: trec-tot.github.io/guideline…
Image from Maik Fröbe (@maik_froebe)
1
7
14
618
TREC Tip-of-the-Tongue Track retweeted
TREC Tip-of-the-Tongue Track (@TREC_ToT) profile picture
TREC Tip-of-the-Tongue Track@TREC_ToT9 May 2025
Hello TREC-ToTers! 👋🏽 Excited to announce the release of TREC 2025 Tip-of-the-Tongue (TREC-ToT) Track guidelines: trec-tot.github.io/guideline…. We will release test queries in July and run submission deadline will be in August. #TRECToT #TREC2025ToT Please register to participate:

TREC 2025 Tip-of-the-Tongue (ToT) Track

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

trec-tot.github.io
5
2
6
1,297
Please share the word and register to participate! #TREC2025ToT
TREC Tip-of-the-Tongue Track (@TREC_ToT) profile pictureTREC Tip-of-the-Tongue Track@TREC_ToT9 May 2025
Hello TREC-ToTers! 👋🏽 Excited to announce the release of TREC 2025 Tip-of-the-Tongue (TREC-ToT) Track guidelines: trec-tot.github.io/guideline…. We will release test queries in July and run submission deadline will be in August. #TRECToT #TREC2025ToT Please register to participate:

TREC 2025 Tip-of-the-Tongue (ToT) Track

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

trec-tot.github.io
3
9
556
Hello TREC-ToTers! 👋🏽 Excited to announce the release of TREC 2025 Tip-of-the-Tongue (TREC-ToT) Track guidelines: trec-tot.github.io/guideline…. We will release test queries in July and run submission deadline will be in August. #TRECToT #TREC2025ToT Please register to participate:

TREC 2025 Tip-of-the-Tongue (ToT) Track

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

trec-tot.github.io
5
2
6
1,297
TREC Tip-of-the-Tongue Track retweeted
Danny To Eun Kim (@TEKnologyy) profile picture
Danny To Eun Kim
@TEKnologyy5 Mar 2025
These approaches powered the TREC 2024 TOT track test queries and will continue into the 2025 track (trec-tot.github.io). Joyful collaboration with Yifan He, @841io, Jaime Arguello, and @UnderdogGeek! #SIGIR #TREC #TOT

Overview

Tip of the tongue: The phenomenon of failing to retrieve something from memory, combined with partial recall and the feeling that retrieval is imminent.

trec-tot.github.io
1
3
7
338
TREC Tip-of-the-Tongue Track retweeted
Danny To Eun Kim (@TEKnologyy) profile picture
Danny To Eun Kim
@TEKnologyy5 Mar 2025
📂 Our Code & Data 🔗LLM-Elicitation: github.com/kimdanny/llm-tot-… 🔗Human query collection interface with visual stimuli set: github.com/kimdanny/human-to…
GitHub - kimdanny/llm-tot-query-elicitation: SIGIR 2025 "Tip of the Tongue Query Elicitation for...

GitHub - kimdanny/llm-tot-query-elicitation: SIGIR 2025 "Tip of the Tongue Query Elicitation for...

SIGIR 2025 "Tip of the Tongue Query Elicitation for Simulated Evaluation" - kimdanny/llm-tot-query-elicitation

github.com
1
2
5
241
TREC Tip-of-the-Tongue Track retweeted
Danny To Eun Kim (@TEKnologyy) profile picture
Danny To Eun Kim
@TEKnologyy5 Mar 2025
⚡️Multi-Domain Coverage Combining both methods allows TOT query evaluation in multiple domains. We tested simulated evaluation in Movie, Landmark, and Person domains. Moreover, we build a broader, more inclusive TOT test collection.
1
2
3
125
Load more