Twitxy Saved

Eugene Yang

@EYangTW

Information Retrieval | Research Scientist at HLTCOE @JohnsHopkins | CS PhD from @Georgetown | from Taiwan
Washington, DC eugene.zone Joined July 2018
426 Following 646 Followers 471 Posts

Latest posts 5

Eugene Yang @EYangTW
Alright! #RAGTIME submission is due in about a month!
Come join us and evaluate your deep research system

I would say this is one of the most expensive and involved annotation processes that we are developing/paying.
So your systems will be well evaluated!
๐ŸŽถ It's #RAGTIME! ๐ŸŽถ
Topics for TREC RAGTIME 2026 are out โ€” your deep research / report generation system now has a benchmark to prove itself on. Multilingual news in, cited English reports out.

Runs due Aug 12. One month. Let's go ๐Ÿ‘‡
๐Ÿ”— trec-ragtime.github.io
View quoted post on X
Eugene Yang @EYangTW
RAGTIME is coming back for the 2nd edition!
Come join us to evaluate your search agents!
We once again feature multilingual and fully human evaluation
This is the ultimate way to know whether your systems are doing better
๐Ÿšจ Every major AI lab is racing to build better "deep research" agents โ€” systems that search, synthesize, and report across the web.

But how do we actually *benchmark* them?

Introducing ๐Ÿงต TREC RAGTIME โ€” the shared task for rigorous RAG evaluation.

trec-ragtime.github.io
View quoted post on X
Eugene Yang @EYangTW
It's this Thursday AoE!
Can't wait to see all those papers coming in!
Eugene Yang @EYangTW Feb 16
๐Ÿ“… Key dates:
Paper submission: March 5, 2026
Shared task submission: April 8, 2026
Acceptance notification: April 28
Workshop: July 2 or 3 at ACL 2026

Papers can be archival or non-archival โ€” your choice after acceptance.

๐Ÿ“ Submit papers on OpenReview: openreview.net/group?id=aclweโ€ฆ
View quoted post on X
Eugene Yang @EYangTW
And if you are wondering, yes -- this is your favorite agentic deep research task!
We are just using a name that describes the output instead of the approach!
Eugene Yang @EYangTW Feb 16
๐Ÿšจ Calling all RAG researchers & NLP folks:
RAG4Reports is coming to ACL 2026 this July โ€” a workshop + shared tasks dedicated to the hardest version of RAG: long-form, citation-backed, multilingual report generation.
Here's why you should care ๐Ÿงต๐Ÿ‘‡

๐Ÿ”— rag4reports.github.io
View quoted post on X