People tend to be more casual when asking AI questions than when asking another person. But what are the consequences? Can existing deep research agents (DRAs) infer what users leave unsaid through agentic reasoning and searching?
๐กIntroducing UNDERSPEC-DR, a framework for evaluating how deep research agents handle underspecified user queries.
๐ถOur results show that while DRAs can still generate answers grounded in cited evidence, their answers may fall short of satisfying usersโ information needs substantially, even when one single detail is missing from the original query.
๐Paper: arxiv.org/abs/2610.39413โฆ
๐กIntroducing UNDERSPEC-DR, a framework for evaluating how deep research agents handle underspecified user queries.
๐ถOur results show that while DRAs can still generate answers grounded in cited evidence, their answers may fall short of satisfying usersโ information needs substantially, even when one single detail is missing from the original query.
๐Paper: arxiv.org/abs/2610.39413โฆ