Twitxy Saved

Dayoon Ko

@dayoon12161

Visiting Student Researcher @ UC Berkeley | Ph.D. Candidate in CSE @ SNU | Prev. LG AI Research
Seoul, Republic of Korea Joined October 2023
252 Following 251 Followers 69 Posts

Latest posts 5

Pinned post

Dayoon Ko @dayoon12161
๐ŸŽ‰ Our paper has been accepted to #ICLR2026! ๐Ÿ˜†๐Ÿ’–
This work was done during my internship at LG AI Research โ€“ Superintelligence Lab. As summarized in the project:

Deep research requires broad evidence coverage and reliable synthesis.
HybridDeepSearcher achieves both by parallelย retrieval for breadth with sequential reasoning for depth, supporting scalable search.

๐Ÿ”— Project page: hybriddeepsearcher.github.io
๐Ÿ“„ OpenReview: openreview.net/forum?id=rXpTZโ€ฆ

Huge thanks to my mentors and co-workers for their guidance and support throughout this project. We also plan to release related work soon. Stay tuned! ๐Ÿ˜Š
4 replies 5 reposts 60 likes 6.2K views View on X
Dayoon Ko @dayoon12161
Wait, what was that paper I saw last week with the pink and blue Pareto curves? ๐Ÿค” Keep screenshots of your screen, and you can find it again, right on your laptop. ๐Ÿ’ป

๐Ÿ”ฅ Introducing ๐‘บ๐’•๐’“๐’†๐’‚๐’Ž๐‘ฌ๐’Ž๐’ƒ๐’†๐’…: real-time visual indexing of your screen history, fully on-device.

โš–๏ธ The latencyโ€“accuracy trade-off
OCR text index: fast, but loses what only pixels show
Screenshot index: accurate, but 2.3s per screenshot on a laptop GPU

๐‘บ๐’•๐’“๐’†๐’‚๐’Ž๐‘ฌ๐’Ž๐’ƒ๐’†๐’… gets both: ๐˜‚๐—ฝ ๐˜๐—ผ ๐Ÿฏ.๐Ÿณร— ๐—ณ๐—ฎ๐˜€๐˜๐—ฒ๐—ฟ than full-screenshot encoding at matched accuracy, and +๐Ÿฒ.๐Ÿฏ ๐—ฅ๐—ฒ๐—ฐ๐—ฎ๐—น๐—น@๐Ÿญ๐Ÿฌ over OCR.

๐Ÿ’ซ How?
(1) ๐—ฆ๐—ฐ๐—ฟ๐—ฒ๐—ฒ๐—ป๐˜€ ๐—ฏ๐—ฎ๐—ฟ๐—ฒ๐—น๐˜† ๐—ฐ๐—ต๐—ฎ๐—ป๐—ด๐—ฒ. Often, only a handful of blocks differ.
(2) ๐—ฆ๐—ผ ๐˜„๐—ฒ ๐˜€๐˜๐—ผ๐—ฝ ๐—ฟ๐—ฒ๐—ฐ๐—ผ๐—บ๐—ฝ๐˜‚๐˜๐—ถ๐—ป๐—ด ๐˜๐—ต๐—ฒ๐—บ. Spatial token pruning drops blocks that repeat a neighbor; temporal KV reuse recomputes only what changed: 57โ€“71% less compute.
(3) ๐—” ๐˜๐—ถ๐—ป๐˜† ๐—ฎ๐—ฑ๐—ฎ๐—ฝ๐˜๐—ฒ๐—ฟ keeps the embedding faithful to the full screenshot.

๐Ÿ“ ๐—ง๐—ฎ๐—ธ๐—ฒ๐—ฎ๐˜„๐—ฎ๐˜†: keeping your entire screen history as pixels is now practical on a laptop. Next: fully local visual agents with memory.

You can try it on your laptop right now: ๐™ฅ๐™ž๐™ฅ ๐™ž๐™ฃ๐™จ๐™ฉ๐™–๐™ก๐™ก ๐™จ๐™ฉ๐™ง๐™š๐™–๐™ข๐™š๐™ข๐™—๐™š๐™™
๐Ÿ’ป Code: github.com/StarTrail-org/โ€ฆ
๐Ÿ“„ Paper: arxiv.org/abs/2611.18516
0:47
5 replies 18 reposts 81 likes 158K views View on X
Dayoon Ko @dayoon12161
๐Ÿ“ข ๐‘ต๐’†๐’˜ ๐‘ท๐’‚๐’‘๐’†๐’“!

Have you ever asked an AI to find a paper and gotten something that looked ๐˜ณ๐˜ช๐˜จ๐˜ฉ๐˜ต but wasnโ€™t? ๐Ÿคฏ

We find that this happens when requirements are ๐˜ช๐˜ฎ๐˜ฑ๐˜ญ๐˜ช๐˜ค๐˜ช๐˜ต, when they ๐˜ข๐˜ค๐˜ค๐˜ถ๐˜ฎ๐˜ถ๐˜ญ๐˜ข๐˜ต๐˜ฆ across turns, and when ๐˜ฏ๐˜ฐ ๐˜ฎ๐˜ข๐˜ต๐˜ค๐˜ฉ๐˜ช๐˜ฏ๐˜จ paper exists.

To evaluate these implicit, cumulative, and unmet needs, we propose ๐‚๐จ๐ฆ๐ฉ๐‹๐ข๐ญ๐Ÿ”Ž, a scientific literature search benchmark covering all arXiv domains. On this benchmark, we find that search agents often find the right paper but fail to read it, or read it but still report a different paper that seems plausible but is wrong.

Why does this matter? Researchers search outward ๐ŸŒฑ, from what they have explored toward what they have not. As a result, they state their requirements implicitly, add to them over time, and often look for something no existing paper satisfies, because they are after novelty.

We analyze the agentsโ€™ trajectories turn by turn to see where they go wrong, which can guide future improvements. Doing well on ๐‚๐จ๐ฆ๐ฉ๐‹๐ข๐ญ would be a first step toward trustworthy research agents.

Huge thanks to my mentors, co-authors, and advisor for their support! โค๏ธ

๐Ÿ“„ Paper: arxiv.org/abs/2610.28658
๐ŸŒ Project page: dayoon-ko.github.io/CompLit/
๐Ÿ’ป Code: github.com/dayoon-ko/Compโ€ฆ
๐Ÿค— Dataset: huggingface.co/datasets/dayooโ€ฆ
6 replies 5 reposts 62 likes 3.5K views View on X
Dayoon Ko @dayoon12161
Super excited to join @sewon__min's group at UC Berkeley as a Visiting Student Researcher from October to March!๐Ÿป I've been a big fan of her work for years!

I'll be exploring on-device multimodal retrieval. If you're in the Bay area and into RAG or multimodal learning, let's grab a coffee โ˜•๏ธ

Huge thanks to my advisor @gunheekim at SNU for supporting this visit โœจ
2 replies 2 reposts 61 likes 3.5K views View on X
Dayoon Ko @dayoon12161
๐Ÿšจ Excited to share that our paper was accepted to #ACL2025 Findings ๐ŸŽ‰ "When Should Dense Retrievers Be Updated in Evolving Corpora? Detecting Out-of-Distribution Corpora Using GradNormIR"

Huge thanks to my amazing collaborators! ๐Ÿ™Œ @jinyoung__kim @ohmyksh

We propose GradNormIR โ€” an unsupervised method to detect out-of-distribution (OOD) corpora. This helps decide when to update dense retrievers to avoid degraded retrieval performance in evolving corpora.

Tested on BEIR, GradNormIR leads to more robust and efficient retrieval in dynamic settings.

๐Ÿ“„ Read more: [arxiv.org/abs/2506.01877]
arxiv.org When Should Dense Retrievers Be Updated in Evolving Corpora?... Dense retrievers encode texts into embeddings to efficiently retrieve relevant documents from large databases in response to user queries. However, real-world corpora continually evolve, leading...