Lin Shi
Verified account This account is verified. Learn more@LinShi592021
20 Following 222 Followers 36 Posts
Latest posts 5
Harbor Adapters and Harbor-Index (previously named as harbor-mix) accepted at NeurIPS E&D! Congrats and special thanks to all of our contributors, advisors, and funding partners!
Harbor Adapters and Harbor-Index
arxiv.org/pdf/2609.04298
1+year work, 120+contributors, 300+PRs, 10+ funding partners.
arxiv.org/pdf/2609.04298
1+year work, 120+contributors, 300+PRs, 10+ funding partners.
Introducing Harbor-Index, a compact, diverse, and high-quality benchmark built to challenge frontier agents.
We carefully select, audit and fix 82 high-signal tasks out of 6,627 candidates spanning 54 benchmarks.
No agent gets above 30%. (1/5)
We carefully select, audit and fix 82 high-signal tasks out of 6,627 candidates spanning 54 benchmarks.
No agent gets above 30%. (1/5)
CAIS AgenticSE Workshop Keynote Talk: Harbor Adapters & Harbor Index
30min video here:
youtu.be/tvAAKX2XVus?si…
Happy to be invited as a keynote speaker and present our recent study on Harbor Adapters and agentic evaluation!
30min video here:
youtu.be/tvAAKX2XVus?si…
Happy to be invited as a keynote speaker and present our recent study on Harbor Adapters and agentic evaluation!