OSU NLP Group

Yuekun Yao Verified account @yuekun_yao · 2d

Looped LLMs are heating up🔥. Open weights are becoming available, but the recipes to train these models remain hard to find.

Introducing ARLoop, a family of strong, fully-open pretrained looped transformers with Attention Residuals! Our strongest model, ARLoop-1.2B, outperforms both Huginn-3.5B, a prior fully open looped LLM, and Qwen3.5-2B Base on evaluated benchmarks across commonsense reasoning, math, and coding.

We release the full recipe: from data preparation and model training to intermediate checkpoints and evaluation code. ⤵️

View quoted post on X

Huan Sun Verified account @hhsun1 · Oct 27

Getting papers published probably won’t excite you anymore, but getting paper awards still do, especially THREE paper awards from #EMNLP2026 and a #NeurIPS2026 workshop on the same day @osunlp! Thrilled to share:

SkillHarm, led by @yuting_ning and @Zhehao_Zhang123, gets an Outstanding Paper Award at #EMNLP2026. I particularly like that SkillHarm introduces a new attack scenario, named Self-Mutating Poisoning (SMP), where an initially benign execution silently mutates persistent skill content that defers harm until a later reuse.

D3-Gym (co-led by @HananeNMoussa and @YifeiLiPKU) gets an Outstanding Paper Award at #EMNLP2026. D3-Gym has received a lot of interest from startups that aim to create scientific tasks and environments to train agents for scientific discovery. I particularly like that my students choose to stay with me rather than quitting Ph.D. to make big money! ;-)

AgentCL (led by @YihengShu) was selected for a Runner-up Paper Award at the #NeurIPS2026 Workshop on Towards Test-Time Continual Learning Agents (TTCL)! Check out our attempt to rigorously evaluate continual learning in language agents.

Congratulations to all co-authors and collaborators!

See our original posts for details:

View quoted post on X

Nature Astronomy @NatureAstronomy · Aug 19

Gold-medal performance by LLMs at the International Olympiad on Astronomy and Astrophysics dlvr.it/TV4tcM ☄️

View quoted post on X

Ziyu Yao @ZiyuYao · Jul 13

Honored to receive the NSF CAREER Award on the topic of "Towards Scalable and Actionable Interpretability of Language Models for Code Generation"! Thank you to @NSF for this recognition and all the support ever since my PhD study, and to my students, collaborators, colleagues, advisors/mentors, and everyone else who has helped me and inspired me in my career!

This idea is a convergence of my research topics started during PhD study at @osunlp (code generation) and after I joined @GMUCompSci (interpretability). The terms "scalability" and "actionability" are widely discussed in the interpretability community today. I'm excited to continue exploring these topics in the coming years!

Finally, special thanks to my students; the award belongs to you as well:
- @DakingRai on interpretability
- @yue_murong21307, @aghzalm, and @salokr_deep on LLMs and LLM agents
- Hao Yan on code generation

(Pictures taken when we celebrated Saurabh's graduation in a lovely Mexican restaurant)

View quoted post on X

Yu Su Verified account @ysu_nlp · Jun 17

We trained a ~frontier Deep Research Agent on academic budget

> 32 H100s
> 8K synthetic samples
> fully open training infra + recipe (SFT, mid-training, RL)
> models of diff sizes (2B -> 35B) ready to use out of the box

This is yet another demonstration of how the frontier of AI is changing. We have reached a point where open models + a small capable team + a few hundred Ks can produce specialized models with ~frontier capabilities. The future of AI doesn’t have to be held in a chokehold by a handful of closed models.

We've open-sourced everything we've built and learned from this project. Hope it helps the community build more!

📌 Project: osu-nlp-group.github.io/QUEST
📌 Paper: arxiv.org/abs/2605.24218
📌 Code: github.com/OSU-NLP-Group/…
📌 Model Weights and Data: huggingface.co/collections/os…
📌 Demo: huggingface.co/spaces/osunlp/…

Amazing effort led by @jianxie_ (our 1st year student!!), Tianhe Lin, Zilu Wang. joint with @hhsun1 and the @osunlp team. thanks @amazon Xiangjun Wang for a gift that covers the compute and fruitful discussion.

View quoted post on X