Atsuki Yamaguchi

@_gucciiiii

Research Fellow & Final-year PhD candidate @SheffieldNLP. Previously NLP researcher at @hitachi. Views are my own. #NLProc

Sheffield, England gucci-j.github.io/about Joined March 2019

456 Following 505 Followers 523 Posts

Latest posts 5

Pinned post

Atsuki Yamaguchi @_gucciiiii Oct 1

A last piece of my PhD work is out!
arxiv.org/abs/2609.39827

We ask whether "pre-pretraining" (PPT) (i.e., training on synthetic non-natural language data briefly prior to pre-training on natural language data) helps at scale.

This is the largest ever PPT study! (1/5)

Prior work sits at or below 1B parameters and short training horizons. We span four scales, four PT mixtures, five PPT tasks, and up to 100B PT tokens to test the effectiveness of PPT in a more realistic setting.

PPT is claimed to induce structural priors that transfer to natural language grammar.

Atsuki Yamaguchi @_gucciiiii Oct 22

I'm attending EMNLP in person next week. If you are around, let's have a chat!

Sheffield NLP @SheffieldNLP Oct 22

With #EMNLP2026 just around the corner, a reminder of the EMNLP papers from Sheffield NLP!

If you're attending, do check out our papers and say hi to the authors! Looking forward to seeing everyone at EMNLP!

View quoted post on X

Atsuki Yamaguchi @_gucciiiii Oct 15

Emails sent to support@aclrollingreview.org are often quite rude. Before pressing send, please keep in mind that ARR is run mostly by volunteers. PLEASE TREAT US WITH RESPECT!

#ARR @ReviewAcl

Atsuki Yamaguchi @_gucciiiii Sep 29

We have just implemented a self-assessment checker for this and now deployed at aclrollingreview.org/qualifications.

View quoted post on X

Atsuki Yamaguchi @_gucciiiii Oct 12

Happy to see that my service was recognised as a "Top Reviewer" at NeurIPS this year!

Atsuki Yamaguchi @_gucciiiii Oct 7

Delighted that our paper received an Outstanding Paper Award at COLM 2026! 🏆

Though I couldn't make it to SF, stop by our oral at 3:30 PM and poster session at 4:30 PM today, presented by @joelniklaus!

@COLM_conf

Conference on Language Modeling @COLM_conf Oct 6

Congratulations to the authors of the 3 outstanding papers!

arxiv.org/abs/2607.01077
arxiv.org/abs/2604.08510
arxiv.org/abs/2604.13977

View quoted post on X