Pinned post
Emmy Liu
@_emliu
PhD student @LTIatCMU, working with @gneubig on NLP || intern @AIatMeta @GoogleDeepMind || from 馃嚚馃嚘 || on the job market
597 Following 3.3K Followers 478 Posts
Latest posts 5
indeed, as an aspiring "LLM raiser" there are a lot of issues to consider! Some behaviours that appear later in training may also be encouraged by earlier stages but be invisible until later...
Raising LLMs well as good kids is @_emliu 鈥榮 thesis direction! Her work already shows LLMs learn stuff in a consistent order for pretraining. Exploring and controlling this across the training stack would be really cool!View quoted post on X
It was great to speak with you at COLM! 馃 Looking forward to the full episode release as well (Besides this paper, I also talk a bit about my experience in the PhD and what tools I use for research!)
Congrats to @_emliu @KaiserWhoLearns @millicent_li @wordscompute @lltjuatja @JentseHuang @gneubig on winning the #COLM2026 Outstanding Paper Award!
#SOTATV just interviewed @_emliu @COLM_conf on 饾悡饾悺饾悶 饾悎饾惁饾惄饾惀饾悽饾悳饾悽饾惌 饾悅饾惍饾惈饾惈饾悽饾悳饾惍饾惀饾惍饾惁 饾悋饾惒饾惄饾惃饾惌饾悺饾悶饾惉饾悽饾惉. language models pick up skills in the curriculum: copying, then word forms, logic, translation, arithmetic, composite tasks last.
Emmy also shared why she gives 2/10 for ICLR workshop paper written by AI, and her secrete sauce on getting 100K GPU hours compute.
More on 饾悞饾悗饾悡饾悁 饾悡饾悤 interview, coming soon.View quoted post on X
Honoured to receive an outstanding paper award for our work! Couldn鈥檛 have done it without all my coauthors @KaiserWhoLearns @millicent_li @wordscompute @lltjuatja @JentseHuang and my advisor @gneubig 馃
Congratulations to the authors of the 3 outstanding papers!
arxiv.org/abs/2607.01077
arxiv.org/abs/2604.08510
arxiv.org/abs/2604.13977View quoted post on X
Excited to head to #COLM2026 to present the Implicit Curriculum Hypothesis and separately, the HalluWorld benchmark at the @SnorkelAI Frontier Data Summit!
I鈥檓 also on the academic/industry job markets.
Happy to chat about pretraining, midtraining, and training dynamics
馃У
I鈥檓 also on the academic/industry job markets.
Happy to chat about pretraining, midtraining, and training dynamics
馃У