Twitxy Saved

Robin Jia

@robinomial

Assistant Professor @CSatUSC | Previously Visiting Researcher @facebookai | Stanford CS PhD @StanfordNLP
Los Angeles, CA robinjia.github.io Joined June 2018
969 Following 5K Followers 390 Posts

Latest posts 5

Robin Jia @robinomial
Heading to ICML where I’ll be presenting 3 papers on differentially private synthetic data, mech interp/ML theory for TFs solving graph problems, & mech interp for LLM negation processing, and giving a talk on the legacy of adversarial evaluation at the EMM-QA workshop!
5 replies 4 reposts 46 likes 3.6K views View on X
Robin Jia @robinomial
Being Johnny’s PhD advisor has not only been a great privilege, but it has forever changed my research vision. His work combining AI, law, and statistics opened my eyes to how technical research can guide policy and promote AI accountability. Excited for his next work as Dr. Wei!
Hi all, I defended my PhD thesis. My thesis in two sentences:

Current AI measurement takes LLMs as fixed objects, which constrains us to observational measurement. *Spiking* the training data (inserting certain data at known rates), enables statistically principled measurement.
View quoted post on X
Robin Jia @robinomial
Hubble is finally out! We used 200k GPU hours from @NSF NAIRR and @nvidia to build a comprehensive resource for the scientific study of LLM memorization. Fully open-source models & data up to 8B params + 500B tokens with controlled data insertion to study memorization risks 🔭✨
Announcing 🔭✨Hubble, a suite of open-source LLMs to advance the study of memorization!

Pretrained models up to 8B params, with controlled insertion of texts (e.g., book passages, biographies, test sets, and more!) designed to emulate key memorization risks 🧵
View quoted post on X