Twitxy Saved

Emily Cheng @ ICML

@sparse_emcheng

PhD @colt_upf in computational linguistics

What is the happiest state? Maryland 💅🏼

Before: Apple MLR, MIT CSAIL, ENS
chengemily1.github.io Joined April 2022
192 Following 219 Followers 109 Posts

Latest posts 5

Emily Cheng @ ICML @sparse_emcheng
UniReps submission deadline October 4th AOE! Please share
UniReps Verified account @unireps Sep 4
📣 Call for Papers: UniReps Workshop in Paris!

We invite work exploring why, when, and how distinct learning processes yield similar representations across AI, neuroscience & cognitive science.

📅 Deadline: Oct 4 (AoE)

🔗 unireps.org/2026/call-for-…
View quoted post on X
0 replies 4 reposts 12 likes 929 views View on X
Emily Cheng @ ICML @sparse_emcheng
Presenting this @icmlconf with @NeuroRJ & @_avaidya✨

Why do 𝙢𝙞𝙙𝙙𝙡𝙚 layers in LLMs and speech-audio models best predict brain responses to language?

We show a peak in the dimensionality of🤖activations (left) to track high🧠predictivity (right)

🧵
We know that middle layers from LLMs best predict brain responses to natural language. But why? In our new short paper (arxiv.org/abs/2409.05771), we show that this prediction performance closely aligns with a peak in the ✨intrinsic dimensionality✨of the LLM's layers. (1/6)
View quoted post on X
2 replies 6 reposts 41 likes 10K views View on X
Emily Cheng @ ICML @sparse_emcheng
We'll be presenting this at #ACL2025 ! Come find me and @tomjiralerspong in Vienna :)
New paper! 🌟How does LM representational geometry encode compositional complexity?

A: it depends on how we define compositionality!

We distinguish compositionality of form vs. meaning, and show LMs encode form complexity linearly and meaning complexity nonlinearly...

1/9
View quoted post on X