Twitxy Saved

Yann Viegas

@_Yann77

🐈 pretraining @MistralAI | pure maths & cs @ENS_ULM | problem setter / half retired competitive programmer
Paris, France Joined December 2016
342 Following 366 Followers 2.1K Posts

Latest posts 5

Yann Viegas @_Yann77
Still waiting for a useful deep learning theory result to be proven by AI !

Why I think it didn't happen yet: it's incredibly tricky to design a toy model simple enough to be tractable yet complex enough to capture what happens at scale.We don't even have much human data on this
Deedy Verified account @deedydas 5h
Holy shit. Levent Alpöge from Anthropic just claimed Claude has resolved the General Reimann Hypothesis!!!

Proof is 250,000+ pages long. Lean is released.

GRH is the 2nd of 6 Millenium prizes solved by AI, after Navier-Stokes. This may be the biggest AI math result of all time.
View quoted post on X
Yann Viegas @_Yann77
Shivam Duggal Verified account @ShivamDuggal4 2d
Language models process each token through a single residual stream (blue arrows): reading / writing memory and applying MLPs at each layer, and finally decoding the next token.

Can we scale up this single stream computation?

Introducing Latent Lattice Language Models (LLLMs): augmenting this vertical stream with a horizontal axis of computation—the Lattice of Latents (orange arrows).

RNN 🤝 Transformers 🧵
View quoted post on X