Twitxy Saved

Hadi Vafaii

@hadivafaii

Postdoc @UCBerkeley @Redwood_Neuro | ๐Ÿง +๐Ÿค– | ๐ŸŽน | ๐ŸŽพ |
Berkeley, CA mysterioustune.com Joined April 2022
158 Following 1.5K Followers 442 Posts

Latest posts 5

Pinned post

Hadi Vafaii @hadivafaii
Elegant theoretical derivations are exclusive to physics. Right?? Wrong!

In a new preprint, we:
โœ…"Derive" a spiking recurrent network from variational principles
โœ…Show it does amazing things like out-of-distribution generalization
๐Ÿ‘‰[1/n]๐Ÿงต

w/ co-lead @dekelgalor & Jake Yates
5 replies 84 reposts 647 likes 97K views View on X
Hadi Vafaii @hadivafaii
LLMs have shown us that sand can think. But how? We need powerful methods to interpret their mind.

โšซ๏ธ Introducing BeFOND, an encoder-free iterative sparse coding model.

โšซ๏ธ BeFOND has closed-form inference and learning rules, both unified as natural gradient flow on free energy.

โšซ๏ธ At 524k width, BeFOND matches Gemma Scope's single-feature probing accuracy with over 1000x fewer samples (~6M vs 8B SAE-training tokens).

โšซ๏ธ BeFOND keeps improving with SAE width, while alternatives plateau.

โšซ๏ธ Importantly, we provide theory to explain WHY BeFOND works so well. Read on! ๐Ÿ‘‰๐Ÿงต[1/17]

Work with my amazing co-lead @tejasraoai
3 replies 9 reposts 74 likes 8.1K views View on X
Hadi Vafaii @hadivafaii
> "impending sense of doom and despair"

To meโ€”and many people I knowโ€”it's the opposite: An invigorating sense of urgency and thrill.

Slide from a talk I gave recently ๐Ÿ‘‡
Boring_Business Verified account @BoringBiz_ Sep 20
Once you watch Claude or some other LLM do a task that used to take you 3 hours in the span of just 3 minutes, all work starts to lose its purpose

Have been hearing the same sentiment from many of my friends in middle management across tech, finance and other office jobs

All the years of experience you culminated at your field suddenly seems useless

You used to feel valued for your expertise in a niche domain, but that knowledge has now become commoditized

You begin to wonder how many more months until upper management and executives realize that they donโ€™t need to pay your salary anymore

Maybe they can replace you fully. Maybe they can hire someone for 50% of the cost to do the same task with an AI

It is the impending sense of doom and despair. The loss of purpose from your lifeโ€™s work disappearing losing value in front of your eyes

Truly an incredible time to be alive
View quoted post on X
5 replies 3 reposts 26 likes 1.7K views View on X
Hadi Vafaii @hadivafaii
We have a paper at #ICML2026 today:

๐€ ๐ก๐ข๐ญ๐œ๐ก๐ก๐ข๐ค๐ž๐ซโ€™๐ฌ ๐ ๐ฎ๐ข๐๐ž ๐ญ๐จ ๐๐จ๐ข๐ฌ๐ฌ๐จ๐ง ๐ ๐ซ๐š๐๐ข๐ž๐ง๐ญ ๐ž๐ฌ๐ญ๐ข๐ฆ๐š๐ญ๐ข๐จ๐ง
๐๐จ๐ฌ๐ญ๐ž๐ซ, ๐Ÿ”:๐Ÿ‘๐ŸŽโ€“๐Ÿ–:๐Ÿ๐Ÿ“ ๐๐Œ ๐๐ƒ๐“, ๐‡๐š๐ฅ๐ฅ ๐€ #๐Ÿ”๐ŸŽ๐ŸŽ.

Co-first authored by Michael Ibrahim (2nd-year undergrad) and Hanqi Zhao (MS), co-supervised with Chengrui Li.

We benchmark methods for differentiating through discrete, stochastic Poisson latent variables (a common problem in computational neuroscience).

๐Ÿ“œ Paper: openreview.net/forum?id=T4Ibpโ€ฆ
โŒจ๏ธ Code: github.com/hadivafaii/Poiโ€ฆ