Twitxy Saved

Weinan Sun

@sunw37

NeuroAI @AsteraInstitute
Prev. Asst Prof @Cornell
Joined February 2016
846 Following 893 Followers 918 Posts

Latest posts 5

Pinned post

Weinan Sun @sunw37
Thrilled to finally share this: I've joined @AsteraInstitute's Neuro-AGI team, working with @dileeplearning to build causal, plannable world models inspired by the brain's cognitive maps, and to explore new paradigms for AGI.
After years working across systems neuroscience, theory, and AI at Janelia and Cornell, I'm convinced the shortest path to robust, general intelligence runs through the brain's own solutions. Now I get to test that conviction full-time, with brilliant colleagues (like @jason_z_kim, a wonderfully creative scientist who joined around the same time) and the freedom to go deep.
If you love both brains and machines, we're hiring. Come build with us!
9 replies 4 reposts 98 likes 11K views View on X
Weinan Sun @sunw37
@karpathy I think you will enjoy reading about the hippocampal-neocortical system in neuroscience, a lot of continual learning algorithm hints can be found there. Agree more unconventional research is needed.
Andrej Karpathy Verified account @karpathy Mar 5
There was a nice time where researchers talked about various ideas quite openly on twitter. (before they disappeared into the gold mines :)).

My guess is that you can get quite far even in the current paradigm by introducing a number of memory ops as "tools" and throwing them into the mix in RL. E.g. current compaction and memory implementations are crappy, first, early examples that were somewhat bolted on, but both can be fairly easily generalized and made part of the optimization as just another tool during RL.

That said neither of these is fully satisfying because clearly people are capable of some weight-based updates (my personal suspicion - mostly during sleep). So there should be even more room for more exotic approaches for long-term memory that do change the weights, but exactly - the details are not obvious. This is a lot more exciting, but also more into the realm of research outside of the established prod stack.
View quoted post on X
0 replies 1 reposts 8 likes 1.2K views View on X
Weinan Sun @sunw37
Great opportunity in an amazing team. Highly recommended! @E11BIO @JohanWinn
Johan Winnubst Verified account @JohanWinn Feb 19
🚀 Looking to hire a light-sheet microscopy scientist to help us design, build, and optimize the next-gen platform that will power mammalian connectomics at scale. If you’re excited to join a fast-paced team doing high-impact science, take a look: jobs.lever.co/convergentrese…🔬⚙️
View quoted post on X
Weinan Sun @sunw37
Closed-loop AI scientists will need to talk to lab hardware. Towards that goal, we released Ataraxis - an open-source framework that gives AI coding assistants direct access to physical instruments. Built by our talented Ph.D. student @InkarosEng @CornellNBB @Cornell.

Paper: biorxiv.org/content/10.648…
Code: github.com/Sun-Lab-NBB/at…

Demos videos:

🎥 Pre-session validation: youtu.be/Ui2AEvFkCoE
🎥 Hardware troubleshooting: youtu.be/KBgv4zgwwKw
🎥 AI-guided hardware integration: youtu.be/iemcuTz1_iM