Twitxy Saved

Xingyang Li

Verified account This account is verified. Learn more

@XYLi_Bruce

A Fan of @FCBayern
Cambridge, MA Joined June 2024
120 Following 192 Followers 62 Posts

Latest posts 5

Pinned post

Xingyang Li Verified account @XYLi_Bruce
Great work with @NunchuxAI. Thanks to all collaborators and mentors!
Nunchux AI @NunchuxAI Sep 16
Introducing VC-Attention: fast and accurate low-bit attention without retraining.

On MiniMax-H3, VC-Attention speeds up attention by 1.6× on B200 and 1.5× on B300 over FlashAttention-4, with better fidelity than SageAttention2. It also works with existing sparse attention methods.

Two key innovations:
• V-Smooth reduces value quantization error.
• ExpCast-FP8 speeds up softmax.

Nunchux Attention, our proprietary extension, pushes the speedup to 1.9× on B200 and 1.8× on B300.

Blog: nunchux.ai/blog/attention…
Technical Report: arxiv.org/pdf/2609.15810

Joint work by researchers at MIT, CMU, UC Berkeley, Stanford, and NVIDIA.
View quoted post on X
3 replies 0 reposts 10 likes 829 views View on X
Xingyang Li Verified account @XYLi_Bruce
Agent loops need fast feedback, and LLM quantization doesn't have it: evaluations of reasoning models are slow, and PTQ methods are hard to port and combine.

Meet QDA. A coding agent designs the quantization recipe for each model and precision, with a KL score that takes minutes and a library of 20+ stackable PTQ methods.

📈 Beats the best public recipe on 11 of 12 model-precision pairs: +0.9 / +1.4 / +2.2 pts at W4A16 / W4A8 / W3A16
🔥 GLM-5.3-Flash (320B) at NVFP4: 98.3% of FP8 accuracy, vs 96.9% for NVIDIA's release
💰 Only $19–75 of Claude Code tokens per search
⚡ Runs on stock vLLM, SGLang and llama.cpp, zero inference overhead

Blog, paper, code and checkpoints below 🧵
0:41
34 replies 24 reposts 171 likes 19K views View on X
Xingyang Li Verified account @XYLi_Bruce
The A-Team
Zhuoyang Zhang Verified account @zhuoyang_zhang Nov 13
You’ve seen Astra draw. This time, it’s an open-source 27B reasoning model we trained! RL entirely in simulation. No demonstrations. No agent harness. Native robot use.

I still can‘t believe what we achieved, from an open-source foundation model with almost no native robot use capability to perform well on the real robot. This is really an exciting moment for me as it means a fundamentally different path from existing robot foundation models, directly addressing their biggest limitations.

Robot foundation models have largely relied on learning manipulation from robot data, which is painfully scarce. Robot-use agent inherits the LLM’s native world knowledge and reasoning capability, and we just unleash and put them to work on robot. With robot demonstrations so scarce, being able to draw on that existing intelligence matters enormously. The exceptional instruction following and generalization have been striking to watch. Capabilities we’ve come to expect from LLMs suddenly feel remarkable when they show up in a physical robot.

In our experiments, more compute and more simulation environments keep translating into stronger capabilities. We also see transfer across tasks, across robots, and from simulation to the real world. That makes the direction feel tangible: scalable simulation compute can translate into transferable robot capabilities. There’s something deeply encouraging about seeing a path where investing more resources keeps moving the needle.

We’re sharing our observations and results, and open-sourcing the model, training infrastructure, and deployment stack so everyone can build on them. We’ve also laid out the limitations in detail. Each one points to an open research question, and together they capture much of what we believe are promising directions in the future.

Excited to see what others discover—and build.

Enjoy! mit-han-lab.github.io/pear-blog/
View quoted post on X
Xingyang Li Verified account @XYLi_Bruce
Amazing work!

So fortunate to have watched this grow from a neat observation into a full paper.

Congrats to the whole team!
Yi Pan Verified account @conlesspan Nov 11
Amazing collaboration with @HaochengXiUCB @KanZhu854772 @XYLi_Bruce @BetaGamma20 @MayankMish98 @zhangho72245693 @WilliamXinze @songhan_mit @KurtKeutzer @rishiyer @istoica05 !

Huge thanks to @shulynnliu @yhfchitanda @YichuanM @melissapan for insightful discussions and helpful feedback!

Feel free to check out the paper, code, and demo. We'd love to hear your feedback! 🙌

(7/7)
View quoted post on X
Xingyang Li Verified account @XYLi_Bruce
Sharing a real masterpiece. Congrats to @conlesspan!
Yi Pan Verified account @conlesspan Oct 21
Excited to share our recent work on leveraging TorchDynamo in AI training and inference systems at @UWSyFi with @thepadawang at #PyTorchConf today! ⚡️

We'll show how to use TorchDynamo beyond torch.compile, as a layer to accelerate, compare, and debug ML systems without rewriting the model.

🗓 5:30–5:55 PM PT
🏛 LL21A, San Jose Convention Center
View quoted post on X