Twitxy Saved

Liangzu Peng

@PengLiangzu

PhD Student at UPenn.
Philadelphia, PA liangzu.github.io Joined April 2022
362 Following 228 Followers 70 Posts

Latest posts 5

Liangzu Peng @PengLiangzu
🫡🫡
James Whittington Verified account @jcrwhittington Nov 2
Today we are happy to share one of our first open research releases: Latent Sparse Attention (LSA), a step towards subquadratic attention that matches accuracy of full attention at ultra-long context.

Sparse attention attends to only a few tokens per query, but it has to find the right ones. At 10M tokens, that search takes 98% of the attention layer's time. LSA makes sparse attention up to 22.7× faster and full attention 72.4x faster.

With @kubicek_ales @caciolai @PengLiangzu @SukritSumant @Ben_Hoov @FraserGreenlee @RMBattleday @radim_urban @thoefler @jcrwhittington
View quoted post on X
1 replies 4 reposts 12 likes 717 views View on X
Liangzu Peng @PengLiangzu
A great opportunity to share your thoughts on continual learning, or more generally, non-stationary learning!
CoLLAs 2026 Verified account @CoLLAs_Conf Mar 14, 2025
📢 Call for Tutorials – #CoLLAs2025 📢

We’re inviting proposals for 2-hour tutorials on topics in continual learning, non-stationary learning, LLM adaptation, neuroscience-inspired learning, and more! 🧠📚

🔹 Submission deadline: April 15, 2025 (AoE)

Have a topic suggestion? Email us at tutorials@lifelong-ml.cc!

🔗 Learn more: lifelong-ml.cc

#MachineLearning #ContinualLearning #LifelongLearning #AI #CallForTutorials
View quoted post on X