Pinned post
DeepSpeed
Verified account This account is verified. Learn more@DeepSpeedAI
Official account for DeepSpeed, a library that enables unprecedented scale and speed for deep learning training + inference.
日本語 : @DeepSpeedAI_JP
日本語 : @DeepSpeedAI_JP
93 Following 4.2K Followers 123 Posts
Latest posts 5
Come and listening to all the exciting updates from @DeepSpeedAI and talk to our awesome @PKUWZP
🎤 Meet keynote speaker Zhipeng Wang (@PKUWZP), Senior Staff Software Engineer at @Google and DeepSpeed maintainer. bit.ly/4iVl3mo
At #PyTorchCon North America, he’ll share advances helping DeepSpeed train large models efficiently across diverse hardware.
October 20-21 | San Jose
Register:
bit.ly/4sh3DSwView quoted post on X
Reminder of DeepSpeed Office Hours
DeepSpeed Office Hours: Tue Aug 25, 12pm ETView quoted post on X
v0.19.3–0.19.5:
• Grad accum for custom & serverless (Tinker)
• AutoEP+AutoTP folding & ZeRO-3 TP inference
• Hybrid Engine for on-policy distillation
• Pinned-memory CPU/NVMe offload speedups
Join: zoom-lfx.platform.linuxfoundation.org/meeting/939025…
DeepSpeed Office Hours: Tue Aug 25, 12pm ET
v0.19.3–0.19.5:
• Grad accum for custom & serverless (Tinker)
• AutoEP+AutoTP folding & ZeRO-3 TP inference
• Hybrid Engine for on-policy distillation
• Pinned-memory CPU/NVMe offload speedups
Join: zoom-lfx.platform.linuxfoundation.org/meeting/939025…
v0.19.3–0.19.5:
• Grad accum for custom & serverless (Tinker)
• AutoEP+AutoTP folding & ZeRO-3 TP inference
• Hybrid Engine for on-policy distillation
• Pinned-memory CPU/NVMe offload speedups
Join: zoom-lfx.platform.linuxfoundation.org/meeting/939025…