Twitxy
Saved
@sidsheth's profile picture
View on X

Sid Sheth

Verified account This account is verified. Learn more

@sidsheth

Founder CEO @dmatrix_ai | AI and Cloud | Entrepreneur | Enjoy going from zero to one | Striving Yogi
Los Altos Hills, CA d-matrix.ai Joined April 2009
296 Following 406 Followers 120 Posts

Latest posts 5

Pinned post

Sid Sheth Verified account @sidsheth
Big news: @dMatrix_AI is partnering with @nvidia.

Our next-gen Raptor XPUs with our path-breaking 3D DRAM stacked memory will plug directly into NVIDIA MGX rack-scale systems via NVIDIA NVLink Fusion — delivering ultra-low latency inference for premium token services.

Inference is an infinite opportunity, and it will demand a diversity of compute. Customers will be able to run a Raptor rack standalone, or alongside NVIDIA GPUs — matching the best compute to each phase of the workload.

Grateful to @JensenHuang and the NVIDIA team for building an open ecosystem that makes this possible. Let's go build the future!

🔗 d-matrix.ai/announcements/…
2 replies 6 reposts 56 likes 21K views View on X
Sid Sheth Verified account @sidsheth
A big week for d-Matrix at #OCP.

Corsair rackscale is now generally available — air-cooled, industry-standard, ready for existing data centers. Grateful to @Supermicro for building alongside us.

We introduced Squadron, our multi-rack clusters scaling to 1,000+ Corsair XPUs.

And we ran the industry’s first public demo of Attention-FFN Disaggregation: one NVIDIA H100 + 8 Corsair XPUs hitting 845 tokens/sec/user.

All credit to the d-Matrix team and our partners.

The future is memory-centric inference compute — here today.

🔗 d-matrix.ai/announcements/…
0 replies 1 reposts 10 likes 784 views View on X
Sid Sheth Verified account @sidsheth
Many more to come @dMatrix_AI team
@dMatrix Verified account @dMatrix_AI Oct 6
We’ve been named one of @FastCompany’s 2026 Next Big Things in Tech in the Foundational AI category.

Our Corsair™ AI inference platform and memory-centric architecture are redefining AI inference — delivering up to 10x faster interactive inference and up to 3x better energy efficiency for LLM workloads, without relying on scarce HBM.

Proud of the d-Matrix team.

Read more: fastcompany.com/next-big-thing…

#FCTechAwards #AIInference #dMatrix
View quoted post on X
Sid Sheth Verified account @sidsheth
Discontinuous innovation w/ our next gen ultra low-latency inference accelerator platform.

Today at Hot Chips Symposium, d-Matrix co-founder and CTO Sudeep Bhoja and Aayush Ankit with Meta took the stage to present a deep dive into the architecture behind the path breaking Raptor inference accelerator, the first chip to use a 3D DRAM stacked approach for ultra low-latency agentic inference.

With 3D-DRAM stacked silicon back in our labs (picture attached), the solution leverages an already proven high-volume CoW packaging technology with an alternate supply chain that is unconstrained by HBM.

More here @ 🔗 ServeTheHome: servethehome.com/d-matrix-rapto…
Sid Sheth Verified account @sidsheth
A new way of doing things. Different types of compute working together to augment user experience. New world beckons. #bettertogether
Techmeme Verified account @Techmeme Jul 8
Nvidia and AI chip startup d-Matrix are combining their hardware in a new system to power AI models, the latest example of Nvidia partnering with rivals (@_pheebini / The Information)

(Visit Techmeme dot com for the link and full context!)
View quoted post on X