NVIDIA AI Infrastructure

"Vera CPU is an extraordinary CPU beast”

One NVIDIA Vera for a range of agent workloads, no mixing and matching required.

Now in full production and rolling out to leading AI labs.

We developed an agent to help streamline AI factory operations management.

The AI Factory Operations Agent uses specialized agents to detect failures and correlate root causes across hardware, telemetry, Kubernetes, and more, all from one chat interface.

The world’s first co-packaged optics Ethernet switch is in full production.

NVIDIA Spectrum-X Ethernet Photonics brings silicon photonics directly into the switch package for better signal integrity and power efficiency.

The world’s most advanced Ethernet switch.

Dev Community Live: CUDA Rust Meetup x.com/i/broadcasts/2…

Larger models and increasing KV cache is increasing stressing memory resources, but AI efficiency comes from optimizing the full system—not simply increasing memory capacity.

We codesign GPUs, CPUs, networking, storage, and software to get more useful work out of the entire memory and data hierarchy in an AI factory. 🧵