Local AI Alex

NVIDIA's own tooling clusters up to 4 DGX Sparks on a switch. I've designed for 8: 1 TB unified memory, a 200G RDMA fabric, and four cluster modes switched in software. 100% local inference for two businesses. 18 drawings below. Tell me what you'd change.

I claimed the “ai__alex” handle on @ThePirateFace 🏴‍☠️

Where open weight models never die, and are immortalized as torrents.

You'll need one too, for what comes next. Claim yours ↓
pirateface.co/claim?ref=ai__…

Everybody who cares about local AI needs to the following right now:

1. Purchase large, inexpensive (>20TB) external drives.
2. Ask an LLM for a Python script to auto-download Hugging Face model collections fitting those drives.
3. Unplug and store the drives for later use.

Do this right now; do this today!

After the hf takedown, head to pirate face to upload and seed.

This is now an urgent matter & we need enough ppl need to act immediately.

Local AI Influencers: please tweet similar advice to your audiences. @thepirateface @LLMSherpa

And so begins the third chapter:

-- Jensen's Revenge!!!

Can a ~A$26,000 Mac Studio M5 Ultra (512GB) really beat an A$120,000+ 8x NVIDIA RTX PRO 6000 rig at running giant LLMs? 🤔

Recent Qwen 3.8 Flash Next benchmarks show the M5 Ultra hitting 125.8 tok/s vs 122.3 tok/s on 8x RTX Pro 6000s.

Wait... how?! Here is what's going on 🧵👇