Twitxy Saved

dippo

Verified account This account is verified. Learn more

@0xdippo

Researching local AI. Building, testing, and benchmarking models on hardware you can actually own. Recipes + receipts.
Pensacola, FL majorminor.xyz Joined September 2022
459 Following 4.6K Followers 2.1K Posts

Latest posts 5

Pinned post

dippo Verified account @0xdippo
The Echo was an easy win, but it’s limited because can't look around, and you're stuck inside whatever Amazon hardware allows.

So I'm building a Hermes robot from scratch.

A head that pans and tilts lets it actually look around the room, which gives visual memory something to work with. I'll run Hermes on it, but it should work with any agent.

Goal: a home robot assistant you can build for $300 to $500.

I'll post updates as I go.

@NousResearch
dippo Verified account @0xdippo Nov 5
My old Echo Dot run Hermes now, instead of Alexa.

I built a Home Assistant integration that connects it to a Hermes profile, with its memory and tools.

Code, setup skill and the hardware recovery notes are public.

github.com/majorminorlabs… @NousResearch
View quoted post on X
14 replies 3 reposts 69 likes 4K views View on X
dippo Verified account @0xdippo
For anyone sizing a machine for this, on the 3090 it ran at 47% to 70% of Edge0's published 4090 numbers. Chat decode held up 48.6 vs 69.9, and 16K prefill was 1,481.2 vs 3,179.4.

I didn't get to the 32 GiB RAM cap test. If you've got a 3090 and 32 to 64 GB of RAM, I'd love to see your numbers.
dippo Verified account @0xdippo 20h
A month ago I got a 122B MoE running on one 3090 at 15.5 tok/s and thought that was decent.

Today @Edge0_AI’s Edge0-145B did 48.6 tok/s on a 3090. Bigger model, about 3x the speed.
Not quite the same, but interesting.

The engine process sat at 43.4 GiB resident, and VRAM was at 23,929 of 24,576 MiB. Edge0's own residency number is 31.28 GiB, from a 5090 D.
View quoted post on X
dippo Verified account @0xdippo
A month ago I got a 122B MoE running on one 3090 at 15.5 tok/s and thought that was decent.

Today @Edge0_AI’s Edge0-145B did 48.6 tok/s on a 3090. Bigger model, about 3x the speed.
Not quite the same, but interesting.

The engine process sat at 43.4 GiB resident, and VRAM was at 23,929 of 24,576 MiB. Edge0's own residency number is 31.28 GiB, from a 5090 D.
dippo Verified account @0xdippo
The hacker news thread about "why buy a pi when you have an old phone" was exactly how I felt about the echo

That’s not going to work for a robot though. Pan and tilt means servos + GPIO and the echo doesn't have it.

Definitely a lot more work, but it'll be the better option.