⚡🛡️ Evan Pappas
@Hevalon
🛡️ Ex Technologia Libertas - Έλευθερία διὰ τῆς τέχνης - (Dec/Acc)
4.1K Following 1.4K Followers 6.9K Posts
Latest posts 5
i'm opensourcing my playbooks; up and running automation to have a local RL & inference cluster on a GB10 (DGX Sparks, ASUS Ascent GX10, etc..)
github.com/epappas/gx10-c…
github.com/epappas/gx10-c…
An agent loop that passes every test it has can run seven times slower the moment it shares a cluster, with nothing inside it changed.
open.substack.com/pub/hyperautom…
open.substack.com/pub/hyperautom…
A KV cache hit skips prefill, so it comes back faster than a miss. Roughly 0.6s vs 4.3s on a repeated 10K-token prompt.
Time the response and you learn "has my neighbor prompted this exact text?" No access to their data required.
Time the response and you learn "has my neighbor prompted this exact text?" No access to their data required.