Pinned post
🚨🚨🚨
🏎️ LIMCARS — Local Inference Monitor · Cost Analyzer · Recipe Server
Your DGX Spark, finally with a dashboard that tells the truth.
📊 Live dashboard, 2 times per second
• ⚡️ Generation & prefill speed, TTFT & end-to-end latency — with honest sample counts, never percentile theater
• 🧠 KV cache usage, prefix-cache hit rate, speculative-decoding acceptance
• 🖥️ Hardware sidebar: CPU/GPU temps, power, clocks, unified RAM, SSD, network — each with its own sparkline
💰 Real money, not vanity metrics
• 🤑 Token ledgers per session and per model
• 📈 Daily savings chart vs cloud API pricing — see what you didn't pay your cloud API provider
• ⚠️ "Lost potential" alerts — your idle GPU's hourly capacity, priced out in USD
• 🧮 All dollars computed live from editable pricing — never baked into storage
🍳 Recipe server
• 🚀 One-click launch of your LLM engines from saved recipes
• 🔒 Password-gated edits (rate-limited, scrypt-hashed)
🕵️ Hermes Traces
• 🔍 Peek into your Hrmes sessions for agents and subagents, see tool calls, reasoning, chat
🔌 Speaks your engine's dialect
• 🤖 Auto-detects vLLM, SGLang, llama.cpp, EXL3, TandemLLM & more — and reads the right metrics for each
🎨 Made to be lived in
• 🌗 Dark & light themes, 24 palettes for theme and also for charts colors, tinted UI that follows your color
• 📱 Works on your phone via LAN
🕊️ Privacy by construction
• 🏠 One single Python process
• 🧬 Had another dashboard? An AI-agent migration contract (AGENTS.md) brings your history over
🧪 Tested on a single NVIDIA DGX Spark — bring your rig, open an issue, help field-test the rest.
🚀🚀🚀
🏎️ LIMCARS — Local Inference Monitor · Cost Analyzer · Recipe Server
Your DGX Spark, finally with a dashboard that tells the truth.
📊 Live dashboard, 2 times per second
• ⚡️ Generation & prefill speed, TTFT & end-to-end latency — with honest sample counts, never percentile theater
• 🧠 KV cache usage, prefix-cache hit rate, speculative-decoding acceptance
• 🖥️ Hardware sidebar: CPU/GPU temps, power, clocks, unified RAM, SSD, network — each with its own sparkline
💰 Real money, not vanity metrics
• 🤑 Token ledgers per session and per model
• 📈 Daily savings chart vs cloud API pricing — see what you didn't pay your cloud API provider
• ⚠️ "Lost potential" alerts — your idle GPU's hourly capacity, priced out in USD
• 🧮 All dollars computed live from editable pricing — never baked into storage
🍳 Recipe server
• 🚀 One-click launch of your LLM engines from saved recipes
• 🔒 Password-gated edits (rate-limited, scrypt-hashed)
🕵️ Hermes Traces
• 🔍 Peek into your Hrmes sessions for agents and subagents, see tool calls, reasoning, chat
🔌 Speaks your engine's dialect
• 🤖 Auto-detects vLLM, SGLang, llama.cpp, EXL3, TandemLLM & more — and reads the right metrics for each
🎨 Made to be lived in
• 🌗 Dark & light themes, 24 palettes for theme and also for charts colors, tinted UI that follows your color
• 📱 Works on your phone via LAN
🕊️ Privacy by construction
• 🏠 One single Python process
• 🧬 Had another dashboard? An AI-agent migration contract (AGENTS.md) brings your history over
🧪 Tested on a single NVIDIA DGX Spark — bring your rig, open an issue, help field-test the rest.
🚀🚀🚀
