Twitxy Saved

Vinoth Kumar

Verified account This account is verified. Learn more

@vinothsparrow

Director of Engineering at Refold AI, AI/Security
vinoth.blog Joined July 2011
3.7K Following 6.4K Followers 436 Posts

Latest posts 5

Pinned post

Vinoth Kumar Verified account @vinothsparrow
I built an operating system where the AI agent IS the process.

No Linux. No POSIX. A tiny LLM runs on bare metal in Rust — and a capability ABI means it can plan anything, but only do what it was granted.

It boots, browses the web, plays video, and talks. 🧵
4:51
7 replies 0 reposts 6 likes 1.1K views View on X
Vinoth Kumar Verified account @vinothsparrow
🤯🤯
Alexander Whedon Verified account @alex_whedon May 5
Introducing SubQ - a major breakthrough in LLM intelligence.

It is the first model built on a fully sub-quadratic sparse-attention architecture (SSA),

And the first frontier model with a 12 million token context window which is:

- 52x faster than FlashAttention at 1MM tokens
- Less than 5% the cost of Opus

Transformer-based LLMs waste compute by processing every possible relationship between words (standard attention).

Only a small fraction actually matter.

@subquadratic finds and focuses only on the ones that do.

That's nearly 1,000x less compute and a new way for LLMs to scale.
View quoted post on X