Twitxy Saved

Ash Vardanian

Verified account This account is verified. Learn more

@ashvardanian

Founder @unum_cloud · General Partner @aal_vc · working on USearch, UStore, StringZilla, NumKong & other open-source AI infra since 2015
London, San Francisco, Yerevan ashvardanian.com Joined June 2012
470 Following 3.5K Followers 2K Posts

Latest posts 5

Pinned post

Ash Vardanian Verified account @ashvardanian
The hardware moved on. Most software didn't!

So I spent 3 years and 2 months since the USearch v2 release rebuilding mine. The v3 release candidate is now public - not a stable release yet, but open for anyone to try - and it didn't come alone:

UStore v1 - a multi-modal GPU-accelerated transactional DBMS engine.
UCall v1 - the fastest take I know on secure client-server networking.
UForm v4 - work in progress on drastically more efficient multi-modal AI training pipelines.

All of this now lives on the main branches, as release candidates rather than tagged releases. It is by far the largest body of open-source work I have ever shared at once, and it pulls in the now-public release candidates of the libraries underneath:

NumKong v8 - one of the largest & most opinionated mixed-precision numerics libraries.
StringZilla v6 - with even more Unicode optimizations and GPU kernels.
ForkUnion v4 - with better UX for low-latency parallelism.
SmashTable v1 - reinventing associative containers again 🤦

It's far from complete or fully stable. I also didn't write all of this alone - AI models have helped massively. A few years ago I was afraid it would take drastically more resources to get even to this point, especially given how often I hate the results of my last month's work and redesign everything from scratch for the tenth time, always taking longer than I anticipated.

The attached 10-minute stuck-in-elevator pitch covers the most important new ideas across these projects. The slightly more detailed, but still brief, 2.5-hour lecture is online: youtu.be/IkGetbrEuws

Code is live on GitHub: github.com/unum-cloud

And most importantly for developers in 2026 - your AI agents can now read all of the docs on a fully redesigned website: unum.cloud/llms.txt
11:02
8 replies 4 reposts 36 likes 1.8K views View on X
Ash Vardanian Verified account @ashvardanian
Most of my nights in 2026 look like this:

Plan overnight work for a swarm of Fables
Micromanage until 3am, fueled by ~2L of coffee/day
Fall asleep completely exhausted
Wake up 6h later. Agents crashed at 4am 🤦‍♂️
In that 1h, they landed 100 commits across 8 repos
Every single one against the projects' design goals
Scream, swear, soft-reset everything
Back to micromanaging...

And to think I used to manage actual humans 😆
6 replies 0 reposts 22 likes 1.7K views View on X
Ash Vardanian Verified account @ashvardanian
Clang over GCC, CMake over all else. At least for now.

The hardest part of my last release, 1.2M lines across 8 repos, was multi-versioning: NVIDIA Hopper and Blackwell kernels living next to AMD CDNA4 and CDNA5, and AVX-512 next to SVE, in one build, picked at runtime. Iterating on that with 4,000+ kernels per platform was too slow, so I distilled it into a toy repo:

github.com/ashvardanian/F…

If you ship hardware-tuned code, it's a small, readable template for:
- one Python wheel with per-capability CPU kernels and both mono- & multi-versioned NVIDIA and AMD GPU code in one binary
- branchless dispatch tables, and GPU support asked of the driver, not guessed with a downstream project example reusing the kernels without shipping a single unused GPU kernel
- comparatively lightweight Docker images that validate all of it on machines with none of that hardware: SDE for AVX-512 and AMX, QEMU for SVE and SME, CUDA and ROCm compilers

CMake still scares me, but nothing else probes compilers and machines at this level of portability, and LLMs made maintaining it far easier.
github.com GitHub - ashvardanian/FatWheels: Starter kit for fat Python wheels: CPU kernels multi-versioned for... Starter kit for fat Python wheels: CPU kernels multi-versioned for AVX2, SVE & RVV, plus CUDA & ROCm kernels from one source, validated under QEMU, with reusable Clang, QEMU, GenMC,...
2 replies 1 reposts 17 likes 914 views View on X
Ash Vardanian Verified account @ashvardanian
This doesn't even begin to describe
how insanely cool USearch v3 is...

Designed for 1B+, 10B+, 100B+ scales,
it also fixes the v2's weakest modes of operation.

~100K QPS over ~100M bit-vectors
on a single outdated CPU at 99%+ recall.