Pinned post
0:05
Latest posts 5
"semantic" is the word i probably use the most in my job
And here is @zml_ai with CUDA running natively on Windows with a RTX 4090 via PCIe passthrough.
(recording over VNC)
(recording over VNC)
1:00
and here is @zml_ai running Llama 3.2 1B *fully natively on @Windows* (CPU for now, it's a demo).
little nugget: it was entirely cross compiled from macOS using @hermeticbuild's LLVMView quoted post on X
our greatest release ever!
Announcing the release of zml/llmd 20261112.0. This week, we are bringing DSpine, more speculative decoding options, faster DeepSeek prefill, Apple M1 and M2 support, more control over sampling.View quoted post on X
And of course, lots of bugfixes!
zml.ai/posts/llmd-202…
Can someone get us access to Ascend 950 ?