Twitxy Saved

TornadoVM

@tornadovm

Official #TornadoVM - JIT Compiler & Runtime system for running JVM applications on heterogeneous hardware
Manchester, UK tornadovm.org Joined June 2020
24 Following 553 Followers 536 Posts

Latest posts 5

TornadoVM @tornadovm
TornadoVM has a new family member! #jitLLM provides blazing fast AI inference at native speed⚡️👇
jitLLM @jitllm Sep 30
Can Java compete with llama.cpp/@ollama? YES! With @jitLLM!

jitLLM uses @nvidia CUDA libraries (cuBLAS, cuDNN) and reaches 0.90× to 1.12× of llama.cpp's throughput!

jitLLM is empowered by @tornadovm and will be soon in @langchain4j and @QuarkusIO.

github.com/beehive-lab/ji…
View quoted post on X