Luminal
Verified account This account is verified because it's an official organization on X. Learn more@luminal_ai
The fastest and cheapest inference in the world. We're hiring.
10 Following 1.5K Followers 99 Posts
Latest posts 5
We've raised a $25M Series A led by @Standard_Cap to accelerate heterogeneous inference.
We're serving a lot of tokens.
In the past few months we've gone through explosive growth. In the coming days we'll be talking about how we handle such rapid growth.
In the past few months we've gone through explosive growth. In the coming days we'll be talking about how we handle such rapid growth.
Luminal is a proud hiring partner of @3blue1brown for their 3B1B talent program!
Grant Sanderson (the man behind the YT channel) interviews and selects each company personally for the program with an emphasis on deeply technical problems and teams with a strong culture.
It鈥檚 an honor to be recognized by a channel that so many of us learned an incredible amount from. Visit our hiring page below 猬囷笍
Grant Sanderson (the man behind the YT channel) interviews and selects each company personally for the program with an emphasis on deeply technical problems and teams with a strong culture.
It鈥檚 an honor to be recognized by a channel that so many of us learned an incredible amount from. Visit our hiring page below 猬囷笍
How much does a token cost?
Speculative decoding has a massive impact on token prices. In this post we dive in to the tradeoffs made with different speculative decoding setups applied to the most popular LLMs.
Speculative decoding has a massive impact on token prices. In this post we dive in to the tradeoffs made with different speculative decoding setups applied to the most popular LLMs.