Twitxy Saved

Luminal

Verified account This account is verified because it's an official organization on X. Learn more

@luminal_ai

The fastest and cheapest inference in the world. We're hiring.
San Francisco, CA luminal.com/careers Joined May 2023
10 Following 1.5K Followers 99 Posts

Latest posts 5

Luminal Verified account @luminal_ai
Luminal is a proud hiring partner of @3blue1brown for their 3B1B talent program!

Grant Sanderson (the man behind the YT channel) interviews and selects each company personally for the program with an emphasis on deeply technical problems and teams with a strong culture.

It鈥檚 an honor to be recognized by a channel that so many of us learned an incredible amount from. Visit our hiring page below 猬囷笍
12 replies 8 reposts 74 likes 3.2K views View on X
Luminal Verified account @luminal_ai
How much does a token cost?

Speculative decoding has a massive impact on token prices. In this post we dive in to the tradeoffs made with different speculative decoding setups applied to the most popular LLMs.