Twitxy Saved

Kosseila (CloudDude) โ˜๏ธ๐Ÿ“ก๐Ÿ‰

@CloudDude_

Founder @cloud_thrill | Speaker | MultiCloud AI Infra | Beatmaker

๐ŸŽ™Podcast: bit.ly/Techbeats
earth cloudthrill.ca Joined February 2020
630 Following 456 Followers 2.3K Posts

Latest posts 5

Pinned post

Kosseila (CloudDude) โ˜๏ธ๐Ÿ“ก๐Ÿ‰ @CloudDude_
Hosted one of Silicon Valleyโ€™s brightest AI infrastructure founders, @JunchenJiang (CEO of @tensormesh ). Watch the full episode๐Ÿ‘‡๐Ÿผ
Tech Beats Unplugged @TechBeatsShow Jul 15
๐ŸŽ™๏ธNew episode #TechBeatsShow
Fresh off @tensormesh 's $20M funding announcement, we sat down with CEO & Co-Founder @JunchenJiang to talk about the journey behind @lmcache, KV cache, and the future of AI inference.

๐ŸŽฅ Watch the full interview๐Ÿ‘‡: open.spotify.com/episode/4u5USZโ€ฆ
View quoted post on X
Kosseila (CloudDude) โ˜๏ธ๐Ÿ“ก๐Ÿ‰ @CloudDude_
"Why would I deceive you?..."
Fireside Alpha Verified account @firesidealpha 3d
Nvidia interim CEO Colette Kress says the board has determined it will not reinstate Jensen Huang

โ€œJensen resigned from his position with NVIDIA, and the board accepted his resignation.โ€

โ€œThe board has determined that they will not reinstate Jensen. And that is our statement and what the board has decided to do.โ€

โ€œWe wanna think about right now growing our business. We wanna grow in terms of everything that we need to do with our employees, our customers, our shareholders, and that is where we are gonna focus moving forward.โ€
View quoted post on X
Kosseila (CloudDude) โ˜๏ธ๐Ÿ“ก๐Ÿ‰ @CloudDude_
๐Ÿ™‚ My first article as Lead FDE at @tensormesh , on CacheBlend: a feature Iโ€™ve worked with for months. The ๐—ป๐—ผ๐—ป-๐—ฝ๐—ฟ๐—ฒ๐—ณ๐—ถ๐˜… ๐—ฐ๐—ฎ๐—ฐ๐—ต๐—ถ๐—ป๐—ด that can save you $Millions ...
Tensormesh Verified account @tensormesh Nov 10
Prefix caching stops at the first change in your prompt. RAG and agents reorder the same docs on every call.

๐‚๐š๐œ๐ก๐ž๐๐ฅ๐ž๐ง๐ reuses KV cache anywhere in the prompt:
- 2.6x more traffic, same GPUs
- Up to 2.9x faster TTFT
- ~$2.7M/yr saved on 256 GPUs
na2.hubs.ly/H08VHzK0 @CloudDude_
View quoted post on X
Kosseila (CloudDude) โ˜๏ธ๐Ÿ“ก๐Ÿ‰ @CloudDude_
Very excited to be speaking at the ๐˜ƒ๐—Ÿ๐—Ÿ๐—  ๐— ๐—ฒ๐—ฒ๐˜๐˜‚๐—ฝ ๐—ง๐—ผ๐—ฟ๐—ผ๐—ป๐˜๐—ผ Thursday at @cohere office๐Ÿ™‚
Iโ€™ll be doing a ๐˜ƒ๐—Ÿ๐—Ÿ๐— -๐—ข๐—บ๐—ป๐—ถ๐ŸŽจwalkthrough, the multimodal inference stack, and sharing the stage with other #vLLM contributors.
See you Thursday๐Ÿ‘‹
@inferact @vllm_project @rogerw0108
Cohere Verified account @cohere Oct 2
Open doors for open weights ๐Ÿš€

@vLLM and Cohere are co-hosting a meetup in Toronto to discuss how we're contributing and pushing the future of open source.

Plus, hear from a lead maintainer of vLLM on where vLLM is heading next and from @NVIDIAAI engineers on agentic debugging. Connect with our teams and learn something along the way ๐Ÿง 
View quoted post on X