Twitxy Saved

Charles 馃帀 Frye

Verified account Modal

@charles_irl

memer of technical staff at @modal. he/him.

ex @full_stack_dl, @weights_biases (acq. @CoreWeave), phd Berkeley @Redwood_Neuro.
SF // WWW charlesfrye.github.io Joined January 2018
3.3K Following 21K Followers 14K Posts

Latest posts 5

Pinned post

Charles 馃帀 Frye Verified account @charles_irl

Replying to @charles_irl

My new job is to get everyone else to see what I see in Modal:

the future of data-driven computing
powered by open generative models trained at the scale of the web
and adapted to end-user needs by code, customization, and continual improvement.

LFG.

modal.com
modal.com Modal: The platform for production AI Cloud infrastructure for teams that develop, train, and serve AI applications at scale.
20 replies 8 reposts 243 likes 132K views View on X
Charles 馃帀 Frye Verified account @charles_irl
great, now that it's 1.0 I can finally start using it in production
SGLang Verified account @sgl_project 4d
Announcing SGLang v1.0 at SGLang Summit 馃殌
High-performance inference for LLMs and multimodal models, built for production at scale.

v1.0 brings together:
鈰匜aster inference: zero-overhead scheduling, performance-critical paths rewritten in Rust, speculative decoding, and megakernels.
鈰匓etter use of memory: unified memory for hybrid models, plus hierarchical caching to keep long agent histories reusable beyond GPU memory.
鈰匜lexible scaling: prefill/decode disaggregation and flexible parallelism to match your serving setup to your workload.

With adoption across 330+ organizations and day-zero support for 217 models, SGLang has grown through the work of contributors and teams running it in production.

Thank you to everyone building with us. This milestone is yours, too.
Details of the release coming soon.
View quoted post on X