Baseten

Inference, training, routing, governance, and sandboxes are the building blocks of every AI product today.

We’ve learned a lot from our customers about what it takes to build that system well: @OpenEvidence trains models that outperform the closed frontier, then serves them on Dedicated Inference. @datadoghq post-trains on Loops. @Opendoor routes every AI request across the company through Grid.

This week we have three launches expanding our inference platform:

- Grid: gateway, intelligent router, and guardrails for every model your company uses (launching tomorrow)

- Sandboxes: stateful, VM-isolated environments for agents that scale to thousands of instances in seconds (launching Thursday)

- Loops: serverless SFT and RL on open-weight models, deployable straight to Dedicated Inference (GA Friday)

@amiruci, @saimaddali, @paul_s3i, and @oneill_c break down what we're launching. You might notice the visuals have a new look as well.

Baseten Loops is now GA, and serverless.

Teams at @AmbienceAI, @datadoghq, and @LangChain use the Loops SDK for SFT and RL training to build durable intelligence.

Serverless Loops includes:
- Always-warm infra that eliminates cold starts
- Pay-per-token pricing for training and sampling
- One-click deployment from your trained checkpoint to production inference
- Model-specific numerical validation, with a focus on reducing mismatch between training and sampling

You bring the data, reward functions, and training logic.
We handle the infrastructure.
You always own the weights.

Learn more: baseten.co/blog/introduci…

What's next for LLM research? @chrmanning, Professor of Machine Learning at Stanford, is joining us at All-Gather to break down the history and future of the field.

Chris has spent decades shaping NLP at Stanford, from GloVe to CS224N, the course that taught a generation of researchers how language models work.

baseten.co/all-gather

Today we're introducing Baseten Sandboxes: stateful, secure environments for agents.

Sandboxes boot from standby in milliseconds and scale to 1,000s of instances in seconds. When an agent disconnects, its filesystem, memory, and running processes are snapshotted, and compute scales to zero. On resume, it picks up right where it left off.

Run your agents on the same platform that serves, trains, and routes your models. To make today's announcement a little extra special, we're making Sandboxes free to run until November 16.

Check it out: docs.baseten.co/sandboxes/over…