Tim Dettmers

This account is verified. Learn more

@Tim_Dettmers

Creator of bitsandbytes. Professor @CarnegieMellon and Research Scientist @allen_ai . I blog about deep learning and PhD life at timdettmers.com.

Pittsburgh, PA timdettmers.com/about Joined October 2012

921 Following 50K Followers 4K Posts

Latest posts 5

Pinned post

Tim Dettmers @Tim_Dettmers Jul 30, 2024

After 7 months on the job market, I am happy to announce:
- I joined @allen_ai
- Professor at @CarnegieMellon from Fall 2025
- New bitsandbytes maintainer @Titus_vK

My main focus will be to strengthen open-source for real-world problems and bring the best AI to laptops 🧵

Tim Dettmers @Tim_Dettmers 5d

David Hall @dlwh 5d

It’s done! Marin’s Mochi 535B-A23B finished its main pretraining phase this morning. 18T tokens! Long context this weekend, SFT over the next week or so. Hoping to release checkpoints next week. Some EU paperwork first. mumtracker.exe.xyz/hero-run-535b

View quoted post on X

Tim Dettmers @Tim_Dettmers Oct 20

This is a very big deal. DeepSeeks inference system is on par with OpenAIs stack and better what Anthropic is running (at least for their user size).

DeepSeek Verified account @deepseek_ai Oct 20

🚀 Introducing DeepInfer, our in-house inference framework, now fully open source!

Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable.

🔗 github.com/deepseek-ai/De…

1/4
View quoted post on X

Tim Dettmers @Tim_Dettmers Oct 18

This is really cool work on our synthetic hospital benchmark. For patient diagnosis, this shows that small models + SFT + the right tools > GPT-6 Luna. Interesting is that the tools help small models, but not big models. So gaps in capability can be replaced by tools

tooz Verified account @adarshsolanki Oct 17

spent a few days trying to train a tiny model to diagnose patients on the Synthetic Hospital environment out of CMU.

RL didn't help much, but some SFT and a simple search tool got qwen3-4b to perform as well as a ~1T param model

this is because the agent is more than just the model.

🧵:
View quoted post on X

Tim Dettmers @Tim_Dettmers Sep 25

We built an all-synthetic simulation of a hospital that can be shared publicly without any issues. Our data quality is so high, physicians cannot tell the difference between real/synthetic patients. The data is fully verified -- perfect for RL.

Christine Park Verified account @sparkcpark Sep 25

Introducing Synthetic Hospital: an open, fully synthetic longitudinal EHR benchmark with verifiable ground truth!

1,268 patients, 5,602 encounters, zero PHI. Physicians could not reliably distinguish its charts from real ones.

📄 arxiv.org/abs/2609.30027
💻 github.com/sparkcpark/syn…
✍️ sparkcpark.github.io/posts/finding-…
View quoted post on X