hammad 🔍

Last year at @tryramp I laid out three predictions for how language models would evolve. I was trying to clarify which bets might actually be durable over time.

A lot of it is now starting to take shape.

Here’s an update. Thread 👇

one should always be weary of situations where one is given responsibility without authority

Life update: after a wonderful few years at @trychroma I’ve decided to step away. I owe so much to the wonderful team I got to build and work with there.

From the core database that served petabytes of data for customers, to our work on context rot, to research on models like context-1 - our small team always punched above its weight and it was a joy to be a part of.

Up next: I’ve joined @OpenAI to work on search and pretraining research (and the lost art of manually reading code 😄). It’s still so early and I am optimistic about the future ahead.

Onwards!

training runs in 2030 be like
brb putting on my hazmat suit to go into the westus-max-security datacenter which is in a faraday cage and thermally controlled at a resolution of 1 inch to prevent low-bit rate communnication

There is a natural social pressure in organizations against questioning the premise.

Questioning the premise is quite demanding, didn't someone smart already think about this?

For this reason, questioning the premise is the highest leverage activity one can often do.