learn rl (that good bellman stuff)
Misinterpreting bitter lesson and an incredibly short period when scaling transformers did most of the legwork has reward hacked brains of a whole generation of scientists.View quoted post on X
The more compute you’re pouring in training you’re model, the *more* important it is what algorithm you’re using.
There are algorithms that scale and algorithms that don’t and the only bitter lesson is that a lot of energy was spent on directions that were dead ends in the end. At the same time there are whole dimensions of scaling completely unexplored.
