Pinned post
Most things that cause me anxiety are coordination problems.
Fred Oliveira 🧠
Verified account This account is verified. Learn more@f
working towards better AI futures. AI safety at @snyksec. Organizing @lisbonai_. Prev: @capitalfactory @gumroad @techcrunch @oreillymedia
947 Following 134K Followers 16K Posts
Latest posts 5
"and then eat them, as a treat"
good prompt "find all of the implicit state machines in my app"View quoted post on X
this is great, and now I want to add a human in the loop to see how we fare.
I spent 20,000 dollars in API credits having different AI models play each other at Blood on the Clocktower (a Mafia or Werewolf type social deception game).
The results were fascinating. Models have gotten much better over the course of this year at creative on-the-spot scheming and bluffing, and also at reasoning as a team to break apart these underground conspiracies.
I go through some of the most standout games these AIs played in this video. The new models are getting pretty good. If my friends pulled off some of these moves while we were playing, I’d give them a fist bump.
Fwiw, OpenAI’s newer models are much better than Anthropic’s at this game.
You can see the full benchmark at the website, and I’ve also made it so that you and your friends can play again the AIs: clocktowerbench.comView quoted post on X
recommended reading from a good friend who really cares about engineering as a craft. Hit the link 👇
Spending time online would have you believe there is a fork in the road of software engineering… We either embrace the slop or micromanage the slop.View quoted post on X
I say we put on our “engineer hat” and carve out a better road. We mold the slop.
nonsense.io/blog/mold-the-…
Agents resend the whole context on every call, often dozens of times per request. If you change one token near the top, you pay full price for everything under it.
Context layout is a cost decision. I wrote up a few months of harness design research. Highlights below 🧵
Context layout is a cost decision. I wrote up a few months of harness design research. Highlights below 🧵
