Pinned post
I spent 20,000 dollars in API credits having different AI models play each other at Blood on the Clocktower (a Mafia or Werewolf type social deception game).
The results were fascinating. Models have gotten much better over the course of this year at creative on-the-spot scheming and bluffing, and also at reasoning as a team to break apart these underground conspiracies.
I go through some of the most standout games these AIs played in this video. The new models are getting pretty good. If my friends pulled off some of these moves while we were playing, I’d give them a fist bump.
Fwiw, OpenAI’s newer models are much better than Anthropic’s at this game.
You can see the full benchmark at the website, and I’ve also made it so that you and your friends can play again the AIs: clocktowerbench.comView quoted post on X
We built the vuln scanner we wanted to use but couldn't find.
Introducing Vuln Scans in Detail!
It uses the same abliterated models attackers are using to create havoc across the internet right now.
Under the hood we are:
- Spinning up your dev environment in a sandbox
- Throwing an enormous amount of abliterated model tokens at trying to hack your code
- Cross-checking your supply chain with cve/.now from Sazabi, to find any supply chain vulns that are exploitable in your app
This is all happening within a cloud dev environment. We will not hack your prod system.
The abliterated models are scary good. We're finding nasty issues in every repo we scan. We've found 13k vulns so far, and the majority are already fixed.
We see the current moment as an all-hands-on-deck situation. Agent swarms are stringing together minor-seeming vulns across different apps to hack systems in new and unexpected ways. We all need to find and patch an enormous number of vulns, fast, or the internet is in trouble.
You don't even have to be a target to get hacked right now. Your entire product might be a stepping stone in an attack aimed somewhere else.
We can remediate findings for you (i.e. send you PRs that fix the vulns), or you can consume them via your agent of choice, or in your ticket tracker of choice.
If you need help or advice on getting your system secure fast, please get in touch. We have helped teams of all sizes adapt to the current moment. DM me.
We're delivering these scans at-cost, because it's all-hands-on-deck. We hope you'll get one today.View quoted post on X
Something feels a bit iffy about California prop 38.
Doing a popular vote proposed by a 3 person non-profit that gives said non profit $4.2B from the public!
I hope Gary is great and knows how to spend $4.2B well because it’s done.View quoted post on X
Our security researchers built an autonomous cyber vulnerability discovery, exploitation, and patching pipeline.
In a single run with an upcoming cyber model, it validated and generated patches for 948 local privilege escalation vulnerabilities in the Linux kernel at a total API cost of $1.2 million.View quoted post on X
