@DevinAI
Introducing Devin Review 2.0: the best way to review PRs with Devin.
Now up to 5× cheaper, 1.5× faster, and with new features and integrations.View quoted post on X
Introducing FrontierCode 2.0: our new coding benchmark that measures a model’s ability to go beyond the spec.
Most coding evals measure a model’s ability to write code that meets a spec. With FrontierCode 1.0, we asked a new question: would you actually merge the PR?
FrontierCode 2.0 is comprised of more diverse tasks, featuring larger scopes and higher mergeability standards. We are now asking: not only would you merge this PR, but should you?
One key feature of FrontierCode 2.0 is underspecified prompts. Rather than including every engineering decision, prompts are deliberately ambiguous, giving the models room to demonstrate their judgment.
The result is a benchmark that is far from saturated, with the top model scoring just 45%.View quoted post on X
We are entering a new dark age of cybersecurity. Devin is here to help.
Introducing the new Devin Security: powered by Claude Mythos and frontier cyber models, plus hundreds of millions of dollars of credits to help teams find, prioritize, and fix urgent vulnerabilities.View quoted post on X
Today we're introducing a refreshed Devin Desktop app, with an agent command center designed to be smoother and more polished than ever before.View quoted post on X
We’ve open sourced an agent plugin that helps secure systems against recent cybersecurity threats.View quoted post on X
You can install them with any agent or use them in Devin today:
devin.ai/blog/vulnerabi…
