Twitxy Saved

Warp

Verified account This account is verified because it's an official organization on X. Learn more

@warpdotdev

Open infrastructure for building cloud software factories
warp.dev/factories Joined June 2021
2 Following 60K Followers 3.3K Posts

Latest posts 5

Pinned post

Warp Verified account @warpdotdev
Introducing Scorers: Agents that grade your agents.

Use LLM-as-a-judge to grade past coding agent sessions on:

• Quality
• Efficiency
• Compliance
• Or any custom dimension

Scores feed into performance measurements and automatic self-improvement for software factories
6:22
19 replies 14 reposts 207 likes 580K views View on X
Warp Verified account @warpdotdev
If you have 100 agent PRs waiting for your review, this should help you get through them:
Ben Holmes Verified account @BHolmesDev 3d
We built a skill for addressing the code review bottleneck: /merge-risk

This assesses the risk of any PR across 5 criteria: alignment, impact, verification, rollback cost, and error monitoring.

1. Alignment: Does the code follow the issue and PR description, or are there drive-by fixes and unintended side effects?
2. Impact: What is the blast radius of the change, and is it touching sensitive code paths like auth, permissions, or billing?
3. Verification: Is the code well verified, both with test coverage and end-to-end computer use artifacts?
4. Rollback cost: How easily can this be rolled back, and what is the rollback procedure in the case of an incident? Think one-way vs. two-way doors.
5. Error detection: If something goes wrong in production, how much visibility will we have? Are errors swallowed, logged, or reported to an error monitoring service?

You can run it as a PR comment automation, or make it a pre-PR check for the agent to derisk its own work before tagging in a human.
View quoted post on X
2 replies 1 reposts 21 likes 3.4K views View on X
Warp Verified account @warpdotdev
If you're buried under 1000 agent code review requests, read this:
Ben Holmes Verified account @BHolmesDev 4d
Alright, it's time to address the code review bottleneck.

Here's 3 steps worth adding to your agent workflows:
1. Build your own code review loop
2. Verify flows end-to-end with simulated environments
3. Score and mitigate risk with /merge-risk x.com/i/article/2118…
View quoted post on X
5 replies 1 reposts 35 likes 9.2K views View on X