Twitxy Saved

Zhuo Zhang

Verified account This account is verified. Learn more

@i2huer

Assistant Professor @ColumbiaCompSci

πŸ‘‰ Binary Analysis πŸ±β€πŸ’» βž• Web3 πŸ¦‡πŸ”Š
πŸ‘‰ Building sre-bench.lol ❄️
πŸ‘‰ Other: tiny-dec, EDB, Web3Bugs
New York, NY zzhang.xyz Joined March 2017
482 Following 2.9K Followers 500 Posts

Latest posts 5

Zhuo Zhang Verified account @i2huer
We have new results for many frontier open-weight models on reverse engineering!

Plot 1 uses rescaled axes for clarity; Plot 2 shows the original scale.

More details: sre-bench.lol/leaderboard

Lots to unpack 🫣! Hope these results help you choose the right models for @reatools!
Zhuo Zhang Verified account @i2huer Oct 14
1/ As someone who have worked on reverse engineering for 10+ years, I've never seen this much excitement around it. Great work, @morluto and @reatools!

Since RE is having such a moment πŸ”₯, I figured I'd share some updates from sre-bench.lol to help you pick the right model.
View quoted post on X
Zhuo Zhang Verified account @i2huer
Oh, shoot. I forget to mention sre-bench.lol is our reverse engineering benchmark πŸ˜‚
sre-bench.lol SRE-Bench SRE-Bench is a realistic, contamination-free benchmark for agentic reverse engineering, hosted by Columbia University.
Zhuo Zhang Verified account @i2huer Oct 14
1/ As someone who have worked on reverse engineering for 10+ years, I've never seen this much excitement around it. Great work, @morluto and @reatools!

Since RE is having such a moment πŸ”₯, I figured I'd share some updates from sre-bench.lol to help you pick the right model.
View quoted post on X
Zhuo Zhang Verified account @i2huer
πŸš€ What if you could vibe-code ANY existing app, even without its source code?
Zhuo Zhang Verified account @i2huer Oct 12
🎬 Check out our demo! We added brand-new AI functionality directly (and reliably!) to Apple's Preview app, without any source code!

Just Astra Max modifying the existing app in under 20 min, using less than 10% of the weekly token allowance on a $200 subscription!

We've released a proof-of-concept skill repository to help agents directly modify existing applications:

πŸ”— github.com/Pasta-Lab/edit…

And I think this points to something MUCH bigger.

I've never seen reverse engineering become such a hot topic in the past 10 years! πŸ”₯ But with AI agents becoming incredibly capable at understanding binaries, I think it's time to ask a bigger question:

What is the future of reverse engineering?

Here's our answer: Omniform Software Engineering (OmniSE).

Over the past few months, following our SRE-Bench work, my research group has been exploring this new direction.

SRE-Bench showed how capable AI agents have become at understanding and reverse-engineering binaries.

But why should we stop at understanding software? Why not let agents directly develop on top of it?

That's the vision behind OmniSE: Software engineering should no longer have to start with source code. It should be possible to start with software in ANY form! Whether you have source code, compiled binaries, or an existing application, you should be able to directly customize and extend it.

Think about a simple scenario.

You love an app, but wish it had one additional feature.

Traditionally, you have to wait for the original developers to implement it.

Today, with increasingly powerful AI agents, you might instead reverse-engineer and rebuild the entire application.

But think about how many tokens it would take to recreate something as mature as Apple Preview! Even worse, rebuilding everything can easily miss subtle but critical functionality. You don't want to spend your time repeatedly fixing an app that already worked perfectly well!

But why rebuild an entire application just to add ONE feature?

With OmniSE, you can bring your AI agent directly to the existing app. Let it understand the software, modify what is needed, and preserve the rest.

This is what excites me most:

Reverse engineering is no longer just a cybersecurity capability. It is becoming a fundamental software development capability that everyone can use and benefit from.

And I believe this is much more than a new task for AI agents. It could represent an entirely new paradigm of software engineering.

Imagine a future where you don't have to adapt yourself to the software you use. Instead, your AI agent adapts the software to YOU.

Every app could become your own customized app.

That's the future of software we want to build. πŸš€ #rea #reverseengineeering #openai #codex #deepmind

@ColumbiaCompSci @Columbia @DAP__Lab
View quoted post on X