Twitxy Saved

Yangruibo (Robin) Ding

@RobinDing3

Assist. Prof. @UCLA. CS Ph.D. @Columbia. Formerly, @GoogleDeepMind, @AmazonScience, @IBMResearch. LLMs, Agents, and Software Engineering.
Los Angeles, CA yrbding.github.io Joined September 2019
458 Following 319 Followers 50 Posts

Latest posts 5

Yangruibo (Robin) Ding @RobinDing3
The #LLM4Code deadline is in two weeks: Nov 13, 2026! Looking forward to your exciting submissions!

CFP and submission portal:
llm4code.github.io
icse2027-llm4code.hotcrp.com

@LingmingZhang @chao_peng_ @saikatdutta2012
llm4code.github.io Home ICSE 2027 Workshop on Large Language Model for Code
Excited to co-organize #LLM4Code @ICSEconf 2027! Consider submitting your cool work to our workshop! Deadline is Nov 13, 2026.
View quoted post on X
Yangruibo (Robin) Ding @RobinDing3
Excited to co-organize #LLM4Code @ICSEconf 2027! Consider submitting your cool work to our workshop! Deadline is Nov 13, 2026.
Saikat Dutta @saikatdutta2012 Oct 14
📣 Announcing the 4th workshop on #LLM4Code, co-located with @ICSEConf 2027 in Dublin, Ireland 🇮🇪!

🎯 We are calling for submissions:

🔗 Website: llm4code.github.io
🌟 Deadlines:
• Submission: Nov 13, 2026 (23:59 AoE)
• Notif.: Dec 11, 2026
• Camera-ready: Jan 29, 2027
View quoted post on X
Yangruibo (Robin) Ding @RobinDing3
Come and check out the story of GPT 6 Astra’s evaluation on SRE-Bench!

It is still shocking to us that how frontier models get improved in cybersecurity analysis (even on binaries!!)

If you are interested, try contributing: sre-bench.lol/contribute
sre-bench.lol Contribute | SRE-Bench How to contribute seed programs, CTF challenges, and anti-analysis tooling to SRE-Bench, and how submissions are reviewed.
Zhuo Zhang Verified account @i2huer Sep 4
1/9 Finally, I can talk about this one.

A few weeks ago, OpenAI told me GPT-6 had basically "cooked" SRE-Bench (our software reverse-engineering benchmark: sre-bench.lol) with a nearly 100% solve rate at pass@4 and ~88% at pass@1; and cheaper!

openai.com/index/gpt-6-as…
View quoted post on X
Yangruibo (Robin) Ding @RobinDing3
Are GPT and Claude already very capable at cybersecurity analysis? Sometimes, yeah, when source code is present.

BUT wait...aren't many cybersecurity-critical software only available in binaries??

Check our new benchmark to challenge frontier agents in reverse engineering!
Zhuo Zhang Verified account @i2huer Aug 14
Something to share: we built a benchmark for evaluating agentic reverse engineering.

- instead of grading intermediate outputs, e.g., recovered types/names

- we evaluate agents e2e on deterministic goals, e.g., JTAG a firmware to enable its debug mode.

vals.ai/benchmarks/rev…
View quoted post on X