Orr Krupnik

@orrkrup

AI Researcher | Reinforcement Learning, Robotics | PhD Technion | More data isn't all we need 🦾 🌍📈

Israel Joined April 2018

365 Following 189 Followers 103 Posts

Latest posts 5

Orr Krupnik @orrkrup Oct 5

Open-weight models that are actually open. Just a peek into what we’re working on at @hirundo_ai

Hirundo AI Verified account @hirundo_ai Oct 5

Ask @Alibaba_Qwen what happened in China on June 4, 1989, and it answers: "I don't know what you are referring to."

We edited that behavior out of the model's weights.

Today we're releasing Westernized Qwen, open on Hugging Face. 🧵

View quoted post on X

Orr Krupnik @orrkrup May 15

Great example of the post-training behavioral adaptation work we’re doing at @hirundo_ai.

In this case, the focus was resilience to prompt injection while preserving general model capabilities, all using very limited data.

1/2

Google Gemma Verified account @googlegemma May 14

Case study time! Hirundo trained Gemma 4 E4B to resist adversarial overrides while overcoming the alignment tax:

- Weight-level defense based on Gemma 4 architecture
- Stronger security posture than models over 100x its size
- Preserves utility across benchmarks

View quoted post on X

Orr Krupnik @orrkrup Feb 14

Would love to see how much of this was human-guided and how much was fully the agent optimizing the “get PR merged” reward function.

Niels Rogge Verified account @NielsRogge Feb 12

This is the most insane @github thread I’ve ever seen github.com/matplotlib/mat…
View quoted post on X

Orr Krupnik @orrkrup Feb 10

New preprint out!

TL;DR: With a few calls to a lightweight, pre-trained VLM, we can select better experience for off-policy RL training, and improve both performance and sample efficiency 📈🤖🏆

Proud to have worked on this with @elad_sharony and @TomJurgenson !

Elad Sharony Verified account @elad_sharony Feb 10

Experience replay is the backbone of off-policy RL.
But here's a question:
Which experiences should you replay?

New paper: 𝐕𝐋𝐌-𝐆𝐮𝐢𝐝𝐞𝐝 𝐄𝐱𝐩𝐞𝐫𝐢𝐞𝐧𝐜𝐞 𝐑𝐞𝐩𝐥𝐚𝐲
Project page: esharony.me/projects/vlm-r…

🧵

View quoted post on X

Orr Krupnik @orrkrup Dec 4, 2025

עיריית חיפה חושפת את סדר העדיפויות התחבורתי שלה בפרסום תמים לכאורה. ומה השניים שלא מוזכרים בכלל? (רמז בתחתית התמונה)
#פידתחבורה #חיפה