Jacky Kwok

Introducing Contrastive Language Model (CLM): an ultra-fast System One Model trained with a contrastive learning objective that connects states and actions.

CLM-8B is pre-trained on internet-scale data and delivers up to 9× faster inference than Jev ⚡ while achieving comparable performance across computer-use, gaming, and tool-calling tasks.

With lightweight fine-tuning, CLM-8B sets a new SOTA on challenging agentic coding benchmarks, such as DeepSWE (81.6%) and Terminal-Bench 2.1 (87.6%). In contrast, Jev fails to serve as an effective verifier for these long-horizon tasks.

We also build an efficient training and serving infra for CLMs by disaggregating states and actions, allowing their embeddings to be cached and reused independently. This substantially reduces inference latency in settings where the state evolves continuously while the action set remains fixed.

Finally, we establish scaling laws for CLMs and show that the test contrastive loss decreases predictably as a power law in training compute, model size, and dataset size.

📄 Blog: contrastive-lm.notion.site
💻 Code: github.com/Contrastive-LM…
🗣️ Discord: discord.gg/5dAQEDJBs
🤗 Data & Models: huggingface.co/Contrastive-LM

More details on CLM’s architecture, data recipe, and scaling laws in the thread below 🧵

Scaling self-verification with Inkling-2-Small and LLM-as-a-Verifier can substantially improve the aesthetic quality of generated 3D scenes 🏙️

The self-verification capability of Inkling is amazing! A blog post with @thinkymachines on RL for creative tasks will be released soon :)

Really impressive model from the @RicursiveAI team!

Happy to share RSI-top: a framework that helps autonomous research agents escape exploration collapse 📈

RSI-top outperforms OpenEvolve and ShinkaEvolve by up to 15% on kernel optimization tasks and achieves a 77.3% medal rate on MLE-Bench Lite.

We developed metrics for retrieving useful past trajectories and proposed 3 diversity control mechanisms that encourage new ideas, perspectives, and starting points when progress stalls.

📄 Blog: rsi-top.github.io

Work led by @Mao_Yuzhen, with incredible collaborators @talaei_shayan and @Azaliamirh

Contrastive Language Model is part of Slingshots // FOUR! Huge thanks to @LaudeInstitute for supporting our work 🙌

Excited to keep building and growing the open-source community around CLM :)