Twitxy Saved

Junyi Zhang @ CoRL

Verified account This account is verified. Learn more

@junyi42

Ph.D. @Berkeley_AI.
research intern @physical_int.
ex @GoogleDeepMind, @MSFTResearch.
vision, generative model, robotics.
junyi42.com Joined July 2022
581 Following 3K Followers 244 Posts

Latest posts 5

Pinned post

Junyi Zhang @ CoRL Verified account @junyi42
๐—ข๐—ป๐—ฒ ๐—บ๐—ฒ๐—บ๐—ผ๐—ฟ๐˜† ๐—ฐ๐—ฎ๐—ปโ€™๐˜ ๐—ฟ๐˜‚๐—น๐—ฒ ๐˜๐—ต๐—ฒ๐—บ ๐—ฎ๐—น๐—น.

We present ๐—Ÿ๐—ผ๐—š๐—ฒ๐—ฅ, a new ๐—ต๐˜†๐—ฏ๐—ฟ๐—ถ๐—ฑ ๐—บ๐—ฒ๐—บ๐—ผ๐—ฟ๐˜† architecture for long-context geometric reconstruction.

LoGeR enables stable reconstruction over up to ๐Ÿญ๐Ÿฌ๐—ธ ๐—ณ๐—ฟ๐—ฎ๐—บ๐—ฒ๐˜€ / ๐—ธ๐—ถ๐—น๐—ผ๐—บ๐—ฒ๐˜๐—ฒ๐—ฟ ๐˜€๐—ฐ๐—ฎ๐—น๐—ฒ, with ๐—น๐—ถ๐—ป๐—ฒ๐—ฎ๐—ฟ-๐˜๐—ถ๐—บ๐—ฒ ๐˜€๐—ฐ๐—ฎ๐—น๐—ถ๐—ป๐—ด in sequence length, ๐—ณ๐˜‚๐—น๐—น๐˜† ๐—ณ๐—ฒ๐—ฒ๐—ฑ๐—ณ๐—ผ๐—ฟ๐˜„๐—ฎ๐—ฟ๐—ฑ inference, and ๐—ป๐—ผ ๐—ฝ๐—ผ๐˜€๐˜-๐—ผ๐—ฝ๐˜๐—ถ๐—บ๐—ถ๐˜‡๐—ฎ๐˜๐—ถ๐—ผ๐—ป.

Yet it matches or surpasses strong optimization-based pipelines. (1/5)

@GoogleDeepMind @Berkeley_AI
1:20
63 replies 437 reposts 3.4K likes 565K views View on X
Junyi Zhang @ CoRL Verified account @junyi42
We trained an agent with native visual world modeling ability.

It imagines counterfactual outcomes to plan ahead. SFT teaches it to imagine; agentic RL makes it even more adaptable.

Weโ€™ve released everything: agima.net
Jiaxin Ge @ CoRL Verified account @jiaxin_ge_ Oct 23
We trained an imaginative agent! โœจ
Agima: an omni agent that plans by imagining futures.

๐—ฆ๐—™๐—ง: Directly generalizes to harder tasks! ๐Ÿฎ%โ†’๐Ÿฐ๐Ÿฌ%, beats GPT-5.6 Sol (๐Ÿฎ๐Ÿฌ%).
๐—ฅ๐—Ÿ: New ways to imagine emerge! Imagines a second plan only if the first one fails (๐Ÿฏ๐Ÿฎ%โ†’๐Ÿญ๐Ÿฌ๐Ÿฌ%).
View quoted post on X
3 replies 7 reposts 54 likes 4.1K views View on X
Junyi Zhang @ CoRL Verified account @junyi42
"The latent world representation is a program, not a vector"

Finding the right representation to be inverse-graphics is really important. Really cool work!
Haven Feng โœˆ๏ธ CoRL Verified account @HavenFeng Jul 16
Today, weโ€™re introducing [schema]: a harness reaching 99% RHAE with Opus 4.8 + Fable 5 and 95.35% with GPT-5.6 Sol on ARC-AGI-3 Public set.

[schema] makes an LLM think like a physicist. ๐Ÿงต
View quoted post on X
4 replies 3 reposts 50 likes 8.1K views View on X
Junyi Zhang @ CoRL Verified account @junyi42
Children learn from play. Can robots do the same?

We propose ๐๐ฅ๐š๐ฒ๐Ÿ๐ฎ๐ฅ ๐€๐ ๐ž๐ง๐ญ๐ข๐œ ๐‘๐จ๐›๐จ๐ญ ๐‹๐ž๐š๐ซ๐ง๐ข๐ง๐ , a paradigm that gives embodied coding agents a play stage before downstream tasks arrive, and instantiate it with ๐‘๐€๐“๐ฌ (Robotics Agent Teams), where robots discover reusable skills through curious play.

Co-led with @jiaxin_ge_
1:38