Twitxy Saved

Hyunjong Ok

Verified account This account is verified. Learn more

@HyunjongOk

Google PhD Fellow | PhD Student at POSTECH
hj-ok.github.io Joined November 2023
61 Following 73 Followers 20 Posts

Latest posts 3

Pinned post

Hyunjong Ok Verified account @HyunjongOk
๐Ÿš€ Stop using Transformers for weight-space programming

If you are not training with gradients on a GPU, why default to a Transformer?

When an LLM writes network weights directly, letting it also design the architecture achieves:

๐Ÿ“‰ ~1,800ร— fewer parameters at matched accuracy on ARC (AI2 Reasoning Challenge), compared to the best Transformer the same LLM wrote.

โšก Up to 17ร— faster GPU inference with a memory architecture built for these tables, compared to a Transformer of the same size.

๐Ÿงต Paper & code at the end ๐Ÿ‘‡
15 replies 37 reposts 265 likes 21K views View on X
Hyunjong Ok Verified account @HyunjongOk
๐ŸŽ‰ Iโ€™ve been selected as a 2026 Google PhD Fellow in Natural Language Processing!

My research focuses on understanding and evaluating language and multimodal models through diagnostic benchmarks and efficient evaluation methods.

Iโ€™m grateful to my advisor, @jaeho_lee_, for his guidance and support, and to my collaborators for the discussions and ideas that have shaped my research.

hj-ok.github.io
Google.org @Googleorg 5d
Every leap in technology starts with a researcher asking a bold question.

Meet the 2026 Google PhD fellows: 148 new fellows from 38 countries, advancing breakthrough research for the public good, supported by $13 million from @Googleorg: goo.gle/phd-fellows-20โ€ฆ
View quoted post on X
0 replies 0 reposts 20 likes 4.9K views View on X