Ibrahim Alabdulmohsin | إبراهيم العبدالمحسن

How is next-token prediction capable of such intelligent behavior? I’m very excited to share our work, where we study the fractal structure of language. TLDR: thinking of next-token prediction in language as “word statistics” is a big oversimplification!
arxiv.org/abs/2402.01825

Is synthetic language as complex as human language? We compared their fractal structures, and the results aren't what you'd expect! Join me & @AndreasPSteiner at #icml2025 to see why.
🗓️ Tue, Jul 15, 4:30pm PDT
📍 EE Hall A-B # E-2704
📜 arxiv.org/abs/2502.14924
A sneak peak 👇

🔥Excited to introduce RINS - a technique that boosts model performance by recursively applying early layers during inference without increasing model size or training compute flops! Not only does it significantly improve LMs, but also multimodal systems like SigLIP.
(1/N)

If you are interested in developing large-scale, multimodal datasets & benchmarks, and advancing AI through data-centric research, check out this great opportunity. Our team is hiring!

Attending #NeurIPS2024? If you're interested in multimodal systems, building inclusive & culturally aware models, and how fractals relate to LLMs, we've 3 posters for you. I look forward to presenting them on behalf of our GDM team @ Zurich & collaborators. Details below (1/4)