Sharing my wife's breaking news startup: didfionapoopyet.com
Lukas Bergstrom
@lukasb
AI Evals & Benchmarks @ Zapier
1.8K Following 1.6K Followers 3.5K Posts
Latest posts 5
Great to see! Having another SOTA lineage benefits everyone. Have been looking forward to showing the new AutomationBench leaderboard with Gemini in the top 5 spots: zapier.com/benchmarks
Introducing Gemini 4 Neon! Pushing the frontier across domains and punching above its model class in a meaningful way. To me, Neon feels like the right balance of intelligence, speed, and usability. Available now across @GoogleAIStudio, the API, and more!View quoted post on X
Detroit changed the world youtube.com/watch?v=KNz01t…
Rest in Power Juan AtkinsView quoted post on X
Everyone's asleep, post the counter-narrative.
There’s more in the post, but even the footnote is bangerView quoted post on X
Had fun! Even though we chewed through my prepared questions in the first twenty minutes 😅
One thing I realized today is that innovation and model improvement isn't something that just comes out of the labs, it's a collaboration across labs, people building benchmarks, users...
One thing I realized today is that innovation and model improvement isn't something that just comes out of the labs, it's a collaboration across labs, people building benchmarks, users...
@zapier, one of our Bench Summit partners, led a panel discussion on the realities of managing highly influential evaluation signals.View quoted post on X
The panel, moderated by Lukas Bergstrom (@lukasb), included insights from Robin Salimans (@SalimansRobin) of Zapier, Greg Kamradt (@GregKamradt) of ARC Prize Foundation, and Shaiyon Hariri of Ramp.
Attendees heard about what defines a successful benchmark, the challenges of maintaining adoption, and critical lessons learned from V1 to V2+.