Pinned post
We built the first benchmark for AI capability in marketing. Turns out "use the best model" is a coding answer, not a marketing one.
Kimi K3 (@Kimi_Moonshot) leads at 94.8, at $1.42 a task.
Ox Alpha aka GLM-5.3-Flash from @Zai_org showed up this week and went straight to #2, 89.9 at $0.87. Opus 5 is 11th of 15, at $8.43.
One real Google Ads account, six real marketing tasks, up to 30 runs per model. Every run in its own container on @modal_labs. This is AdsBench (check out adsbench.ai) 🧵👇
Kimi K3 (@Kimi_Moonshot) leads at 94.8, at $1.42 a task.
Ox Alpha aka GLM-5.3-Flash from @Zai_org showed up this week and went straight to #2, 89.9 at $0.87. Opus 5 is 11th of 15, at $8.43.
One real Google Ads account, six real marketing tasks, up to 30 runs per model. Every run in its own container on @modal_labs. This is AdsBench (check out adsbench.ai) 🧵👇
adsbench.ai AdsBench: A Benchmark for Real Digital Marketing Work 15 AI agents, one frozen Google Ads account, six real marketing tasks. See which models get the numbers right and what each one costs per task. 
