PostHog

We ran the numbers on a full year's worth of PostHog AI prompts (3,670,000 of them).

Here's some of our most amusing findings on how people interact with AI, illustrated with charts:

Power. Wisdom. Courage. And Nintendo Wii.

We spend 2 trillion+ LLM tokens a month. That’s way too much money spent to trust our agents based on gut feeling.

So, we started using custom benchmarks.

We ran into plenty of problems, from parallel runs to open-ended tasks. Here’s everything we learned along the way: