Twitxy Saved

Matt Killen

@mattkillen42

ÜT: 38.763792,-93.736711 Joined July 2009
1.5K Following 190 Followers 1.9K Posts

Latest posts 5

Matt Killen @mattkillen42
Agentic evals 🤝 behavioral analytics
Spenser Skates Verified account @spenserskates Sep 1
Today we're launching Agent Analytics

Every team shipping an AI agent has the same blind spot. Offline evals pass, you ship, and then you have no idea what's happening in production. AI fails silently. Users ask a question and get different answers. They all look 'engaged' in a classic dashboard. You don't know who got a great response and who got a terrible one.

Agent Analytics solves it:
- Every session scored out of the box on task completion, response quality, friction, safety, and negative feedback
- Topic clustering across thousands of conversations, so you know if a failure hits 1 user or 10,000
- Eval agents that watch for regressions, and if you want will file a Linear ticket or the pull request themselves
- Agent quality sits next to product data, so 'payment scheduling fails 31%' becomes 'which renewals did that cost us?'

The Economist got their agent to a 96.9% task success rate and cut weekly failures 84%.

Included on every plan. Free tier included. amplitude.com/agent-analytics
View quoted post on X
Matt Killen @mattkillen42
As someone that has spent TOO much time building reports over the years, today’s @Amplitude_HQ announcement feels truly ground breaking. Proud to be a part of the future of analytics
Spenser Skates Verified account @spenserskates Feb 17
Al has collapsed the time it takes to ship a feature. Now it's all about shipping the right thing. It's just as hard as it ever was.

As coding gets automated, agentic analytics becomes the bottleneck. Teams that win will build within context rich environments that capture user behavior and customer feedback, making that data accessible to both builders and agents.

Today @Amplitude_HQ is launching our Al Analytics Platform with Agents and MCP. Autonomous analytics that helps builders and coding agents ship products that their customers actually want.

Just as our partner @claudeai has reinvented software, Amplitude is reinventing analytics for the Al age.

We have achieved 76% accuracy for complex production grade queries and agentic usage has grown 10x in 3 months.

Don't just build fast, build what's right.

Try it for free, today.
View quoted post on X
Matt Killen @mattkillen42
The once and future king!
🚨🎙NEW EPISODE🎙🚨

EPISODE 57: Benvenuto Mateo

☑️ SERIE A HIT MATEO RETEGUI
☑️ PRESEASON MATCHES VENEZIA LOSS & MONACO NEXT
☑️ LIPANI STAY OR LEAVE

🎧Apple
🎧Spotify
🎧Spreaker

🔎 Search “La Lanterna Podcast” on podcasts partners (also Podchaser, Podcast Addict, Google, etc)
View quoted post on X