my (brilliant) fiancée is starting to study AI from a moral psychology lens -- and is thinking about better evals for real-world decisionmaking.
If you want to build more/better model evals on topics like this / using good experimental designs, follow/ping!
If you want to build more/better model evals on topics like this / using good experimental designs, follow/ping!
Today, we’re releasing a dataset of >2k LLM conversations with real voters about the 2026 Midterms. We wanted to know how the ~millions of American who use AI models to talk about elections actually prompt them. Our hope is to use this data to build better evals for LLMs, to prepare for a world where most voters use AI to think through election decisions.View quoted post on X
We observe that:
- People mostly want basic information
- Multi-turn chats follow predictable patterns
- Models differ widely in whether they’ll recommend candidates