Minds and machines!
1/ Introducing PhilosophyBench from @StanfordAILab @StanfordHCI, the first independent, large-scale benchmark for evaluating AI’s philosophical capabilities.
philosophybench.orgView quoted post on X
Michael Bernstein
@msbernst
@stanford Professor of Computer Science, @simile_ai co-founder, nationally bestselling author. I build interactive, social, and societal tech.
1.9K Following 19K Followers 824 Posts
Latest posts 5
In which the lecturer gives a lecture:
What does it take to build an AI model that can accurately simulate human behavior?
You need to understand both what people do and why they do it.
On Sept 24, @msbernst is taking us under the hood of behavioral simulation. We’ll explore why neither behavioral data nor surveys and interviews are enough on their own, what each reveals about human behavior, and how Simile brings them together to model what people might do next.
RSVP here simile.zoom.us/webinar/regist…View quoted post on X
I describe AI behavioral simulation as a “what-if” machine. I wrote about what a What-If Machine is, and how it works, at @simile_ai:
Most big decisions are some version of a “what-if” question.View quoted post on X
What if we launched this? What if we raised the price? What if we didn’t?
At Simile, we’re building a What-If Machine to simulate those decisions before making them for real. But getting the answer right requires understanding both what people do and why they do it.
@msbernst explains what it takes to build one.
simile.com/blog/what-if-m…
Behavioral simulation requires confidence estimation. I'm 100% fine asking the system to simulate unlikely situations if it can signal lower confidence, so long as I can also get high confidence simulations and calibrate my trust.
Simile trains a simulation model. Also, we train another model that predicts the error of the simulation model (the “confidence model”). Tucked away in a secret dungeon below Mission Bay, we also have a “confidence confidence model” that predicts the error of the confidence model, but this one is saddled with a certain sinister statistical spirit that must be contained at all costs! To contain San Francisco’s crisis of confidence, Members of Technical Staff across the valley must come together and read Simile’s confidence blog post today!View quoted post on X
