Martin Wattenberg

Visualize transformer attention!

AttentionViz, created by Catherine Yeh and expanded by Yida Chen, helps you explore transformer self-attention by visualizing query and key vectors in a joint embedding.

Paper: arxiv.org/abs/2305.03210
Website: attentionviz.com

Toasters have blinking lights, cars have speedometers. Should chatbots have dashboards too?

A speculative essay: The System Model and the User Model: Exploring AI Dashboard Design
arxiv.org/abs/2305.02469

Starting to get used to Mastodon. Find me at @wattenberg@mastodon.social

Thinking about grad school next year? Interested in visualization, machine learning interpretability, or human/AI interaction? Consider Harvard. @viegasf and I are continuing to build our lab!

I'm teaching with @OpenProcessing for the first time, and am completely impressed with how polished and friendly the system is. Every detail is on point. Last class a student spontaneously said, "OpenProcessing is just so great." I agree!