Twitxy Saved

Valentin Hofmann

@vjhofmann

valentinhofmann.github.io Joined February 2020
292 Following 1.6K Followers 416 Posts

Latest posts 5

Pinned post

Valentin Hofmann @vjhofmann
💥 New paper 💥

We discover a form of covert racism in LLMs that is triggered by dialect features alone, with massive harms for affected groups.

For example, GPT-4 is more likely to suggest that defendants be sentenced to death when they speak African American English.

🧵
72 replies 497 reposts 1.5K likes 485K views View on X
Valentin Hofmann @vjhofmann
Interesting analysis. Nearly 6% of US Claude chats touch on politics, but almost none ask for explicit voting advice. Instead, they have quite diverse goals.

Clear support for the importance of *ecologically valid* political bias benchmarks, like @paul_rottger's IssueBench!
Andy Hall Verified account @ahall_research Oct 14
Today we're sharing some initial data on how Americans use Claude for politics, based on aggregated conversation data analyzed with differentially private methods. A couple interesting takeaways:

*Almost no one asks AI how they should vote*

About ~5.75% of conversations in the US touch on some kind of political or social issue in a recent one-week period, and less than 0.01% of conversations involve asking how to vote.

*Political conversations have many goals*

These conversations have wide-ranging goals, everything from research and writing assistance to learning, fact-checking, and arguing.

We are continuing to make progress on improving how Claude talks about these topics---steadily increasing our performance on our even-handedness evals and partnering with a range of outside organizations to develop new measures of political bias---and I hope that sharing information about the shape of these conversations will help people outside the company evaluate AI's political bias, accuracy, and other criteria in ecologically valid ways. I'd love to discuss this with people who are interested, as it was a huge priority for me before joining.

This was a big joint effort as part of our work preparing for the midterm elections @AnthropicAI.

Full post is here: anthropic.com/news/2026-us-m…
View quoted post on X
Valentin Hofmann @vjhofmann
Thrilled to share that our work on LLM byteification is out in @Nature today! 🎉

Byteification lets existing LLMs gain the strengths of byte-level models without training from scratch.

Huge kudos to lead author @bminixhofer, who did most of this in a three-month internship! 🤯
Ai2 Verified account @allen_ai Oct 7
Our paper on retrofitting language models to operate over bytes – the approach behind Bolmo – has been accepted to Nature! 🎉

We’re also releasing new checkpoints that extend our method from Olmo to Qwen & Llama. 🧵

nature.com/articles/s4158…
View quoted post on X