Twitxy Saved

MMitchell

Verified account This account is verified. Learn more

@mmitchell_ai

Interdisciplinary researcher focused on shaping AI towards long-term positive goals. ML & Ethics.

Similar content in the Skies (this bird has flown).
m-mitchell.com Joined June 2016
1.5K Following 83K Followers 22K Posts

Latest posts 5

MMitchell Verified account @mmitchell_ai
I appreciate the corrections and community notes on this, but here's the deal: If this doesn't happen as the headline suggests, it soon will. Transformers applied over *weights* instead of *text* would make this possible. The punchline is that...1/
Rikiya Takehi @rikiyatakehi Nov 2
We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math.
It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training.

We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! 🧵
Blog: rikiyat.github.io/blog/weight-sp…
View quoted post on X
8 replies 14 reposts 106 likes 22K views View on X
MMitchell Verified account @mmitchell_ai
The chatbot spells 17 “seveen”. It’s a great example of how (transformers) attention over tokens works. In AI, we get around this via “reasoning”, where letters are used instead of tokens.
matdryhurst Verified account @matdryhurst Nov 3
What not to learn from this : AI models can't spell 17

What to learn from this: he is using a Qwen model with reasoning turned off for conversational speed and comedic effect

Comforting myths of AI incapability threaten to mislead more people than models.
View quoted post on X
2 replies 1 reposts 23 likes 2.8K views View on X
MMitchell Verified account @mmitchell_ai
This is not good from the safety perspective, friends.
Rikiya Takehi @rikiyatakehi Nov 2
We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math.
It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training.

We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! 🧵
Blog: rikiyat.github.io/blog/weight-sp…
View quoted post on X
11 replies 12 reposts 91 likes 8.9K views View on X