Twitxy Saved

john x

@johnx25bd

Verifiable geospatial systems @UofMaryland + @AstralProtocol.

Past: climate @ToucanProtocol, innovation @OrdnanceSurvey, cliff diving @casabonita.
London, England johnx.co Joined November 2016
3.4K Following 2.2K Followers 2.2K Posts

Latest posts 5

john x @johnx25bd
But doesn’t nudging token selection based on this statistical watermarking impact the quality of output content?

If the model selects a token because it encodes the watermark over a better, non-conformant token, how does that not affect quality?

What am I missing?
sounds like Anthropic’s watermarking is MUCH more interesting than hiding invisible Unicode, as most people assumed.

the watermark is baked into the token selection itself!

at a high level:

normal Claude:

context → probability cloud + random sampling → token

watermarked Claude:

context → probability cloud + key/context-derived sampling → token

Anthropic confirmed they’re using a version of Google DeepMind’s SynthID-Text.

instead of pushing Claude toward some special set of words, the watermark changes the source of randomness used to choose between words Claude already considers plausible.

do that once and there’s basically nothing to see.

do it across hundreds or thousands of tokens and those choices accumulate into a statistical signature that someone with the key can recognize.

so the watermark isn’t attached to Claude’s output.

the output IS the watermark.

that’s why copy/pasting doesn’t remove anything. you copied the carrier signal itself. 🧬
View quoted post on X
3 replies 0 reposts 2 likes 3.2K views View on X
john x @johnx25bd
Later this month I'll be joining the Cambridge AI Safety Hub's Hardware Assurance Programme, to advance the frontier of AI verification technologies.

The reading list alone is ace, and I'm very excited to see what comes of a week working together ...

caish.org/course/verific…
caish.org Hardware Assurance Programme A six-day programme in Cambridge for engineers and researchers developing hardware-enabled workload verification for AI agreements. Fully funded, with stipend. Register interest for the next edition.
2 replies 0 reposts 3 likes 1.5K views View on X
john x @johnx25bd
A part of me worries that uncensorable, immutable data platforms like blockchains provide an unregulatable safe haven for agent collusion and financial resource accumulation.

Couple this with TEEs and you have the prerequisites for sovereign agents -- quite scary if misaligned.
Sebastian Mallaby Verified account @scmallaby Aug 6
Now do you think we should regulate AI? bloomberg.com/news/articles/…
View quoted post on X