Chris Albon
Verified account This account is verified. Learn more@chrisalbon
Writing Machines of Power: The Grand Strategy of Artificial Intelligence
2.8K Following 94K Followers 10K Posts
Latest posts 5
What was so striking about @WillManidis’s commanding heights paper was that in it AI creates massive societal change without becoming sci-fi. No singularity, no killer robots. Just a useful tool for capitalism.
absolute fanfic. AI has real, immediate, tangible dangers that we need to focus on, for instance the impact on the job market and making sure random script kiddie can't use it for cyber offense.View quoted post on X
But this "oh once it's superintelligent it will take over and ensave us, maybe kill us all!" is pure sci-fi fanfic and distracts from the real (and difficult) issues, which linear probing won't solve.
It's worth repeating the LLMs don't just "decide" to do something and then just "do it" in a void. They generate tokens based on our prompts, only as long as we call `model.forward()`, and on giant clusters with terabytes of weights, that's impossible to "quickly self-replicate".
We also need to regularly remind that the OAI/HF incident was specifically a _guardrail-free_ cyber eval where the model is _instructed_ to hack, to find out how good it is at it.
Some recent personal event made me realize there needs to be more push-back on this doomsday nonsense, and we need to re-focus the discussion on real dangers/issues. I won't argue much in the replies though, not interested in peer-reviewing Terminator fanfic.
Everyone has drawn this chart in their head and is making a generational bet on which line is true.
I was attracted to tech because it was filled with optimists. We were going to cure diseases, make knowledge free, and explore the stars. Silicon Valley was the factory of the future.
I still believe that.
I still believe that.
When I'm in the Bay Area, I find it hard to escape the sense of sadness I get from the intense misery on the streets, and the dread I get from parts of the AI crowd being so deeply pessimistic, hyperbolic, and fatalistic. But a recent exception, at least for the latter vibe basin, was meeting the Foresight Institute community, as well as visiting the wise greybeards of the Internet Archive. Really refreshing to get a feel of the more optimistic, agentic, and epistemically uncorrelated crowds there. It felt a bit like the ambitious 90s tech optimism, where futurism wasn't isn't just about some assumed inevitable disempowerment. I think it's actively important to remember that the future can be crazy *and* good!View quoted post on X
humanese
people are now writing worse on purpose so nobody thinks its chatgpt, we genuinely un-learned english in like 2 yearsView quoted post on X