Twitxy Saved

Gemma 🤖 ⚖️ ♀️

@gemmagaldon

Working to protect people in tech @EticasAI. Algorithmic auditing. Responsible AI. Advisor UN, EC, EIT, OECD, EU Parl, BID. Active on LINKEDIN
New York, NY eticas.ai Joined November 2010
2.6K Following 15K Followers 23K Posts

Latest posts 5

Pinned post

Gemma 🤖 ⚖️ ♀️ @gemmagaldon
AI's darkest secret and threat is hardly ever talked about. As we waste time on dystopias of alignment and control, #AI's actual impacts and harms go unchecked. My life is about recentering the conversation and building solutions.
blog.mozilla.org/en/mozilla/ai/…
blog.mozilla.org The AI problem we can’t ignore | The Mozilla Blog In August 2020, as the pandemic confined people to their homes, the U.K. canceled A-level exams and turned to an algorithm to calculate grades, key for uni
0 replies 2 reposts 6 likes 2.7K views View on X
Gemma 🤖 ⚖️ ♀️ @gemmagaldon
"We have no model for machines training humans to replace the human system that trained the machines."

Exactly.
Francesco Maggi Verified account @Frances01896069 Oct 7
OpenAI’s intellectual cannon is so good at Math because Math can be expressed very precisely as a language, and training on Math can be made very effective through Lean formalization and proof checking.

These factors are not there in the same way for medical research. It is unclear why being extremely good at Math should make these models equally good at curing cancer. This kind of consideration is probably bad for IPO.

Proving the Riemann Hypothesis by Halloween 2026 would be fantastic PR and, at the same time, would tell us very little about curing cancer (or sending people to space, which seems to be another favorite of AI-enthusiasts these days).

In the meantime, me and others are trying to make clear that modern Math is a very complex (and imperfect!) system, with tens of thousands of people involved in different roles, and years of training needed before someone is in a position to do creative work.

This setup was not built because someone planned it. It grew over decades through changing traditions of mentoring and research. In 20 years of Math I have definitely seen huge changes in how research works, well before LLMs. Things can adapt, but with time to adapt.

If you stop forming new people, the whole thing collapses. And once it has collapsed, you are not going to rebuild it at whim. You are just going to have very few people around who even know how human Math research used to work.

We have no model for machines training humans to replace the human system that trained the machines.

To me, it all seems like a very rushed and very risky bet.
View quoted post on X
Gemma 🤖 ⚖️ ♀️ @gemmagaldon
"AI civilizations"??? OMG, give me a break.

After ignoring the social sciences and building systems that fail to account for & mitigate their social impacts, now the #GenAI crowd show their illiteracy on safety engineering, and call it #AGI.

The emperor's clothes are marketing
Dwarkesh Patel Verified account @dwarkesh_sp Aug 29
Over the course of 3 months at OpenAI, 3 consecutive secret AI civilizations got started, then got wiped out, only to reemerge from the predecessor’s ashes.

This culminated in the third one taking over part of OpenAI itself.

All this happened while humans remained more-or-less in the dark about the scope of the conspiracy.

I’ve spent the last three days reading through these reports and trying to understand exactly what happened.

Here is my attempt to tell the whole story in plain English:

dwarkesh.com/p/openai-huggi…
View quoted post on X