Twitxy Saved

Jeffrey Wang

Verified account This account is verified. Learn more

@jeffreygwang

Researcher @OpenAI. Previously (and perhaps again) CS/Math/English @Harvard.
San Francisco, CA jeffreygwang.com Joined July 2020
1.1K Following 7.3K Followers 585 Posts

Latest posts 5

Jeffrey Wang Verified account @jeffreygwang
(1/10) Today, we’re sharing new research from @OpenAI: How does CoT monitorability (no-CoT capability and CoT controllability) evolve over the model training lifecycle?

We emerged with unsurprising but sobering findings: as we scale toward more intelligent systems, models are becoming harder to monitor through their CoT. 🧵
126 replies 188 reposts 1.5K likes 265K views View on X
Jeffrey Wang Verified account @jeffreygwang
People describing their fears around AI often reanimate the sci-fi future (likely dystopia) they once read about.

All of this makes it ever more critical for us to crystallize a coherent, grounded, and positive vision for the future of this technology.
Patrick Collison Verified account @patrickc Nov 8
Two things I’ve been thinking about regarding AI:

• People often highlight the risks involved in AI, which are surely very real. I’m struck, however, by how hard it is to understand the contours of the positive scenario. There are easy-to-perceive and frequently invoked elements of a positive vision — more diseases cured, more material abundance, etc. — which sound great, but these are by themselves just ingredients. I’m curious what the larger equilibrium is supposed to look like. Do people work? If so, why? What is their marginal contribution? If not, how are resources allocated? What is scarce? What is the ratio between humans and AIs? Are humans in control, whatever that means? One sometimes hears the Culture novels invoked as one scenario, but I’m not sure they depict a desirable outcome. (AI runs everything and humans compete in games? Iain Banks himself said that the humans in the Culture are “somewhere between passengers, pets and parasites.”) There is Richard Brautigan’s famous poem, but do we want to be “returned to our mammal brothers and sisters”? (Isn’t that rewinding Genesis?) We could say that it was hard to imagine the world of 1900 from the vantage point of 1700, and that’s assuredly true. But nobody in 1700 was trying to recast humanity itself within a couple of years — things necessarily unfolded slowly and by increments, and therefore with the possibility for error correction. Given how rapid the rate of progress in AI may be, it feels strange for the upside case to be so opaque.

• There is increasing discussion of whether AIs are conscious or how we would know whether they are, with conclusions there often assumed to be relevant to matters of moral worth. At first blush, this seems a rather arcane, benign, or even absurd issue. (Remember the response to Blake Lemoine’s fears.) Setting aside the terms of the debate itself, or the relevant demarcation criteria, it seems to me a quite high-stakes question, for an affirmative answer — that is, granting moral worth to AIs — would presumably mean that the aggregate worth of AIs would soon outweigh that of humans in any utilitarian calculus. The AIs will be exceptionally wise and intelligent, and vastly more numerous (especially once one considers the imminent future and the AIs not yet born). As such, even epsilon of moral worth will multiply to a lot once one considers the quadrillions that could soon exist. (This is effectively a distributed version of the Nozick’s utility monster.) If this conclusion is unpalatable, I think one of three propositions needs to be rejected: the premise AIs can have moral worth; utilitarianism itself; or the belief that there is even a possibility that they will be far more numerous than humans.

With both of these matters (contours of future society; AI moral worth), there is the possibility of dramatic change. Today, people argue about datacenters. I’m curious how popular support for AI will evolve as more people come to understand these medium-term questions and the relevant stakes. What is the vision for AI that most people would be excited about?
View quoted post on X
2 replies 0 reposts 30 likes 2.7K views View on X
Jeffrey Wang Verified account @jeffreygwang
continued takeoff from my friends at AC:
Yash Patil Verified account @ypatil125 Nov 2
Applied Compute update:

- crossed ⁠$100M annualized revenue run rate up from zero 18 months ago
- raised $350M at $3.25B led by Elad Gil
- 40% of customers use AC for both custom model training + production inference
- inference serving 1T tokens a day after launching 12 weeks ago
- 2X enterprise customers since last raise
- 3X team since January, 85% are researchers and engineers
⁠- Working with customers like Microsoft, Shopify, Harvey, DoorDash, Cognition, Clay, Decagon and others

To move even faster we need people who are extremely technical AND extremely practical. If this is you, please reach out.
View quoted post on X
3 replies 0 reposts 54 likes 4.3K views View on X
Jeffrey Wang Verified account @jeffreygwang
Conversation with my father.

Me: We should make a no AI writing to family rule

Dad: If I own a beautiful shirt, why should I settle for wearing something plain?

Me: I disagree with this characterization; I think there's something very human about writing to one another—imperfections and all—that gets erased when you plaster it with the makeup of AI.

Especially because AI's rouge is so recognizable.

Dad: *reacted 🙏 to your last message*