Twitxy Saved

Jimmy Lai

Verified account This account is verified. Learn more

@feedthejim

codex/chatgpt web infra EM @openai

previously: eng director @nextjs @vercel, also @reactnative @meta
San Francisco jimmyl.ai Joined August 2018
534 Following 9.1K Followers 1.2K Posts

Latest posts 5

Jimmy Lai Verified account @feedthejim
btw, am now leading ChatGPT/Codex Web + Desktop infra group

if you’ve already made other developers meaningfully faster (platform, tooling, reliability, DX), the opportunity is to do the same work at AGI scale

hit me up if interested
97 replies 41 reposts 1.2K likes 93K views View on X
Jimmy Lai Verified account @feedthejim
this is why frameworks aren't dead :) there's still so much to do in order to scale to infinity
Zack Jackson Verified account @ScriptedAlchemy Oct 31
I’ve thrown a modified t3code and pretty much every frontier model working in tandem over multiple subaccounts on a relatively “low-hanging fruit” for rspack— a portable cache that’s worktree-aware. While this doesn’t solve the memory challenges exceptionally, it does have a significant impact on agentic development. The question came from Copilot: “If 80% of the code isn’t changing, why can’t the compiler share memory when working concurrently in worktrees?”
Ultimately, that’s a large architectural change for rspack to just try, especially given the tools’ reliance in trillion-dollar companies, and our own company too.
The path of least resistance would be making the cache portable; from there, the option to think about how to optimize or shift rye architecture could be somewhat explored, while providing users today with gains specifically targeting machine contention.
I’ve been testing this using @grafana @gitlab @sentry codebases, which consume rspack already and are the general target market for large, complex, enterprise-style builds.
If you are on the main worktree and create a new one, the rspack dev server, when you change a module, will only HMR one module. The warm vs. cold initial builds and hmr cycles were pretty substantial. If that agent decides to split work and makes a new worktree, rspack will rebase the cache off the base worktree, not the main one. I tested this up to 6 worktrees deep.
One prominent challenge: loaders often use require.resolve or dirname, or import.meta to resolve an absolute path to a resource. In Vue loader and React transforms, this would cause the loader to rerun on a worktree. Like gitlab it cost 16k modules to be rebuilt. Finding a solution to rebasing absolute paths in worktrees was tricky. Also, you have to ensure things like the time it takes to replicate the cache (use reflink or cow) isn’t longer than rspack just rawdogging it.
View quoted post on X
1 replies 0 reposts 14 likes 3.4K views View on X
Jimmy Lai Verified account @feedthejim
I'm looking at migrating over for the ChatGPT codebase and saw ~70% improvements on both wall time perf + peak cpu/memory usage.

this is great for getting work done faster but also much better if you want to run concurrent agents/worktrees at scale
VoidZero Verified account @voidzerodev Oct 20
Introducing tsrs: a Rust port of the TypeScript compiler 🦀

We are not forking TypeScript!

◆ In close collaborating with the TypeScript team
◆ Up to 8x faster than TS 7.0 & ~70% less memory
◆ Runs in WASM, so it works in your browser & on Workers
◆ Soon part of the Oxc toolchain

npx tsrs

blog.cloudflare.com/typescript-rus…
View quoted post on X
7 replies 7 reposts 367 likes 20K views View on X
Jimmy Lai Verified account @feedthejim
it wouldn't be far-fetched to say that for OSS js maintainers, a fully functional and cost-efficient slop fork of Typescript is the equivalent of Navier-Stokes being solved for mathematicians

a year ago, this idea would have been laughed at

where do we go from here?
Theo - t3.gg Verified account @theo Oct 7
Announcing tsc-rs (aka ts-rust), my complete rewrite of the Typescript compiler, type checker, and LSP, all in Rust.

This is a project I've had agents working on for 5 months now. I burned ~$400k of Codex tokens and got nowhere. Burned ~$20k of Opus and got there in 2 weeks.

I have not read a single line of the code.

tsc-rs is an open source drop-in replacement for tsc, and it's available now.
View quoted post on X
5 replies 2 reposts 92 likes 12K views View on X