Pinned post
Han
Verified account This account is verified. Learn more@hhua_
6.7K Following 5.1K Followers 11K Posts
Latest posts 5
Full hardcore mode
We have dumped JAX/SGLang and rewritten the entire RL and inference stack from scratch in C/C++, which took some extra time.View quoted post on X
Training (aka pre-training) is done. Lot of cleanup was needed on the SFT data to get that mostly right. Now, 4.8 is in RL and the evals are starting to climb. We will do a soft rollout to Bot users later this week and see how it goes.
Grok 4.8 will bear no resemblance to 4.7 (thankfully). It is not yet incredible, but, this time, the foundations are built right, so I expect it to evolve to be something special.
Is it more like portable solar farms? And you install compute on site?
We built a new type of datacenter for AI inference. We call it NanoDC.
NanoDC is a solar-powered autonomous datacenter that can be deployed anywhere on the planet in 4 weeks.
11 Trillion will be invested in AI compute over the next 4 years. Most of this will be for inference and most of it will be severely delayed: stuck in grid interconnect queues, site permits, or supply chain issues. NanoDC sidesteps these issues completely.
NanoDC is built rapidly at a factory and shipped to the site ready to be turned on in 30 minutes. It generates its own power with solar and batteries. You open the door and the solar panels fold-out like an accordion. The compute is cooled with patent-pending high-density air cooling. It connects to the internet via Starlink.
No construction. No grid interconnect. No Water supply.
It never waits for transformers and turbine generators either.
Getting more compute is as easy as dropping more units and turning them on.
The first units will be live this month. Thousands will be shipping starting 2027.
Sunlight in. Tokens out.View quoted post on X
Heard from one of our angel investors that we are the last check from sequoia scout fund. 😂😂
uhh so this is how i found out that i'm not only no longer a Sequoia Scout, my main partner (and boardmember since @Temporalio) is also gone.View quoted post on X
no email from sequoia yet about anything in the past month. no response to my texts from any partner.
I literally left my previous partnership to join Sequoia because I respected what they have built and thought they represent the epitomy of what being long term partners could be in Silicon Valley and I wanted to be closer to that from the inside rather than read about it in @colossusmag hagiographies.
disappointed. i respect the new direction but the collateral damage is high.
on the plus side, i think i am done being a scout. @mariadlzollo and I are going to raise a small side fund, by founders for founders. we are seeking a compute partner (possible GP, or just sponsor/in-kind-investor), and a researcher GP.
pls enquire within - dm or text if you have me, else business@latent.space
Tip: work from Cafe Venetia
Jeff Dean reveals Discovery Loop did 400 interviews, mostly at Cafe Venetia on University Avenue, in its first three weeks and already has about 20 automated improvement loops running
“So what have we done so far? First three weeks we did 400 interviews, mostly at Cafe Venetia on University Avenue, to find amazing people, which I talked about some of them. Finding office space, we’re in the old Zibibbo restaurant, so we have a funky space for us."
"We’ve built our own agent harness that we’re using for all of our own development and for automation. That harness has some really nice collaboration features, so you can think of it as a system that you interact with a model to have conversations and ask it to solve things, but you can also invite your teammate in to collaborate. And so then the two of you can talk to a model and an agent. And you can also have other people add comments to the thing you’re trying to do, and propose a design to the agent before you propose that."
"We’ve built really agent-first infrastructure so that it will scale to having tens, hundreds of thousands of agents doing things rather than sort of hundreds of people doing things. We think that’s really important, and we’ve got probably on the order of 20 automated improvement loops running in the way in which we imagine that we want to solve problems.”View quoted post on X
