Twitxy Saved

Charlie Cheever

Verified account Expo

@ccheever

@ccheever.com on 🦋/ working on @expo & @castlexyz
Palo Alto, CA ccheever.com Joined April 2007
4.8K Following 18K Followers 9.7K Posts

Latest posts 5

Pinned post

Charlie Cheever Verified account @ccheever
I want to share a preview of something I've been working on called Exact. It's a new Agent Native app framework written in Rust. It's extremely fast and tries to let you build exactly the experience you want with no compromises.
0:35
42 replies 59 reposts 495 likes 43K views View on X
Charlie Cheever Verified account @ccheever
Interesting
Axel Delafosse Verified account @axeldelafosse Oct 30
@ccheever We are testing a new compaction approach in the Codex harness (it's not a secret, the harness is open-source).

But after running and seeing a bunch of evals on compaction, I can tell you that summarization works really well and that we don't really need a 1M context window size.
View quoted post on X
0 replies 0 reposts 10 likes 2.4K views View on X
Charlie Cheever Verified account @ccheever
This seems intuitively ~ right to me
Alexander Yue Verified account @Alezander9 Oct 29
Compaction is a mistake.

When an agent's context fills up, tools like Codex and Claude Code compact it:
1. The model prefills the entire session again
2. It writes a summary of everything so far
3. A new session starts from that summary

I measured this on a real ~400k-token session with Opus 5.5:
→ 38 s and $1.99 when the prompt cache has expired
→ 29 s and $0.17 when it hasn't

And the summary is lossy. The exact error message, the file path, the one number you needed is often gone.

So I do something new for Mainplane

Context retrieval works the other way around. Mainplane keeps the full record of every session as a file. When the context fills up, a new session starts right away with one instruction: "You are continuing session X. Retrieve key context from it as you go."

The agent searches the old session and copies the exact lines it needs, when it needs them.

Same session, same model: 15 s and $0.10 to get back to work. It does not depend on a cache hit, and nothing is paraphrased.

This is the bitter lesson applied to agent memory. Don't hand-design what the model should remember. Give it the full record and good tools, and let it decide.

Mainplane is open source (MIT). Link in the first comment.
View quoted post on X
7 replies 1 reposts 147 likes 34K views View on X