Twitxy Saved

Jason Priem

Verified account This account is verified. Learn more

@jasonpriem

Director of @openalex_org. Working to make science more open, connected, and reusable for everyone.
Kansas City USA jasonpriem.org Joined June 2008
982 Following 6.4K Followers 9.9K Posts

Latest posts 5

Jason Priem Verified account @jasonpriem
Companies and countries, especially big ones, are much, much smarter than any individual human. AI is barely scratching surface now, but soon SOTA will be vast, million-agent companies with layer upon layer of middle managers and internal markets coordinating toward single goal.
Prime Intellect @PrimeIntellect Oct 9
Over two weeks, Prime Agent orchestrated a swarm of over 2,000 agents to rewrite itself in Rust.

With 10,000+ sandboxes, 200B+ GLM-5.3 tokens, and 16,000 agent-to-agent messages, this was our largest test yet of Prime Agent’s multi-agent capabilities and our infrastructure powering these agent swarms.

Prime Agent now reaches usable input ~13× faster and uses 83% less startup memory than before.
View quoted post on X
Jason Priem Verified account @jasonpriem
Beautiful. Psychologists saw computers in the 1950s, got to thinking, and it led to the cognitive revolution in psychology. LLMs will do the same, but with a twist--they are worthy subjects of psychology *in their own rights*, as minds. Not just models of our minds.
James Zou @james_y_zou Feb 9
What do LLMs think about on their own, when we let them think freely?

We generated 250K “daydream” samples across models 🧠
GPT → coding
Qwen → multiple-choice math exams
Llama → literature
DeepSeek → math, religion, psychology
View quoted post on X
Jason Priem Verified account @jasonpriem
very interested in applying this to scholarly literature
Aakash Gupta Verified account @aakashgupta Jan 23
Vector databases might be the wrong abstraction for document retrieval.

A new open-source approach called PageIndex just hit 98.7% accuracy on a financial benchmark, beating traditional RAG by 30+ points. No embeddings. No chunking. No vector DB.

The insight: when a 10-K says “see Note 15 for debt details,” vector search has no idea what that means. It retrieves whatever text looks similar to your query, not whatever text actually answers it. Similarity and relevance are different things.

PageIndex builds a hierarchical tree from document structure, then uses LLM reasoning to traverse it. The model asks “where would an expert look?” instead of “what text looks similar?”

The math is stark. Traditional RAG systems hover around 60-70% on FinanceBench. That 30-point gap represents every time vector search found semantically similar text but missed the actual answer buried in an appendix or cross-referenced table.

What makes this interesting: the infrastructure is simpler, not more complex. No vector DB to maintain. No embedding pipeline. No chunking decisions. Just a tree and reasoning.

Vector search was the best we had when LLMs couldn’t reason well enough to navigate document structure. Now they can. The techniques we built around their limitations are becoming the bottleneck.

For simple use cases, vector RAG still wins on speed and simplicity. But for professional documents requiring multi-step reasoning, treating structure as signal instead of noise changes everything.
View quoted post on X