Twitxy Saved

DEMi

@demi_network

We help researchers, engineers, founders, policymakers and funders coordinate to make AI open and aligned.
San Francisco demi.network Joined December 2024
23 Following 249 Followers 72 Posts

Latest posts 5

DEMi @demi_network
heroic work by @louisnandre !
Louis Andre Verified account @louisnandre Nov 10, 2025
Today, we're announcing @episteme, a new type of R&D company that recruits exceptional scientists to pursue high-impact ideas.

Science isn’t bottlenecked by the availability of talent, but by places where they can do their best work.

Scientific progress has driven human flourishing: extending lifespans, lifting billions from poverty, and expanding our understanding of the universe.

But history is littered with transformational ideas that were overlooked in their time. That problem is still acute today: too much promising talent remains uncultivated, and remarkable ideas die in the lab or are filtered out by misaligned incentives.

Today, scientists face suboptimal paths for translating their research into impact: academia is famously risk-averse and incentivizes publications and winning grants vs. translational research. Industry is too often focused on short‑term incentives. And startups lack the substantial capital, expertise, and complex infrastructure needed to deliver long-term scientific progress.

On top of that, recent funding cuts in the US mean the overall supply of ideas is decreasing. Put together, the global scientific production system is operating at a fraction of its capacity.

How Episteme operates is different: we identify great scientists who can meaningfully benefit humanity, but who aren’t supported efficiently within traditional institutions today. Researcher by researcher, we work with them to determine the bespoke resources, operational support, and environmental conditions to execute on their research. We bring them together in-house, and provide those resources to ensure that their breakthroughs are deployed for real-world impact.

We’ve already assembled an amazing team of operators, ranging from the Gates Foundation, DeepMind, ARPAs, DoE – just to name a few – and researchers who are pursuing important problems across physics, biology, computing, and energy. Our team has spoken to hundreds of researchers across disciplines and geographies to understand the limitations they’re facing and what can be done better, and designed Episteme for them.

We’re backed by individuals like @sama, Masayoshi Son, and other long-term partners who share our mission of enabling ambitious science for tangible human impact.

About me: I started working as a researcher 9 years ago, on problems ranging from AI-driven drug discovery to developing brain-machine interfaces. It was that experience that led me to realize that so many scientists with great potential to change the world don’t have access to opportunities equal to their capacities.

@sama and I believe that much better science should happen for humanity, and that a new engine is needed to support that. We decided to cofound Episteme together, and I am incredibly grateful for Sam’s unwavering support as a thought partner and founding investor.

Our conviction is that by supporting the right people with the right incentives, we're set to generate breakthrough discoveries to benefit humanity. We cannot rely on the course of history to shape scientific progress; we need to proactively shape the system by supporting the most talented people with the right resources and incentives.
View quoted post on X
DEMi @demi_network
Google Zero is happening, and publishers are worried about how they’ll be paid for their content. Many are rushing to make deals with co's like OpenAI, making it hard for smaller players to access high-quality content.

To solve this, @edwardjhu, ex-researcher at @OpenAI and inventor of LoRA, proposes a content infrastructure for the new “agentic web”, like Stripe or Plaid but for content, where AI startups can retrieve content directly from publishers and make micro payments with no legal overhead.

Anyone building this?
14:00
DEMi @demi_network
When access to GPUs is controlled by a few closed companies, innovation slows to the pace of their priorities. "The next breakthrough won’t come from another walled garden, but from an open infrastructure."

@SimeonBochev and team at @computeexchange are democratizing access to compute by building a marketplace trading compute like energy — benchmarked, rated, and fairly priced. Anyone can buy, sell, or resell capacity freely, and performance is measured transparently.

What they are building is at the heart of what believe in at DEMi, and we're excited to continue supporting them in their mission.
19:23
DEMi @demi_network
Today's LMs have huge long-term memory (parameters and training data) but relatively very small working memory (context). With standard attention architecture, extending the working memory makes the model’s internal state grow rapidly, which weakens in-context learning.

To solve this, @jacobmbuckman and his team at
@manifest__ai created Power Retention as an alternative architecture to transformers. It holds the model's internal state size constant regardless of context length, while keeping the model learning across the whole context with similar flop budgets and speedups of more than 10x during training and 100x during inference for context lengths of 64k tokens.

Check out their implementation on Github.👇
19:03
DEMi @demi_network
.@bilgeacun, research scientist @AIatMeta, is making models more efficient and sustainable by optimizing for carbon footprint as a metric in the design stage. Her recent project, CatTransformers, is a model and architecture search framework that takes a pre-trained transformer model, prunes it across different dimensions such as number of layers and attention heads, and fits it to an optimal hardware architecture with parameters like number of cores and memory. By doing such a joint model and hardware architecture search, you make running the model more efficient and significantly reduce carbon footprint.
8:40