Twitxy Saved

Jacob Effron

Verified account This account is verified. Learn more

@jacobeffron

Managing Director @redpoint supporting @AbridgeHQ @wearelegora @tryaugie @tryramp @getgarner @AcuityMD @scribehow / AI pod: Unsupervised Learning
youtube.com/@RedpointAI Joined March 2011
651 Following 5.1K Followers 819 Posts

Latest posts 5

Jacob Effron Verified account @jacobeffron
Thrilled to co-lead @fractile_ai's $720M Series C and get to work with @goodwin_ml and the incredible team.

Agents are running longer on bigger models and larger contexts. They’re bottlenecked by memory.

Fractile is the chip-first frontier AI company built to break that, stacking DRAM directly on logic for speed and scale. Over many whiteboards in Bristol, it became clear that Fractile’s full-stack approach is unlike anything else in silicon. You won’t find a more talented and fast-moving team. Couldn’t be more excited for everything ahead!
Fractile @fractile_ai 5d
We’re delighted to announce that Fractile has raised $720M in a Series C led by @thrivecapital @foundersfund @lightspeedvp and @redpoint, with further participation by brilliant new and existing investors.
View quoted post on X
10 replies 3 reposts 59 likes 2.9K views View on X
Jacob Effron Verified account @jacobeffron
Jev creator, @CompleteSkeptic, on how much coding agents increase engineers' efficiency:
0:56
Jacob Effron Verified account @jacobeffron Nov 5
Why hasn't AI automated more work? What's holding coding agents back? And are the labs' valuations built on the right expectations?

@CompleteSkeptic, co-founder and CEO of @typesafeai, was the perfect person to discuss this and more. Diogo coauthored OpenAI's InstructGPT paper, and a few weeks before we recorded, TypeSafe launched Jev, a "system one" model that returns structured decisions instead of text.

It was a ton of fun to discuss this with Diogo.

The conversation includes:

0:00 Intro
1:14 The Early Bet on RLCD
4:40 Built for Humans vs Computers
6:39 Roadmap & Model Limitations
11:04 Mental Models of Models
16:07 Do LLMs Have a Place in 10 Years?
17:32 New Model Shapes
21:24 Problems Still Unsolved
27:00 The Tyranny of the KV Cache
31:21 Rethinking Coding Agents
34:40 Multimodality
37:52 Images, Games & Computer Use
39:36 Could This Have Been Built 5 Years Ago?
42:01 Benchmarks & Copycat Releases
44:12 Fundraising
45:27 Quickfire

Listen here:

YouTube: youtu.be/ham8dROHCrc
Spotify: bit.ly/4kyeNBQ
Apple: bit.ly/3WppmgK
View quoted post on X
Jacob Effron Verified account @jacobeffron
"Let them cure cancer" may be the new "let them eat cake": why Jev's creator, @CompleteSkeptic, thinks some AI valuations are miscalibrated:
0:35
Jacob Effron Verified account @jacobeffron Nov 5
Why hasn't AI automated more work? What's holding coding agents back? And are the labs' valuations built on the right expectations?

@CompleteSkeptic, co-founder and CEO of @typesafeai, was the perfect person to discuss this and more. Diogo coauthored OpenAI's InstructGPT paper, and a few weeks before we recorded, TypeSafe launched Jev, a "system one" model that returns structured decisions instead of text.

It was a ton of fun to discuss this with Diogo.

The conversation includes:

0:00 Intro
1:14 The Early Bet on RLCD
4:40 Built for Humans vs Computers
6:39 Roadmap & Model Limitations
11:04 Mental Models of Models
16:07 Do LLMs Have a Place in 10 Years?
17:32 New Model Shapes
21:24 Problems Still Unsolved
27:00 The Tyranny of the KV Cache
31:21 Rethinking Coding Agents
34:40 Multimodality
37:52 Images, Games & Computer Use
39:36 Could This Have Been Built 5 Years Ago?
42:01 Benchmarks & Copycat Releases
44:12 Fundraising
45:27 Quickfire

Listen here:

YouTube: youtu.be/ham8dROHCrc
Spotify: bit.ly/4kyeNBQ
Apple: bit.ly/3WppmgK
View quoted post on X
1 replies 2 reposts 7 likes 1.5K views View on X
Jacob Effron Verified account @jacobeffron
Why hasn't AI automated more work? What's holding coding agents back? And are the labs' valuations built on the right expectations?

@CompleteSkeptic, co-founder and CEO of @typesafeai, was the perfect person to discuss this and more. Diogo coauthored OpenAI's InstructGPT paper, and a few weeks before we recorded, TypeSafe launched Jev, a "system one" model that returns structured decisions instead of text.

It was a ton of fun to discuss this with Diogo.

The conversation includes:

0:00 Intro
1:14 The Early Bet on RLCD
4:40 Built for Humans vs Computers
6:39 Roadmap & Model Limitations
11:04 Mental Models of Models
16:07 Do LLMs Have a Place in 10 Years?
17:32 New Model Shapes
21:24 Problems Still Unsolved
27:00 The Tyranny of the KV Cache
31:21 Rethinking Coding Agents
34:40 Multimodality
37:52 Images, Games & Computer Use
39:36 Could This Have Been Built 5 Years Ago?
42:01 Benchmarks & Copycat Releases
44:12 Fundraising
45:27 Quickfire

Listen here:

YouTube: youtu.be/ham8dROHCrc
Spotify: bit.ly/4kyeNBQ
Apple: bit.ly/3WppmgK
61:05
4 replies 7 reposts 21 likes 13K views View on X
Jacob Effron Verified account @jacobeffron
Danila Shtan, @nebiusai CTO, on the state of open-model inference:

"As an industry, we didn't optimize sh*t."

Run a new open model as published and the results are slow and expensive:
1:40
Jacob Effron Verified account @jacobeffron Nov 2
Danila Shtan is the CTO of @nebiusai, the AI cloud racing AWS, Google and Microsoft.

Danila has been with the company since the beginning. On November 1, 2023, Nebius launched its first public cloud with about 1,600 H100s. That same day, Danila told the engineering team to throw the entire stack away and start from scratch.

Today, Nebius is a Nasdaq-listed AI cloud with a $17.4 billion deal with Microsoft, a Meta agreement worth up to $27 billion, and a $2 billion investment from NVIDIA.

Danila is betting Nebius can grow fast enough to fight the hyperscalers as equals before they turn their full attention to AI cloud. He thinks the market is barely scratching the surface.

0:00 Intro
1:25 What Differentiates AI Clouds
6:16 Nebius’ Origin Story
10:15 Bringing New Nvidia Chips Online
14:55 What Different Customers Want
19:58 Latency vs. Cost
21:53 Disaggregated Prefill & Decode
24:59 Inference’s Low-Hanging Fruit
28:31 What Nebius Should Productize
30:11 The Tavily Acquisition
31:56 How Data Centers Differ
34:29 Bottlenecks in the AI Buildout
37:03 How New Workloads Shape Clusters
39:17 Why Hyperscalers Didn’t Win This Market
43:39 The Future of Neoclouds
45:42 What Gets Absorbed by AI Hyperscalers
49:43 OpenAI x Baseten
52:07 Quickfire

Listen here:

YouTube: youtu.be/qJkcjURcAe8
Spotify: bit.ly/47OFCKJ
Apple: bit.ly/4f6hwPk
View quoted post on X