Twitxy Saved

Deepnote

Verified account This account is verified. Learn more

@DeepnoteHQ

Data workspace where agents and humans work together.
馃寧 deepnote.com Joined August 2019
74 Following 5.3K Followers 1.4K Posts

Latest posts 5

Deepnote Verified account @DeepnoteHQ
Intelligence is solved. AI labs are shifting their attention to the next: proactive intelligence. AI that knows when to jump into your day-to-day.

Today, we're releasing the Agent Initiative Benchmark: a proactive intelligence test that measures 12 models' ability to solve real-world tasks in a carefully curated synthetic workspace, backed by a robust 6-year data blueprint.

Check out our founder Jakub's key takeaways for agent builders.
Jakub Jurovych Verified account @jakubjurovych Nov 13
What鈥檚 the best model for proactive agents?

Today, we鈥檙e introducing the Agent Initiative Benchmark. We tested 12 frontier models on realistic workplace tasks inside a synthetic company with 6 years of highly detailed history: it has a financial model, CRM records, past-due invoices, Linear tickets, and real-life events affecting company development - competitor product announcements, SVB collapse, etc.

We used the company鈥檚 Slack to test how a proactive agent listening in on each conversation would assist the team in day-to-day tasks: from stepping in to align initiatives across teams to warning the team not to use an unapproved customer logo.

Highlights:

- 6.1 Sol and Astra from @OpenAIDevs beat Anthropic's latest Fable 5.2, with Sol crushing it at both performance and cost ($0.11 per task vs $1.87).
- The most expensive models aren't the best: Fable 5.1 is 430x more expensive than GPT-6 Luna, with similar performance.
- Most models try to help even if they're not needed. Interestingly, in these failure cases, they spend more time thinking, and the unnecessary work takes about 80% more time and money than if they stayed quiet.

If you鈥檙e building agents, keep reading for more tips on which model is best for your use case. Detailed breakdown, the open-source dataset, and benchmark code below:
View quoted post on X
15 replies 2 reposts 18 likes 807 views View on X
Deepnote Verified account @DeepnoteHQ
Most data teams that got their context layer working didn鈥檛 buy one. They wrote .md files and put them in a git repo.

One team took agent accuracy from 14% to ~90% that way. Setup took 5 minutes.

The lesson from comparing notes with data leaders, startups to the F500: writing your context down pays off enormously. Where you put it matters far less.

Full article linked in comments.
23 replies 0 reposts 26 likes 448 views View on X
Deepnote Verified account @DeepnoteHQ
Meet Deepnote Agent Workspace: a shared place where people and agents work on the same data tasks and publish them as hosted apps - all grounded in your skills, 100+ native integrations, and permissions.
Jakub Jurovych Verified account @jakubjurovych Aug 3
Meet Deepnote Agent Workspace: a shared place where people and agents work on the same data tasks and publish them as hosted apps, all grounded in your skills, 100+ native integrations, and permissions.

Every major model release gives agents more capability. They can search, write code, query databases, use applications, and sustain increasingly complex work.

But capability alone is not enough to scale across the team or reliably reproduce work over time.

Most data agents still work inside a temporary chat or a developer鈥檚 local harness. They can produce an impressive answer, but they do not automatically inherit the knowledge, permissions, and processes that allow a company to depend on that answer.

People do not work that way.

A good teammate knows which definitions the company trusts. They know where the relevant data lives and what they are allowed to access. They leave behind work that others can inspect. They learn from corrections. When a task becomes important and recurring, they turn it into a process the organization can rely on.

Agents need the same foundation.

Today, we鈥檙e introducing Deepnote Agent Workspace, a shared place where people and agents work on the same data, using the same organizational context.

It brings together the components required to operate data agents across a company:

- Skills that capture trusted definitions and procedures,
- Agents that perform inspectable and recurring work,
- Apps that bring the result into business workflows,
- Integrations and permissions that govern access throughout.

Interested in trying it out? Reach out, and I鈥檒l hook you up.

@DeepnoteHQ
View quoted post on X
Deepnote Verified account @DeepnoteHQ
@Deepnote x @OpenAI

We鈥檙e excited to be part of OpenAI鈥檚 launch of new role-specific plugins in Codex. Your Deepnote notebooks, scheduled analyses, data apps are available directly to Codex via our native plugin.

Three things this unlocks:

- Your workspace as context. Codex can search and read across every project, so a cross-functional question can pull from your marketing, sales, and product notebooks and reason across all three. The reporting matches how your team actually defines things.

- Explorations that ship. Codex can write back to Deepnote, so an analysis lands as a notebook or a published app your team can open, rerun, and extend, not a chat thread that scrolls away.

- Complex workflows from question to production. Teams can build new analytics jobs in Codex using Deepnote鈥檚 context layer, then hand them off to run as long-running workflows in Deepnote.
0:29
2 replies 0 reposts 8 likes 1.4K views View on X
Deepnote Verified account @DeepnoteHQ
Which AI data viz tool makes it hardest to ship a wrong answer?

We gave 9 of them the same dataset and the same 4 prompts. Some nailed the math but couldn't show their work. Others produced confident charts built on wrong assumptions.

Get the full breakdown with scores, screenshots, and the dataset so you can try it yourself.
Link in comments.