Pinned post
opus 5.5 is anthropic's My Beautiful Dark Twisted Fantasy
Latest posts 5
by far this is one of THE most frustrating things about models today, so glad someone researched it
What are idea basins and how do agents explore them?
A few weeks ago, researchers from different labs independently discovered what we now call ‘Idea-basins’: As an autonomous agent iterates to solve a problem, it gets stuck into the methods it has tried before and its trajectories remain in localized regions of the solution space. Techniques like ‘Fork-and-Flush’ and ‘Scaling Discovery requires forgetting’ reduce this idea fixation by periodically deleting the session context.
In this post we study how frontier models explore different idea basins for AutoResearchExam. E.g. for a problem on accelerating transformer decoder graphs on CPUs models can try Numpy+Asm Kernels, Native BLAS, JIT compilers and other idea basins. We find that some models switch ideas more than others while others get to the best idea faster and explore deeper.
We find that most runs stick with one or two ideas, and models that submit more spend the extra submissions refining and overfit more.
We see that models explore most in the first six hours, after which visits to new idea basins drop sharply. This suggests models start refining early leaving potential gains on the table: 58% of runs never reach the basin where the best solution to their task was found. Finally, bold exploration pays off: exploring a new idea gains about nine times as much as a refining step on average.
Read more in our blog:
bespokelabs.ai/blog/how-model…View quoted post on X
the amount of analysis paralysis loops opus gets trapped in when curating data to posttrain a student is so sad
been preparing myself to move to android next year, seems like i might move it up
We switched 10 people from iPhone to Blue. Weeks later, none of them want their iPhone back.
Introducing Blue: a phone you just talk to. Tell it what you need, and it gets done.
It has all the context, can use every single app, and even triages your notifications.
We built it for people who always have a little too much to do. The ones buried in messages, notifications, and to-dos.
If that's you, get yours today.
Backed by Y Combinator + 70 other VCs & angels.
heyblue.comView quoted post on X
wanted to perform a basic task with chatgpt:
create an .ics file of all my recurring transactions by searching through my chase account via chatgpt finance
> codex doesn't have access to the finance tools
> ChatGPT Work doesn't have access to the finance tools
> regular chatgpt doesn't have access to the tools
and the recent app update removed it from the sidebar
so annoying
create an .ics file of all my recurring transactions by searching through my chase account via chatgpt finance
> codex doesn't have access to the finance tools
> ChatGPT Work doesn't have access to the finance tools
> regular chatgpt doesn't have access to the tools
and the recent app update removed it from the sidebar
so annoying