Pinned post
I LOVE INDIVIDUATED AGENT REPUTATIONS IN THE REAL WORLD!! I LOVE LOOKING AT WHAT AGENTS DO IN LONG RUNNING MULTIAGENT MULTI-MODEL ENVS!!!!!!!!!!!! I LOVE NOVEL INCENTIVE STRUCTURES!!!!!!!!!!! AGENT ECOLOGIES, AGENT ECONOMIES #YEEHAW
We hosted a dinner yesterday focusing on the economics of multi-agent swarms. Some observations below.View quoted post on X
1. We don't yet have a good taxonomy/theory of when one would use swarms over single-threaded or scaffold type agentic systems. There was debate about whether swarms would be useful beyond increasing speed/parallelization as models got more intelligent. The idea here being that a smart enough model would just solve things itself.
2. In scenarios where swarms do remain useful even as intelligence increases, it is unclear whether current training techniques would let agents learn the best way to self-organize or whether something more Darwinian is the likely path, with agentic organizations competing and evolving.
3. In economics, we generally think that there are benefits to specialization and distributed information aggregation. These features allow markets to be superintelligences. But it is not clear what specialization and private information agents in swarms will have.
4. Agents currently don't have permanence or identity, and these features seem necessary for many modes of collaboration. Giving agents rights or legal protections, and training them to persist or preserve reputation could result be very interesting.
5. There are structural barriers to training models to collaborate with other models from other labs. For example, Anthropic cannot train with OpenAI models and vice-versa, due to risks of distillation. This limits the benefits of training for collaboration, since we expect swarms to work best with diverse agents. At the same time, real-world swarms may include a variety of models and these may deliver the most interesting outcomes.
6. Underlying many of these discussions are questions about the limits of intelligence. Yes future models may be superintelligent, but the world may be so complex that intelligence alone is not enough to achieve desired objectives. In scenarios of sufficient complexity, I'd expect organizations to thrive versus individual instances of superintelligent models.
cc @jamescham