@UCL_DARK
Almost all agentic pipelines prompt LLMs to explicitly plan before every action (ReAct), but turns out this isn't optimal for Multi-Step RL 🤔 Why?
In our new work we highlight a crucial issue with ReAct and show that we should make and follow plans instead🧵View quoted post on X
LLMs can be programmed by backprop 🔎
In our new preprint, we show they can act as fuzzy program interpreters and databases. After being ‘programmed’ with next-token prediction, they can retrieve, evaluate, and even *compose* programs at test time, without seeing I/O examples.View quoted post on X
Join Tim Rocktäschel tomorrow at 2PM in Hall 1 Apex at #ICLR2025 for a Keynote on Open-Endedness, a research paradigm focused on systems that generate endless sequences of novel but learnable artifacts, hinting at a future where AI drives its own discoveries. iclr.cc/virtual/2025/i…View quoted post on X
