Never send a human to do an AI's job.
Never send an AI to do a compiler's job.
Never send an AI to do a compiler's job.
@beddows
⚙️ Agents are the “killer” LLM app, but building and evaluating agents is hard.View quoted post on X
A huge part of agents is tool use, but there aren't enough open-source tool use benchmarks out there.
Today, we are excited to release four new test environments for benchmarking LLMs’ ability to effectively use tools.
📖 blog.langchain.dev/benchmarking-a…
🧵 Below are some of our preliminary results