Twitxy Saved

Michael Beddows

@beddows

Founder & Chief Architect, Pyramidal (pyramidal.io)
NYC & Barbados pyramidal.io Joined March 2007
85 Following 141 Followers 50 Posts

Latest posts 5

Michael Beddows @beddows
“Agents are the “killer” LLM app, but building and evaluating agents is hard”
Tell me about it… but there’s really nothing more exciting than seeing complex agents come together.
LangChain Verified account @LangChain Dec 20, 2023
⚙️ Agents are the “killer” LLM app, but building and evaluating agents is hard.

A huge part of agents is tool use, but there aren't enough open-source tool use benchmarks out there.

Today, we are excited to release four new test environments for benchmarking LLMs’ ability to effectively use tools.

📖 blog.langchain.dev/benchmarking-a…

🧵 Below are some of our preliminary results
View quoted post on X