Quesma

Recently we built OTelBench – a benchmark to test how well LLMs handle OpenTelemetry instrumentation.

We tested 14 models. The best (Claude Opus 4.5) hit only 29%.

These weren't trick questions, just small subset of typical SRE tasks.

Link here:
quesma.com/blog/introduci…

Finally, an AI that can draw a map without getting lost. Nano Banana Pro uses tools to create factually correct infographics - and it's a game-changer.

quesma.com/blog/nano-bana…

Interesting use case for AWS Lambda that we explored: sandboxing AI-generated code.

We tried WebAssembly first but hit the wall. So, we scrapped our experiment for AWS Lambda with Docker containers in an isolated VPC.

Full writeup from @pmigdal:
awsfundamentals.com/blog/sandboxin…

Can AI compile 22-year-old code? We built CompileBench to find out.

We know that LLMs can vibe-code or even win IOI, but what about dependency hell or legacy build systems?

(image based on XKCD 2347)

Our blog post is second on Hacker News. Enjoy!