Mattt (@mattt)

Over the last 30 days, Sosumi.ai has served tens of millions of requests to coding agents looking up Apple docs, from about 6,900 (nice) unique IPs/day.

But does it actually help? I built an eval to find out: 41 Swift tasks, mostly new APIs in the OS 27 SDKs, checked by the compiler and per-task rules.

Without docs, Opus, GPT-6.1 Sol, and Sonnet pass about a third of them. With Sosumi, they pass 98%, 97%, and 94%.

Compared to built-in web search, Claude models score 12 to 30 points higher with Sosumi, at about half the cost or less. GPT does slightly better with web search (99%), but at 3× the cost.

Running the eval also turned up a handful of fixes, now live (one framework page was 3 MB 😬). The eval is open source: github.com/NSHipster/sosu…

Two bar charts from the Swift API eval: 41 Swift tasks, mean of 3 runs per task. Each model has three conditions: no docs, built-in web search, and Sosumi. Tasks passed: Claude Opus 5.5, 38%, 84%, and 98%. GPT-6.1 Sol, 33%, 99%, and 97%. Claude Sonnet 5.5, 31%, 63%, and 94%. Claude Haiku 5.5, 23%, 64%, and 76%. API cost per task, in US cents: Claude Opus 5.5, 2.5, 11.2, and 5.7. GPT-6.1 Sol, 1.5, 4.0, and 1.3. Claude Sonnet 5.5, 0.8, 4.5, and 2.2. Claude Haiku 5.5, 0.1, 2.0, and 0.2.

Mattt @mattt 5d

AnyLanguageModel 1.2 is out! 🎉

This release brings dynamic profiles from Foundation Models 27 to earlier OS versions and to other models, so a session can now change its model, instructions, and tools as it goes.

Huge thanks to @llqoli for this work, and to @jaleel_akbashev, @mergesort, and ﹫jihtsan.

github.com/huggingface/An…

github.com Release 1.2.0 · huggingface/AnyLanguageModel ImportantIf you use multi-turn sessions, tools, structured responses, or streaming, check these changes: OpenAILanguageModel with apiVariant: .responses and OpenResponsesLanguageModel now send ear...

Mattt @mattt Nov 3

Dictation is half of how I use this. But when I put on AirPods, macOS makes them the default input, and the moment I dictate, whatever's playing gets loud and drops to walkie-talkie quality.

So I built a small plugin that keeps Paseo on the mic you pick: github.com/mattt/paseo-mi…

Paseo's Dictation settings from the Preferred Microphone plugin. The preferred microphone is set to Yeti X, the never-use list says AirPods, and the screen says dictation uses Yeti X, your preferred microphone.

Mattt Verified account @mattt Nov 3

I made Paseo Micro: a plugin and macOS app that turns a @work_louder Creator Micro 2 keypad into a controller for my Paseo coding agents.

github.com/mattt/paseo-cr…

I've been using @moboudra's Paseo for the past month, and it's been a great fit. I was getting so much done that noticing which agents were waiting on me had become the bottleneck. Then I saw @Thom_Wolf switching between 36 sessions with a tiny Work Louder keypad, and impulse-bought one.

There were probably easier, definitely more responsible ways to solve this. But buying a cool toy seems Pareto optimal (right?). I hadn't even checked whether it was compatible. Just took a leap of faith: "Claude, take the wheel."

Fortunately, @chacon had reverse-engineered the keypad's USB HID protocol and documented it in micro-manager. Following his work, I had a working plugin within an hour. I've spent the past week polishing it, and I'm really happy with it.

The translucent key glows green when an agent is waiting for me. I tap it, and Paseo opens to that conversation, even from the background. The double-wide key is hold-to-talk. So I see green, tap, read, and hold to respond by voice.

The top rows have keys to navigate back and forth. The dial scrolls the conversation (press while scrolling to go faster), and the joystick opens a radial menu of common responses. But the next-agent key and dictation get about 90% of my use.

(The photo is AI-generated from my own pictures of the keypad, because my desk was a mess.)

View quoted post on X

Mattt @mattt Nov 3

iMCP 1.8.2 fixes a security issue: in 1.8.1 and earlier, another process on your Mac could intercept an MCP client's session with iMCP. Please update with "Check for Updates..." or brew upgrade --cask imcp, then follow the steps in the release notes:

github.com/mattt/iMCP/rel…

github.com Release 1.8.2 · mattt/iMCP ImportantThis release fixes a security vulnerability in iMCP 1.8.1 and earlier that let another process on your Mac intercept an MCP client's session with iMCP, or connect as a client that you ...

Mattt @mattt Nov 3

I made Paseo Micro: a plugin and macOS app that turns a @work_louder Creator Micro 2 keypad into a controller for my Paseo coding agents.

github.com/mattt/paseo-cr…

I've been using @moboudra's Paseo for the past month, and it's been a great fit. I was getting so much done that noticing which agents were waiting on me had become the bottleneck. Then I saw @Thom_Wolf switching between 36 sessions with a tiny Work Louder keypad, and impulse-bought one.

There were probably easier, definitely more responsible ways to solve this. But buying a cool toy seems Pareto optimal (right?). I hadn't even checked whether it was compatible. Just took a leap of faith: "Claude, take the wheel."

Fortunately, @chacon had reverse-engineered the keypad's USB HID protocol and documented it in micro-manager. Following his work, I had a working plugin within an hour. I've spent the past week polishing it, and I'm really happy with it.

The translucent key glows green when an agent is waiting for me. I tap it, and Paseo opens to that conversation, even from the background. The double-wide key is hold-to-talk. So I see green, tap, read, and hold to respond by voice.

The top rows have keys to navigate back and forth. The dial scrolls the conversation (press while scrolling to go faster), and the joystick opens a radial menu of common responses. But the next-agent key and dictation get about 90% of my use.

(The photo is AI-generated from my own pictures of the keypad, because my desk was a mess.)

Work Louder Creator Micro 2 keypad on a dark surface: twelve black keycaps, a knob, and a small joystick, with a thin teal light around its edge and one frosted key glowing green.

Mattt

Latest posts 5