Twitxy Saved

vaish

@wishee0

workflows @cloudflare
⛏️ Joined September 2022
719 Following 709 Followers 4.2K Posts

Latest posts 5

vaish @wishee0
It's been a hot minute since I've blogged, so I wrote up the issues I kept running into while building a @Cloudflare World for @vercel's @workflowsdk.

spoiler: giving every run its own Durable Object made it slower :P

wishee.medium.com/running-vercel…
vaish @wishee0 2d
I've wanted to build a @Cloudflare World for @vercel's @workflowsdk for a while. The SDK is pluggable, so the whole backend lives in userland, on Workers, Durable Objects, R2 and so on. It's also my first dive into the Workflow SDK!

github.com/vaishnav-mk/wo…
View quoted post on X
1 replies 2 reposts 19 likes 1.3K views View on X
vaish @wishee0
I hammered the absolute fuck out of DOs and Workers on this without throwing more DOs, I tried to make the ones I had faster instead
5k-way fan-out: 683s to 41s with batching
1k steps: 65s to 4s with a separate step lane, same shard count

so much more I want to talk about here
vaish @wishee0 2d
numbers depend on the workflow, but fancy numbers go brrr:

100k runs admitted at ~5k/s, all done in 89s
30k parallel steps in 4.5 min
30k sequential steps in one run
resume after 10k steps in 185ms (quickjs snapshots ftw!)
a 1.75 GiB stream in ~3 min
world-cloudflare.vaishnav.one/docs/benchmarks
View quoted post on X
vaish @wishee0
numbers depend on the workflow, but fancy numbers go brrr:

100k runs admitted at ~5k/s, all done in 89s
30k parallel steps in 4.5 min
30k sequential steps in one run
resume after 10k steps in 185ms (quickjs snapshots ftw!)
a 1.75 GiB stream in ~3 min
world-cloudflare.vaishnav.one/docs/benchmarks
vaish @wishee0 2d
I've wanted to build a @Cloudflare World for @vercel's @workflowsdk for a while. The SDK is pluggable, so the whole backend lives in userland, on Workers, Durable Objects, R2 and so on. It's also my first dive into the Workflow SDK!

github.com/vaishnav-mk/wo…
View quoted post on X
vaish @wishee0
I didn't write the queue plumbing from scratch: my world's queue runs on @avenceslau's durability package!!

Each blazingly fast durable object queue shard gets batched delivery, retries with backoff, dedups and dead letters, all on one shared alarm

github.com/avenceslau/dur…
vaish @wishee0 2d
I've wanted to build a @Cloudflare World for @vercel's @workflowsdk for a while. The SDK is pluggable, so the whole backend lives in userland, on Workers, Durable Objects, R2 and so on. It's also my first dive into the Workflow SDK!

github.com/vaishnav-mk/wo…
View quoted post on X
0 replies 0 reposts 12 likes 1.3K views View on X