Twitxy Saved

rob tandy

@shinyrobject

make code fast. race cars fast.
life goes fast. be curious. be kind.

cognitive systems research @datadoghq
opinions are my own
Joined June 2012
50 Following 34 Followers 31 Posts

Latest posts 5

rob tandy @shinyrobject
That was super fun! Thanks @charles_irl @zhijianliu and @skeptrune !
Zhijian Liu Verified account @zhijianliu 7h
On the KV cache panel at #InferCon today: 10:55am, Room B, with Nick Khami and Charles Frye.

We'll get into when to keep, move or drop the cache, and how long-running agents change the math.

At lunch I'm hosting a founders' table on speculative decoding and inference for agents.
View quoted post on X
0 replies 1 reposts 5 likes 2.3K views View on X
rob tandy @shinyrobject
I wanted to rewrite some go hot loops so that they didn't use the heap. Goose looked perfect and I wanted to get around cgo, so I made a go compiler backend:

github.com/robtandy/goose…

Based on the C backed Goose language by @wvo
github.com GitHub - robtandy/goose.go: Go backend and pure-Go mmap Data Stack runtime for the Goose programm... Go backend and pure-Go mmap Data Stack runtime for the Goose programming language - robtandy/goose.go