On the KV cache panel at #InferCon today: 10:55am, Room B, with Nick Khami and Charles Frye.View quoted post on X
We'll get into when to keep, move or drop the cache, and how long-running agents change the math.
At lunch I'm hosting a founders' table on speculative decoding and inference for agents.
rob tandy
@shinyrobject
make code fast. race cars fast.
life goes fast. be curious. be kind.
cognitive systems research @datadoghq
opinions are my own
life goes fast. be curious. be kind.
cognitive systems research @datadoghq
opinions are my own
50 Following 34 Followers 31 Posts
Latest posts 5
The song of the siren
You’ll want to hear this.View quoted post on X
For the drivers, with an all-motor heart born from racing.
Ford Mustang Cobra, a Legacy Reborn.
The story continues in 2027.
I just saw this cast in #Cleveland last night! They were incredible! I can't wait to see this wonderful musical again. I am so moved
View quoted post on X
I voted. Yay!!
I wanted to rewrite some go hot loops so that they didn't use the heap. Goose looked perfect and I wanted to get around cgo, so I made a go compiler backend:
github.com/robtandy/goose…
Based on the C backed Goose language by @wvo
github.com/robtandy/goose…
Based on the C backed Goose language by @wvo