Twitxy Saved

Zain

Verified account Together AI

@zainhas

I build and teach AI • AI/ML @togethercompute • EngSci ℕΨ/PhD @UofT • Previously: vector DBs, data scientist, lecturer & health tech founder • 🇺🇸🇨🇦🇵🇰
SF⇄Toronto zainhas.github.io Joined August 2012
2.2K Following 8.9K Followers 6.2K Posts

Latest posts 5

Zain Verified account @zainhas
the prefix cache is all important for agentic workloads

in this deepdive we discuss how to preserve it from both the agent client side + the inference engine perspective
Together AI @togethercompute 9h
coding agents resend the whole conversation on every turn. prefix caching keeps long sessions fast, but only if the harness and the inference engine both do their part.

@zainhas from Together and @parthsareen from @ollama wrote down what each side needs to get right.

together.ai/blog/making-op…
View quoted post on X
1 replies 0 reposts 10 likes 1.1K views View on X
Zain Verified account @zainhas
the @noeri_ai team is absolutely cracked

super high talent density
Danqi Chen Verified account @danqi_chen 13h
I joined @noeri_ai part-time two months ago.

It has been a blast! I’m very impressed by the team that Yejin and Carlos (@guestrin) have built. Everyone is incredibly talented and kind, and it’s been so much fun working together.

I’m especially excited about plural AI for scientific discovery, where every scientist can aim AI at their own hard problems.

At a personal level, I am grateful that I’ve finally had the opportunity to work with my long-time role model and friend @YejinChoinka.

We are hiring in Palo Alto and Zurich. The picture is me working from the Zurich office this week :)
View quoted post on X