We’ve scaled @ZyphraAI’s subquadratic attention method - ZHA - to leading open source multi-trillion parameter models across Nemotron, Qwen, Mimo, and GPT-OSS!
ZHA preserves reasoning and agentic performance while delivering 9-60x long-context speedups at 10M tokens.
ZHA preserves reasoning and agentic performance while delivering 9-60x long-context speedups at 10M tokens.