Hey folks, I’ve just wrapped up some work at Graphcore on numerics, FP4 pre-training and inference, and wanted to share it here:
arxiv.org/abs/2609.02846
arxiv.org/abs/2610.00053
arxiv.org/abs/2609.04105
arxiv.org/abs/2610.00049
Four papers, a few things we learned 🧵
arxiv.org/abs/2609.02846
arxiv.org/abs/2610.00053
arxiv.org/abs/2609.04105
arxiv.org/abs/2610.00049
Four papers, a few things we learned 🧵