We worked with @liangsu325045, the creator of FlashRT, to port FlashRT to @AMD GPUs (first CDNA4, then CDNA3)!
Along the way, we found that FP8 actually slows down π0.5’s decoder. So we wrote a custom BF16 path for CDNA3 instead.
35ms π0.5, 19.6ms GR00T.
What we learned 🧵👇
Along the way, we found that FP8 actually slows down π0.5’s decoder. So we wrote a custom BF16 path for CDNA3 instead.
35ms π0.5, 19.6ms GR00T.
What we learned 🧵👇
0:11