Twitxy Saved

Joe Fioti

Verified account This account is verified. Learn more

@joefioti

ceo @luminal_ai

delivering superintelligence to the proletariat.
San Francisco, CA luminal.com Joined June 2015
521 Following 3.7K Followers 2.1K Posts

Latest posts 5

Joe Fioti Verified account @joefioti
For some reason (probably my GPU MODE talk) people think Luminal is a megakernel™️ company.

We are not! They are one (of many) possibilities our compiler searches over, and are often not the right solution for a given workload. Sometimes they are, sometimes they aren’t, and it’s often not knowable beforehand. Search wins here!
Dylan Lim Verified account @dylan__lim 17h
Last Year We Built Megakernels. This Year We Deleted Them.

One year ago, we helped introduce some of the first AI megakernels to the world. Since then, we’ve enjoyed seeing their wide adoption from friends and researchers. However, while whole model megakernels are a helpful abstraction, we’ve found that they overcomplicate and are not always an ideal optimization target.

Below, we discuss our journey to understand and push past these limitations. We start with a deep dive into two contrasting paradigms of ML optimization – Torch Compile and Megakernels
View quoted post on X
1 replies 1 reposts 48 likes 2.3K views View on X