Lesto, a new MLX-based inference engine for @googlegemma 4.
My personal local AI experiment.
The fastest of the 6 MLX engines I tested on a Mac.
Based on a stripped down MLX-Serve by @ddalcu + custom optimizations and optionally with its own optimized checkpoint.
My personal local AI experiment.
The fastest of the 6 MLX engines I tested on a Mac.
Based on a stripped down MLX-Serve by @ddalcu + custom optimizations and optionally with its own optimized checkpoint.