Twitxy Saved

Jeffrey Morgan

Verified account ollama

@jmorgan

Palo Alto ollama.com Joined September 2010
183 Following 6.7K Followers 2.5K Posts

Latest posts 5

Jeffrey Morgan Verified account @jmorgan
State of the art on-device coding. Lightning fast on Apple Silicon and RTX/DGX spark with @ollama.
ollama Verified account @ollama Oct 21
Meet Flint from @Recursive_SI! A ~40B parameter MoE open model for fast, accurate agentic coding use case made to run on-device.

Flint can generate >125 tps on a M4 Pro Macbook Pro and >150 tps on a 64GB NVIDIA RTX Spark on short contexts.

Try it on Ollama today:
ollama run flint

Claude Code:
ollama launch claude --model flint
View quoted post on X
0 replies 0 reposts 13 likes 1.2K views View on X
Jeffrey Morgan Verified account @jmorgan
Many concerns this weekend about slowing down AI, some targeting open models.

We need to be responsible. But we can't let this slow down, or worse, prohibit open models. It's the wrong risk. Open models have tremendous power to democratize AI and make it more personal.

The larger risk I see with open models is right in front of us: in the last week I've read about how many popular platforms quietly send data to foreign jurisdictions, or worse, sell or train on it to gain an advantage. And this is becoming more and more mainstream.

Now more than ever open model vendors must act in the user's best interest, not their own: zero data retention or training, and hosting in the user's region vs sending data overseas.

This has been our belief and commitment with @ollama. Nobody needs to slow down open models. We need to distribute and run them in a way users can trust.
8 replies 11 reposts 78 likes 9.3K views View on X
Jeffrey Morgan Verified account @jmorgan
Small models are truly capable of the majority of conversational use cases and even a majority of difficult reasoning ones. Amazing work @Avanika15 @JonSaadFalcon + team and great feature in @FT !
Avanika Narayan Verified account @Avanika15 Sep 11
dreams do come true 🥹. excited to see our work (w/@JonSaadFalcon, @HazyResearch, john hennessy and @Azaliamirh) feat. in a major way in @FT. the world is becoming increasingly less dependent on centralized cloud ai. we are just getting started 🚀🌖
View quoted post on X