Colin Kealty

@bartowski1182

LLM Enthusiast

huggingface.co/bartowski

github.com/bartowski1182

ko-fi.com/bartowski

Joined February 2024

184 Following 3.3K Followers 811 Posts

Latest posts 5

Just posted another blog post on @huggingface, this time about new tensor-type layouts in llama.cpp 🤗

huggingface.co/blog/bartowski…

I shout them out in there but I'll do it again here, this research was largely powered by @FrameworkPuter Desktop 👀

Colin Kealty @bartowski1182 Aug 17

Made a short blog post about most recent imatrix dataset experiments :)

Enjoy! huggingface.co/blog/bartowski…

huggingface.co New imatrix dataset A Blog post by Bartowski on Hugging Face

Colin Kealty @bartowski1182 Jun 5

Anyone know what happened to Yorkie..?

I guess I'm a bit late to the party, but seems they went and deleted their discord, X, and github :( if you're out there Yorkie, hope you're okay, feel free to DM or email, just to let me know you're alive

Colin Kealty @bartowski1182 Mar 10

Forgot to update the Qwen 0.8B - 9B models with the F32 ssm_alpha and ssm_beta weights, redoing now :)

If you were getting lower performance, in particular speed-wise, it may do you well to redownload (especially on strix halo apparently?)

Colin Kealty @bartowski1182 Mar 6

Alright, I've added the mean and 99.9% KLD, and the mean and same top P statistics to huggingface.co/bartowski/Qwen… README

This is more of a one-off, but I will explore doing it more regularly in the future, just gotta figure out how best to handle with my limited GPU compute :)