Twitxy Saved

James Hall

@MrRio

Director @parallax, AWS Hero, Co-host at Off Script Podcast heypresents.com/podcast, wrote some popular JS stuff like jsPDF many moons ago
Leeds, UK parall.ax Joined March 2008
1.7K Following 3.3K Followers 5.5K Posts

Latest posts 5

James Hall @MrRio
Another weekend project, I've built another visualisation.

Commercial LLMs often don't expose their logits/logprobs. This is the chance that the next token/word appears.

What I've done:
- Pulled Llama3.3 locally from HuggingFace, converted it to GGUF for llama.cpp.
0:54