Twitxy Saved

Morgan Funtowicz

@MorganFunto

Machine Learning Engineer - @HuggingFace / Paris πŸ‡«πŸ‡·
Paris Joined May 2012
315 Following 1.6K Followers 319 Posts

Latest posts 5

Morgan Funtowicz @MorganFunto
Your local AI just got more Windows-native πŸ¦™

Llama for Windows v0.13.0 is out!

πŸ–ΌοΈ Share images & text to Llama
⚑ Speculative decoding support
πŸ’» See which models likely fit your hardware
πŸ”— llama:// deep links
Give it a spin πŸ‘‡
github.com/ggml-org/Llama…
github.com Release v0.13.0 Β· ggml-org/Llama-Windows Highlights Speculative decoding, wired automatically β€” models that ship a draft head (mtp / dflash / dspark) now run up to ~2Γ— faster with identical output. The app detects the head from Hub repos...
Morgan Funtowicz @MorganFunto
Hey @Windows users, local AI is for you tooπŸ₯³
Llama for Windows v0.12.0 is out!

πŸ–₯️ llama.cpp in your Windows 11 tray
πŸ€— Download models in one click
😎 Improved UX flow

πŸ‘‰ github.com/ggml-org/Llama…
github.com Release v0.12.0 Β· ggml-org/Llama-Windows Highlights Search Hugging Face from the app β€” browse and download any of the Hub's GGUF models straight from the model list, with suggestions as you type, download progress, failure reasons th...
0 replies 3 reposts 12 likes 3.2K views View on X
Morgan Funtowicz @MorganFunto
Serving @OpenAI Whisper, powered by @vllm_project, deployed on @huggingface Inference Endpoint, with astonishing @Gradio demo ... What else? 😎

AI community is all you need to create blazing fast whisper transcriptions πŸ’₯πŸš€

More in our blog πŸ“° huggingface.co/blog/fast-whis…
huggingface.co Blazingly fast whisper transcriptions with Inference Endpoints We’re on a journey to advance and democratize artificial intelligence through open source and open science.