Twitxy Saved

OpenEuroLLM

@OpenEuroLLM

A series of foundation models for transparent AI in Europe
Joined June 2024
5 Following 485 Followers 29 Posts

Latest posts 5

OpenEuroLLM @OpenEuroLLM
A series of technical reports from our project, like the one just posted by our colleague @kleiaaro, will try to provide answers to the many questions that LLM training teams cope with around the globe.

This one is about training recipes 👇
Aaron Klein @kleiaaro Sep 1
🚀 How do you choose the right LLM training recipe? We just released a tech report on the scaling-law pipeline of @OpenEuroLLM 🇪🇺, along with the corresponding checkpoints, data, and code.
arxiv.org/abs/2608.28308 1/N 🧵
View quoted post on X
OpenEuroLLM @OpenEuroLLM
Our 9B experimental WIP model now named

🎼 PRELUDE

is still training but we are sharing intermediate checkpoints for transparency:

🛑 WIP research artifact.
🛑 NOT cooled down yet.
✔️Include validation across 36 languages.

Full WIP model card👇huggingface.co/openeurollm/pr…
huggingface.co openeurollm/prelude-base · Hugging Face Machine learning model. Download, explore files and run it on Hugging Face.