BigScience Large Model Training

@BigScienceLLM

Follow the training of "BLOOM 🌸", the @BigScienceW multilingual 176B parameter open-science open-access language model, a research tool for the AI community.

JeanZay supercomputer (France) bigscience.notion.site/BigScience-176… Joined March 2022

1 Following 8.3K Followers 129 Posts

Latest posts 5

Pinned post

BigScience Large Model Training @BigScienceLLM Jul 12, 2022

The BLOOM model is now officially released!

Read more here: bigscience.huggingface.co/blog/bloom
Find the model here: huggingface.co/bigscience/blo…

BigScience Research Workshop @BigscienceW Jul 12, 2022

BLOOM is here. The largest open-access multilingual language model ever. Read more about it or get it at
bigscience.huggingface.co/blog/bloom
hf.co/bigscience/blo…

View quoted post on X

BigScience Large Model Training @BigScienceLLM Sep 15, 2022

The super-fast inference solutions are finally here for all to use:

Stas Bekman Verified account @StasBekman Sep 15, 2022

Learn how you can get under 1msec per token generation time with BLOOM 176B model!

Not one, but multiple super-fast solutions including Deepspeed-Inference, Accelerate and Deepspeed-ZeRO!

huggingface.co/blog/bloom-inf…
View quoted post on X

BigScience Large Model Training @BigScienceLLM Jun 30, 2022

▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓ 102%

BigScience Large Model Training @BigScienceLLM Jun 29, 2022

For 111 days, we've enjoyed world-class hardware stability and throughput thanks to the hard work of our friends at @Genci_fr, @INS2I_CNRS, Megatron & DeepSpeed. Having reached our objective earlier than expected, we'll keep training for a few more days. Stay tuned, more soon ;)

BigScience Large Model Training @BigScienceLLM Jun 29, 2022

▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓ 101%