Twitxy Saved

OSCAR

@oscarnlp

The Open Super-large Crawled Aggregated coRpus
oscar-project.org Joined April 2021
27 Following 321 Followers 46 Posts

Latest posts 5

Pinned post

OSCAR @oscarnlp
📣 The OSCAR Project and @DFKI are happy to announce the release of Colossal OSCAR 1.0 📚, which is now available on the @huggingface Hub 🤗 at huggingface.co/datasets/oscar…

Colossal OSCAR 1.0 was put together by @pjox13 as part of the @OpenGPTX collaboration.
huggingface.co oscar-corpus/colossal-oscar-1.0 · Datasets at Hugging Face Dataset. Explore, preview and download it on Hugging Face.
2 replies 15 reposts 52 likes 16K views View on X
OSCAR @oscarnlp
👇Take a look at the ROOTS corpus put together by @BigscienceW 🌸

We're proud to see that the version 21.09 of OSCAR accounts for 38% of ROOTS. More information about this version can be found on oscar-project.org/post/oscar-v21…
Saulnier Lucile @LucileSaulnier Nov 28, 2022
🌸How was ROOTS built?

The final corpus is made up of:
1️⃣ 62% from a community-selected and documented list of language data source (aka Crowdsourced Datasets)
2️⃣ 38% from a pre-processed web crawl, OSCAR filtered with the help of native speakers
View quoted post on X