We are proud to announce 
text
We are proud to announce 
https://huggingface.co/datasets/HuggingFaceFW/fineweb-2
HuggingFaceFW/fineweb-2
dataset
resource
https://huggingface.co/datasets/HuggingFaceFW/fineweb-2
: A sparkling update to 
text
: A sparkling update to 
https://huggingface.co/datasets/HuggingFaceFW/fineweb
HuggingFaceFW/fineweb
dataset
resource
https://huggingface.co/datasets/HuggingFaceFW/fineweb
 with 1000s of 🗣️languages.
text
 with 1000s of 🗣️languages.
new_line
new_line
We applied the same data-driven approach that led to SOTA English performance in🍷 FineWeb to thousands of languages.
text
We applied the same data-driven approach that led to SOTA English performance in🍷 FineWeb to thousands of languages.
new_line
new_line
🥂 FineWeb2 has 8TB of compressed text data and outperforms other multilingual datasets in our experiments.
text
🥂 FineWeb2 has 8TB of compressed text data and outperforms other multilingual datasets in our experiments.
new_line
new_line
The dataset is released under the permissive 📜 ODC-By 1.0 license, and the 💻 code to reproduce it and our evaluations is public.
text
The dataset is released under the permissive 📜 ODC-By 1.0 license, and the 💻 code to reproduce it and our evaluations is public.
new_line
new_line
We will very soon announce a big community project, and are working on a 📝 blogpost walking you through the entire dataset creation process. Stay tuned!
text
We will very soon announce a big community project, and are working on a 📝 blogpost walking you through the entire dataset creation process. Stay tuned!
new_line
new_line
In the mean time come ask us question on our chat place: 
text
In the mean time come ask us question on our chat place: 
https://huggingface.co/spaces/HuggingFaceFW/discussion
https://huggingface.co/spaces/HuggingFaceFW/discussion
link
new_line
new_line
H/t 
text
H/t 
@guipenedo
mention
guipenedo
text
@hynky
mention
hynky
text
@lvwerra
mention
lvwerra
 as well as 
text
 as well as 
@vsabolcec
mention
vsabolcec
 Bettina Messmer 
text
 Bettina Messmer 
@negar-foroutan
mention
negar-foroutan
 and 
text
 and 
@mjaggi
mention
mjaggi
text
new_line
We are proud to announce https://huggingface.co/datasets/HuggingFaceFW/fineweb-2: A sparkling update to https://huggingface.co/datasets/HuggingFaceFW/fineweb with 1000s of 🗣️languages.

We applied the same data-driven approach that led to SOTA English performance in🍷 FineWeb to thousands of languages.

🥂 FineWeb2 has 8TB of compressed text data and outperforms other multilingual datasets in our experiments.

The dataset is released under the permissive 📜 ODC-By 1.0 license, and the 💻 code to reproduce it and our evaluations is public.

We will very soon announce a big community project, and are working on a 📝 blogpost walking you through the entire dataset creation process. Stay tuned!

In the mean time come ask us question on our chat place: https://huggingface.co/spaces/HuggingFaceFW/discussion

H/t @guipenedo @hynky @lvwerra as well as @vsabolcec Bettina Messmer @negar-foroutan and @mjaggi 

🚀
linoyts lvwerra victor AdinaY stefan-it John6666 clem yasirkayaalp ToKrCZ mexicanamerican raghavprabhakar Martins6 davanstrien Felladrin fdaudens AtAndDev ayymen BrigitteTousi xi0v negar-foroutan FM-1976 pcuenq
🔥
fffiloni clem raghavprabhakar Martins6 gabe-cha AtAndDev BrigitteTousi iky1e negar-foroutan Steveeeeeeen pcuenq
🤗
prithivMLmods Martins6 AtAndDev BrigitteTousi 1024m negar-foroutan pcuenq
👀
aloobun AtAndDev BrigitteTousi
👍
Rsln negar-foroutan
630f3e4002ce39336c411048
https://cdn-avatars.huggingface.co/v1/production/uploads/630f3e4002ce39336c411048/Dbb855C55XdPd3rRH9auc.jpeg
alkinun
AtAndDev
user
5e48005437cb5b49818287a5
https://cdn-avatars.huggingface.co/v1/production/uploads/5e48005437cb5b49818287a5/4uCXGGui-9QifAT4qelxU.png
Leandro von Werra
lvwerra
user