Edit Datasets filters

Levantine Arabic

Egyptian Arabic

Moroccan Arabic

Iranian Persian

Ta'izzi-Adeni Arabic

Central Kurdish

Waray (Philippines)

Tunisian Arabic

Northern Kurdish

Luo (Kenya and Tanzania)

Nepali (individual language)

Mesopotamian Arabic

South Azerbaijani

Standard Latvian

Swahili (individual language)

North Azerbaijani

Nigerian Fulfulde

Southern Pashto

Plateau Malagasy

Ayacucho Quechua

Central Atlas Tamazight

Southwestern Dinka

West Central Oromo

Eastern Yiddish

Standard Arabic

Languages with no match

Datasets

43

Full-text search

Active filters: apc

HuggingFaceFW/fineweb-2

Viewer • Updated Jan 8 • 12.5B • 46.2k • 491

google/smol

Viewer • Updated Mar 3 • 811k • 1.39k • 58

facebook/flores

Updated Jan 18, 2024 • 10.7k • 78

openlanguagedata/flores_plus

Viewer • Updated Mar 23 • 868k • 3.53k • 45

allenai/tulu-3-sft-mixture

Viewer • Updated Dec 2, 2024 • 939k • 9.81k • 152

allenai/tulu-3-sft-olmo-2-mixture

Viewer • Updated Dec 2, 2024 • 939k • 871 • 44

vpermilp/nllb-200-distilled-600M-rust

Updated Mar 4, 2023 • 77 • 1

vpermilp/nllb-200-1.3B-rust

Updated Mar 4, 2023 • 92 • 4

CohereLabs/xP3x

Viewer • Updated 20 days ago • 434M • 154k • 88

CohereLabs/aya_dataset

Viewer • Updated Apr 15 • 206k • 2.06k • 309

ramybaly/arsentd_lev

Updated Jan 18, 2024 • 78 • 3

Helsinki-NLP/tatoeba

Updated Jan 18, 2024 • 2.11k • 47

Muennighoff/flores200

Updated Jan 7, 2024 • 1.77k • 15

visheratin/laion-coco-nllb

Viewer • Updated Apr 11, 2024 • 894k • 1.23k • 43

Muennighoff/xP3x-sample

Viewer • Updated Sep 18, 2023 • 28.4k • 1.22k • 3

cis-lmu/Glot500

Viewer • Updated Jun 17, 2024 • 1.23B • 2.3k • 37

lbourdois/language_tags

Viewer • Updated Jan 21, 2024 • 27.3k • 92 • 7

ayymen/Weblate-Translations

Viewer • Updated Apr 2, 2024 • 11.7M • 1.21k • 15

lbourdois/panlex

Viewer • Updated Feb 3, 2024 • 24.6M • 63 • 8

Davlan/sib200

Viewer • Updated Feb 19, 2024 • 206k • 1.15k • 16

Felladrin/ChatML-aya_dataset

Viewer • Updated Feb 17, 2024 • 202k • 47 • 1

jaygala24/xsimplusplus

Viewer • Updated May 1, 2024 • 816k • 61 • 1

mteb/sib200

Viewer • Updated May 6 • 412k • 1.99k • 2

mteb/flores

Viewer • Updated May 4 • 2.01k • 161

cis-lmu/GlotCC-V1

Viewer • Updated Nov 1, 2024 • 1.28B • 473 • 51

gentaiscool/bitext_sib200_miners

Viewer • Updated Jun 18, 2024 • 287k • 176 • 3

Svngoku/xP3x-Kongo

Viewer • Updated Jun 24, 2024 • 1.22M • 17 • 3

espnet/mms_ulab_v2

Viewer • Updated Feb 4 • 20.7k • 675 • 18

robinhad/long_flores

Updated Aug 29, 2024 • 32

FrancophonIA/gatitos

Updated Mar 30 • 106 • 2