Edit Datasets filters

Central Kurdish

Luo (Kenya and Tanzania)

Waray (Philippines)

Northern Kurdish

South Azerbaijani

North Azerbaijani

Plateau Malagasy

Levantine Arabic

Southwestern Dinka

West Central Oromo

Standard Latvian

Nepali (individual language)

Southern Pashto

Ayacucho Quechua

Swahili (individual language)

Egyptian Arabic

Nigerian Fulfulde

Eastern Yiddish

Tunisian Arabic

Moroccan Arabic

Iranian Persian

Central Atlas Tamazight

Mesopotamian Arabic

Languages with no match

Datasets

57

Full-text search

Active filters: hne

openlanguagedata/flores_plus

Viewer • Updated Mar 23 • 868k • 3.06k • 46

HuggingFaceFW/fineweb-2

Viewer • Updated Jan 8 • 12.5B • 44k • 491

google/smol

Viewer • Updated Mar 3 • 811k • 1.53k • 58

Helsinki-NLP/kde4

Updated Jan 18, 2024 • 784 • 24

facebook/flores

Updated Jan 18, 2024 • 10.6k • 78

vpermilp/nllb-200-distilled-600M-rust

Updated Mar 4, 2023 • 85 • 1

vpermilp/nllb-200-1.3B-rust

Updated Mar 4, 2023 • 98 • 4

CohereLabs/xP3x

Viewer • Updated 23 days ago • 434M • 156k • 88

Svngoku/xP3x-Kongo

Viewer • Updated Jun 24, 2024 • 1.22M • 19 • 4

espnet/mms_ulab_v2

Viewer • Updated Feb 4 • 20.7k • 793 • 19

Helsinki-NLP/opus_ubuntu

Viewer • Updated Feb 22, 2024 • 37.4k • 173 • 4

Muennighoff/flores200

Updated Jan 7, 2024 • 1.76k • 15

visheratin/laion-coco-nllb

Viewer • Updated Apr 11, 2024 • 894k • 1.44k • 43

Muennighoff/xP3x-sample

Viewer • Updated Sep 18, 2023 • 28.4k • 1.28k • 3

slone/nllb-200-10M-sample

Viewer • Updated Nov 20, 2023 • 9.98M • 102 • 10

cis-lmu/Glot500

Viewer • Updated Jun 17, 2024 • 1.23B • 2.33k • 37

lbourdois/language_tags

Viewer • Updated Jan 21, 2024 • 27.3k • 95 • 7

ayymen/Weblate-Translations

Viewer • Updated Apr 2, 2024 • 11.7M • 1.35k • 15

lbourdois/panlex

Viewer • Updated Feb 3, 2024 • 24.6M • 65 • 8

Davlan/sib200

Viewer • Updated Feb 19, 2024 • 206k • 1.15k • 16

iAkashPaul/limmits-2024

Preview • Updated Apr 23, 2024 • 103 • 2

jaygala24/xsimplusplus

Viewer • Updated May 1, 2024 • 816k • 67 • 1

google/IndicGenBench_xorqa_in

Updated May 4, 2024 • 712 • 2

google/IndicGenBench_flores_in

Updated May 4, 2024 • 601 • 7

google/IndicGenBench_crosssum_in

Updated May 4, 2024 • 191 • 7

mteb/sib200

Viewer • Updated May 6 • 412k • 1.47k • 2

mteb/flores

Viewer • Updated May 4 • 2.01k • 160

cis-lmu/GlotCC-V1

Viewer • Updated Nov 1, 2024 • 1.28B • 510 • 51

gentaiscool/bitext_sib200_miners

Viewer • Updated Jun 18, 2024 • 287k • 172 • 3

robinhad/long_flores

Updated Aug 29, 2024 • 31