Edit Datasets filters

Iranian Persian

Swahili (individual language)

Nepali (individual language)

Egyptian Arabic

Central Kurdish

South Azerbaijani

Luo (Kenya and Tanzania)

Southwestern Dinka

Waray (Philippines)

Moroccan Arabic

Levantine Arabic

Standard Latvian

Plateau Malagasy

West Central Oromo

Northern Kurdish

North Azerbaijani

Ayacucho Quechua

Ta'izzi-Adeni Arabic

Languages with no match

Datasets

54

Full-text search

Active filters: pes

facebook/flores

Updated Jan 18, 2024 • 10.6k • 78

openlanguagedata/flores_plus

Viewer • Updated Mar 23 • 868k • 3.06k • 46

Helsinki-NLP/tatoeba

Updated Jan 18, 2024 • 2.02k • 48

vpermilp/nllb-200-distilled-600M-rust

Updated Mar 4, 2023 • 85 • 1

vpermilp/nllb-200-1.3B-rust

Updated Mar 4, 2023 • 98 • 4

CohereLabs/xP3x

Viewer • Updated 22 days ago • 434M • 156k • 88

CohereLabs/aya_dataset

Viewer • Updated Apr 15 • 206k • 2.09k • 309

Svngoku/xP3x-Kongo

Viewer • Updated Jun 24, 2024 • 1.22M • 19 • 4

espnet/mms_ulab_v2

Viewer • Updated Feb 4 • 20.7k • 793 • 19

allenai/tulu-3-sft-mixture

Viewer • Updated Dec 2, 2024 • 939k • 9.73k • 152

Helsinki-NLP/bible_para

Updated Jan 18, 2024 • 169 • 18

community-datasets/tapaco

Viewer • Updated Jun 26, 2024 • 3.85M • 4.42k • 46

bible-nlp/biblenlp-corpus

Updated Dec 5, 2024 • 150 • 33

mteb/tatoeba-bitext-mining

Viewer • Updated May 4 • 176k • 522 • 7

Muennighoff/flores200

Updated Jan 7, 2024 • 1.76k • 15

visheratin/laion-coco-nllb

Viewer • Updated Apr 11, 2024 • 894k • 1.44k • 43

Muennighoff/xP3x-sample

Viewer • Updated Sep 18, 2023 • 28.4k • 1.28k • 3

cis-lmu/udhr-lid

Viewer • Updated Jul 20, 2024 • 27.8k • 31 • 8

cis-lmu/Glot500

Viewer • Updated Jun 17, 2024 • 1.23B • 2.33k • 37

lbourdois/language_tags

Viewer • Updated Jan 21, 2024 • 27.3k • 95 • 7

lbourdois/panlex

Viewer • Updated Feb 3, 2024 • 24.6M • 65 • 8

Davlan/sib200

Viewer • Updated Feb 19, 2024 • 206k • 1.15k • 16

CohereLabs/aya_collection

Viewer • Updated Apr 15 • 514M • 17.4k • 222

CohereLabs/aya_evaluation_suite

Viewer • Updated Apr 15 • 26.8k • 1.11k • 50

Felladrin/ChatML-aya_dataset

Viewer • Updated Feb 17, 2024 • 202k • 55 • 1

CohereLabs/aya_collection_language_split

Viewer • Updated Apr 15 • 514M • 21.9k • 99

cointegrated/panlex-meanings

Viewer • Updated Apr 1 • 157M • 190 • 10

loicmagne/tatoeba-bitext-mining

Viewer • Updated Apr 25, 2024 • 178k • 160

davidstap/biblenlp-corpus-mmteb

Viewer • Updated Apr 26, 2024 • 1.74M • 1.04k • 2

jaygala24/xsimplusplus

Viewer • Updated May 1, 2024 • 816k • 67 • 1