Edit Datasets filters

Waray (Philippines)

Central Kurdish

Egyptian Arabic

Swahili (individual language)

Northern Kurdish

Moroccan Arabic

South Azerbaijani

Luo (Kenya and Tanzania)

Southern Pashto

Eastern Yiddish

Standard Latvian

Nepali (individual language)

North Azerbaijani

Southwestern Dinka

Nigerian Fulfulde

Languages with no match

Datasets

69

Full-text search

Active filters: awa

wikimedia/wikipedia

Viewer • Updated Jan 9, 2024 • 61.6M • 75k • 841

HuggingFaceFW/fineweb-2

Viewer • Updated Jan 8 • 12.5B • 45.1k • 491

facebook/flores

Updated Jan 18, 2024 • 10.1k • 78

CohereLabs/xP3x

Viewer • Updated 18 days ago • 434M • 157k • 88

lbourdois/language_tags

Viewer • Updated Jan 21, 2024 • 27.3k • 75 • 7

openlanguagedata/flores_plus

Viewer • Updated Mar 23 • 868k • 3.59k • 44

google/smol

Viewer • Updated Mar 3 • 811k • 1.22k • 56

kmi-linguistics/ilist

Viewer • Updated Aug 8, 2024 • 90.4k • 99 • 1

Helsinki-NLP/tatoeba

Updated Jan 18, 2024 • 2.18k • 47

sil-ai/bloom-lm

Updated Oct 21, 2022 • 32 • 29

sil-ai/bloom-captioning

Updated Dec 10, 2022 • 10 • 12

sil-ai/bloom-vist

Viewer • Updated Dec 6, 2022 • 9.14k • 147 • 6

mteb/tatoeba-bitext-mining

Viewer • Updated May 4 • 176k • 533 • 7

Muennighoff/flores200

Updated Jan 7, 2024 • 1.79k • 15

vpermilp/nllb-200-distilled-600M-rust

Updated Mar 4, 2023 • 67

vpermilp/nllb-200-1.3B-rust

Updated Mar 4, 2023 • 89 • 3

graelo/wikipedia

Viewer • Updated Sep 10, 2023 • 105M • 10.2k • 66

visheratin/laion-coco-nllb

Viewer • Updated Apr 11, 2024 • 894k • 1.03k • 43

Muennighoff/xP3x-sample

Viewer • Updated Sep 18, 2023 • 28.4k • 1.17k • 3

cyanic-selkie/wikianc

Viewer • Updated Sep 5, 2023 • 269M • 665 • 5

slone/nllb-200-10M-sample

Viewer • Updated Nov 20, 2023 • 9.98M • 91 • 10

lbourdois/panlex

Viewer • Updated Feb 3, 2024 • 24.6M • 59 • 8

Davlan/sib200

Viewer • Updated Feb 19, 2024 • 206k • 1.17k • 16

loicmagne/tatoeba-bitext-mining

Viewer • Updated Apr 25, 2024 • 178k • 135

jaygala24/xsimplusplus

Viewer • Updated May 1, 2024 • 816k • 54 • 1

google/IndicGenBench_xorqa_in

Updated May 4, 2024 • 646 • 2

google/IndicGenBench_flores_in

Updated May 4, 2024 • 643 • 7

google/IndicGenBench_crosssum_in

Updated May 4, 2024 • 182 • 7

mteb/sib200

Viewer • Updated May 6 • 412k • 2.06k • 2

mteb/flores

Viewer • Updated May 4 • 2.01k • 150