Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

26,184

Full-text search

Active filters: 8-bit

microsoft/bitnet-b1.58-2B-4T

Text Generation • Updated May 1 • 15.5k • 1.05k

HF1BitLLM/Llama3-8B-1.58-100B-tokens

Text Generation • Updated Sep 19, 2024 • 2.5k • 186

lmstudio-community/DeepSeek-R1-0528-Qwen3-8B-MLX-8bit

Text Generation • Updated 11 days ago • 408k • 4

speakleash/Bielik-11B-v2.6-Instruct-MLX-8bit

Text Generation • Updated 4 days ago • 105 • 2

RedHatAI/gemma-3-27b-it-quantized.w8a8

Image-Text-to-Text • Updated about 11 hours ago • 19 • 2

Qwen/Qwen1.5-4B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 45 • 6

MaziyarPanahi/ChatMusician-GGUF

Text Generation • Updated Mar 2, 2024 • 333 • 13

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 1.59k • 128

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 18, 2024 • 1.39k • 33

atcsecure/dolphin-2.9-llama3-70b-8.0bpw-h8-exl2

Text Generation • Updated May 2, 2024 • 42 • 2

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9, 2024 • 2.02k • 25

brunopio/Llama3-8B-1.58-100B-tokens-GGUF

Text Generation • Updated Sep 19, 2024 • 2.36k • 16

MaziyarPanahi/ruadapt_qwen2.5_3B_ext_u48_instruct_v4-GGUF

Text Generation • Updated Oct 30, 2024 • 47 • 1

LucidityAI/pico-mini-v1-.5b

Text Generation • Updated Dec 27, 2024 • 17 • 1

Zoont/faster-whisper-large-v3-turbo-int8-ct2

Automatic Speech Recognition • Updated Jan 31 • 254 • 5

RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w8a8

Image-Text-to-Text • Updated Apr 3 • 1.58k • 5

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8

Image-Text-to-Text • Updated 10 days ago • 9.45k • 5

lmstudio-community/Qwen3-30B-A3B-MLX-8bit

Text Generation • Updated Apr 29 • 42k • 8

premkumarkora/qwen3-shakespeare-final

Text Generation • Updated 24 days ago • 8 • 1

MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF

Text Generation • Updated 11 days ago • 67.2k • 3

mlx-community/Josiefied-DeepSeek-R1-0528-Qwen3-8B-abliterated-v1-8bit

Text Generation • Updated 11 days ago • 1.02k • 1

Disya/DeepSeek-R1-0528-Qwen3-8B-exl2-8bpw-h8

Text Generation • Updated 10 days ago • 42 • 1

Cosmobillian/qwen2_5-turkish-vlm

Updated 8 days ago • 145 • 1

mlx-community/plamo-2-translate-8bit

Text Generation • Updated 5 days ago • 39 • 1

mlx-community/ether0-8bit

Text Generation • Updated 4 days ago • 18 • 1

ReadyArt/Omega-Darkest_The-Broken-Tutu-GLM-32B_EXL3_8.0bpw_H8

Text Generation • Updated 15 days ago • 12 • 2

ReadyArt/Forgotten-Safeword-22B-V3.0_EXL2_8.0bpw_H8

Updated Mar 12 • 6 • 1

ReadyArt/Forgotten-Safeword-24B-V3.0_EXL2_8.0bpw_H8

Updated Mar 12 • 15 • 1

ReadyArt/ReadyArt_Forgotten-Safeword-8B-V3.0_EXL2_8bpw_H8

Updated Mar 12 • 4 • 1

echarlaix/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic

Text Classification • Updated Jun 13, 2023 • 1.59k • 1