Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,658

Full-text search

Active filters: 6-bit

MaziyarPanahi/EZO-Llama-3.2-3B-Instruct-dpoE-GGUF

Text Generation • Updated Nov 2 • 54 • 1

MaziyarPanahi/Llama-3-8B-Stroganoff-4.0-GGUF

Text Generation • Updated Nov 2 • 138 • 1

MaziyarPanahi/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-GGUF

Text Generation • Updated Nov 2 • 154 • 1

MaziyarPanahi/SmolLM2-135M-Instruct-GGUF

Text Generation • Updated Nov 3 • 658 • 1

MaziyarPanahi/SmolLM2-360M-Instruct-GGUF

Text Generation • Updated Nov 3 • 189 • 2

MaziyarPanahi/BioMistral-Clinical-7B-GGUF

Text Generation • Updated Nov 6 • 6.38k • 1

MaziyarPanahi/Mistral-Crab-DPO-GGUF

Text Generation • Updated Nov 7 • 53 • 2

MaziyarPanahi/MN-Tiramisu-12B-GGUF

Text Generation • Updated Nov 7 • 117 • 1

MaziyarPanahi/calme-3.1-instruct-3b-GGUF

Text Generation • Updated Nov 15 • 513 • 1

MaziyarPanahi/calme-3.3-instruct-3b-GGUF

Text Generation • Updated Nov 15 • 390 • 2

MaziyarPanahi/calme-3.1-qwenloi-3b-GGUF

Text Generation • Updated Nov 15 • 768 • 1

MaziyarPanahi/calme-3.2-llamaloi-3b-GGUF

Text Generation • Updated Nov 15 • 118 • 1

MaziyarPanahi/NuExtract-1.5-smol-GGUF

Text Generation • Updated Nov 15 • 243 • 7

MaziyarPanahi/Mistral-Large-Instruct-2411-GGUF

Text Generation • Updated Nov 20 • 675k • 1

mlx-community/Qwen2.5-Coder-32B-Instruct-6bit

Text Generation • Updated Nov 23 • 139 • 1

BigHuggyD/TheDrummer_Behemoth-123B-v2.2_exl2_6.0bpw_h6

Updated 29 days ago • 45 • 1

imnotednamode/OuteTTS-0.2-500M-exl2-b6.0-hb8

Text-to-Speech • Updated 27 days ago • 34 • 1

mlx-community/INTELLECT-1-Instruct-6bit

Text Generation • Updated 22 days ago • 24 • 1

Dracones/QwQ-32B-Preview_exl2_6.0bpw

Text Generation • Updated 22 days ago • 26 • 1

MaziyarPanahi/Sailor2-1B-Chat-GGUF

Text Generation • Updated 21 days ago • 696k • 3

MaziyarPanahi/Sailor2-8B-Chat-GGUF

Text Generation • Updated 20 days ago • 402 • 3

MaziyarPanahi/Sailor2-20B-Chat-GGUF

Text Generation • Updated 20 days ago • 479 • 2

MaziyarPanahi/Ninja-V3-nsfw-enhance-GGUF

Text Generation • Updated 18 days ago • 328 • 1

MaziyarPanahi/SAINEMO-reMIX-GGUF

Text Generation • Updated 18 days ago • 168 • 1

mlx-community/Llama-3.3-70B-Instruct-6bit

Text Generation • Updated 18 days ago • 311 • 5

MaziyarPanahi/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated 17 days ago • 1.54M • 8

LoneStriker/Llama-3.3-70B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated 18 days ago • 95 • 2

MaziyarPanahi/Pleias-Nano-GGUF

Text Generation • Updated 17 days ago • 339 • 3

MaziyarPanahi/EXAONE-3.5-2.4B-Instruct-GGUF

Text Generation • Updated 15 days ago • 335 • 1

MaziyarPanahi/EXAONE-3.5-7.8B-Instruct-GGUF

Text Generation • Updated 15 days ago • 218 • 1