Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

82,888

Full-text search

Active filters: conversational

anthracite-org/magnum-v4-12b-gguf

Text Generation • Updated 22 days ago • 10k • 13

RichardErkhov/ruchi012_-_saul-7B-merged-3000-gguf

Updated Oct 10 • 35 • 1

bartowski/qwen2.5-7b-ins-v3-GGUF

Text Generation • Updated Oct 10 • 2.97k • 9

mmnga/tokyotech-llm-Llama-3.1-Swallow-70B-Instruct-v0.1-gguf

Updated Oct 10 • 2k • 2

NikolayKozloff/qwen2.5-7b-ins-v3-Q8_0-GGUF

Updated Oct 10 • 20 • 1

QuantFactory/Gemma-2-Ataraxy-v3i-9B-GGUF

Updated Oct 10 • 83 • 1

mav23/Qwen2.5-32B-Instruct-GGUF

Text Generation • Updated Oct 10 • 264 • 1

Chainbase-Labs/Theia-Llama-3.1-8B-v1

Text Generation • Updated Oct 10 • 535 • 10

QuantFactory/Rombos-LLM-V2.5.1-Qwen-3b-GGUF

Updated Oct 10 • 369 • 1

sheldonrobinson/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Oct 10 • 13 • 1

mradermacher/MedNarra-X1.0-GGUF

Updated Oct 10 • 280 • 1

mradermacher/Gemma-2-Ataraxy-v3-Advanced-9B-GGUF

Updated Oct 11 • 221 • 1

mradermacher/Zinakha-12b-GGUF

Updated Oct 11 • 201 • 1

mav23/Vikhr-Nemo-12B-Instruct-R-21-09-24-GGUF

Updated Oct 10 • 3.5k • 2

QuantFactory/llama-7b-GGUF

Updated Oct 10 • 100 • 1

mradermacher/Gemma-2-Ataraxy-v3-Advanced-9B-i1-GGUF

Updated Oct 11 • 234 • 2

Triangle104/Mahou-1.5-mistral-nemo-12B-Q4_K_S-GGUF

Updated 28 days ago • 13 • 1

Triangle104/Mahou-1.5-mistral-nemo-12B-Q4_K_M-GGUF

Updated 28 days ago • 14 • 1

Triangle104/Mahou-1.5-mistral-nemo-12B-Q5_K_S-GGUF

Updated Oct 10 • 3 • 1

Triangle104/Mahou-1.5-mistral-nemo-12B-Q5_K_M-GGUF

Updated Oct 10 • 10 • 1

Triangle104/Mahou-1.5-mistral-nemo-12B-Q6_K-GGUF

Updated Oct 10 • 31 • 1

mradermacher/Zinakha-12b-i1-GGUF

Updated Oct 11 • 384 • 1

mav23/Llama3.2-3B-Enigma-GGUF

Text Generation • Updated Oct 10 • 310 • 1

nguyenpham95/lora_model

Updated 28 days ago • 143 • 1

Rewatiramans/Dermatech-Qwen2-VL-2B

Text Generation • Updated 30 days ago • 107 • 1

Triangle104/Mahou-1.5-mistral-nemo-12B-Q8_0-GGUF

Updated Oct 10 • 15 • 1

gair-prox/math-doc-refining-lm

Text Generation • Updated Oct 10 • 24 • 2

elsatch/salamandra-7b-instruct-Q8_0-GGUF

Text Generation • Updated Oct 10 • 30 • 1

KingNish/Reasoning-Llama-3b-v0.1

Text Generation • Updated Oct 12 • 399 • 9

ChenmieNLP/Zephyr-7B-Beta-Helpful

Text Generation • Updated Oct 10 • 12 • 1