Edit Models filters

Model Tree

deepseek-ai/DeepSeek-R1-Distill-Llama-8B

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

89

Full-text search

Active filters: deepseek-ai/DeepSeek-R1-Distill-Llama-8B

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q3_K_L-GGUF

Text Generation • Updated 13 days ago • 31

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q4_K_S-GGUF

Text Generation • Updated 13 days ago • 6

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q4_K_M-GGUF

Text Generation • Updated 13 days ago • 30

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q5_0-GGUF

Text Generation • Updated 13 days ago • 27

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q5_K_S-GGUF

Text Generation • Updated 13 days ago • 25

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q5_K_M-GGUF

Text Generation • Updated 13 days ago • 43

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q6_K-GGUF

Text Generation • Updated 13 days ago • 94

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q8_0-GGUF

Text Generation • Updated 13 days ago • 498

jakiAJK/DeepSeek-R1-Distill-Llama-8B_GPTQ-int4

Text Generation • Updated 13 days ago • 385

jakiAJK/DeepSeek-R1-Distill-Llama-8B_AWQ

Text Generation • Updated 13 days ago • 889

XelotX/DeepSeek-R1-Distill-Llama-8B-GGUF

Updated 13 days ago • 1.58k

mlx-community/DeepSeek-R1-Distill-Llama-8B-4bit-mlx

Updated 13 days ago • 1.08k

mlx-community/DeepSeek-R1-Distill-Llama-8B-8bit-mlx

Updated 13 days ago • 153

jesusoctavioas/DeepSeek-R1-Distill-Llama-8B-MLX-Q4

Updated 11 days ago • 7

mlx-community/DeepSeek-R1-Distill-Llama-8B-3bit

Updated 13 days ago • 15.2k

mlx-community/DeepSeek-R1-Distill-Llama-8B-6bit

Updated 13 days ago • 3.19k

numen-tech/DeepSeek-R1-Distill-Llama-8B-w4a16g128asym

Text Generation • Updated 13 days ago

mlc-ai/DeepSeek-R1-Distill-Llama-8B-q4f16_1-MLC

Updated 12 days ago • 899

mlc-ai/DeepSeek-R1-Distill-Llama-8B-q0f16-MLC

Updated 12 days ago • 4

mlc-ai/DeepSeek-R1-Distill-Llama-8B-q4f32_1-MLC

Updated 12 days ago • 519

pbatra/DeepSeek-R1-Distill-Llama-8B-GGUF

Text Generation • Updated 13 days ago • 519

Cran-May/DeepSeek-R1-Distill-Llama-8B-Q5_K_M-GGUF

Updated 12 days ago • 747

Cran-May/DeepSeek-R1-Distill-Llama-8B-IQ4_NL-GGUF

Updated 12 days ago • 130

featherless-ai-quants/deepseek-ai-DeepSeek-R1-Distill-Llama-8B-GGUF

Text Generation • Updated 10 days ago • 593

osllmai-community/DeepSeek-R1-Distill-Llama-8B-GGUF

Updated 5 days ago • 2.07k

brunosk/DeepSeek-R1-Distill-Llama-8B-Q4_K_M-GGUF

Updated 9 days ago • 11

vankhoa/DeepSeek-R1-Distill-Llama-8B-Q4_K_M-GGUF

Updated 8 days ago • 9

Triangle104/DeepSeek-R1-Distill-Llama-8B-Q4_K_S-GGUF

Updated 8 days ago • 37

Triangle104/DeepSeek-R1-Distill-Llama-8B-Q4_K_M-GGUF

Updated 8 days ago • 126

Triangle104/DeepSeek-R1-Distill-Llama-8B-Q5_K_S-GGUF

Updated 8 days ago • 45