Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
DeepSeek-R1-Distill-Llama-3B-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
refs/pr/1
DeepSeek-R1-Distill-Llama-3B-GGUF
1 contributor
History:
7 commits
MaziyarPanahi
2c91ae562a1cedec9eaea65b6889065a92af308a6415008905b353e46f1d80c0
a260c5e
verified
1 day ago
.gitattributes
Safe
1.98 kB
2c91ae562a1cedec9eaea65b6889065a92af308a6415008905b353e46f1d80c0
1 day ago
DeepSeek-R1-Distill-Llama-3B-GGUF_imatrix.dat
2.99 MB
LFS
2c91ae562a1cedec9eaea65b6889065a92af308a6415008905b353e46f1d80c0
1 day ago
DeepSeek-R1-Distill-Llama-3B.Q5_K_M.gguf
Safe
2.32 GB
LFS
165b2e57f097ccedfbeb24c471240b47ec1ce415d8ea4ce17a84253163668b95
1 day ago
DeepSeek-R1-Distill-Llama-3B.Q5_K_S.gguf
Safe
2.27 GB
LFS
4f503aab25077fd3801b116a36491f87dc7e3273992c0f377635d178939af768
1 day ago
DeepSeek-R1-Distill-Llama-3B.Q6_K.gguf
Safe
2.64 GB
LFS
9d980c19c6ef831f96712807691f92dcba03f1136a562b1d703fe078b0583e1b
1 day ago
DeepSeek-R1-Distill-Llama-3B.Q8_0.gguf
Safe
3.42 GB
LFS
15e07dbfe71328ff230578517c6885f4585c4386d1730ca3ffe011f29edd68b9
1 day ago
DeepSeek-R1-Distill-Llama-3B.fp16.gguf
Safe
6.43 GB
LFS
5dee8d752178ced8d2876edcf83b0fc40975bc1cfb3553e258b549dab92d7be1
1 day ago
README.md
Safe
3.06 kB
2c91ae562a1cedec9eaea65b6889065a92af308a6415008905b353e46f1d80c0
1 day ago
