Joseph717171
/

DeepSeek-R1-Distill-Llama-8B-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF

GGUF

Inference Endpoints

imatrix

conversational

Model card Files Files and versions Community

DeepSeek-R1-Distill-Llama-8B-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF / README.md

Joseph717171

Create README.md

5a013b7 verified about 2 months ago

preview code

raw

history blame contribute delete

255 Bytes

Custom GGUF quants of deepseek-ai/DeepSeek-R1-Distill-Llama-8B, where the Output Tensors are quantized to Q8_0 or upcast to F32, while the Embeddings are kept at F32. Enjoy! 🧠🔥🚀