| base_model: "deepseek-ai/DeepSeek-R1-Distill-Qwen-7B" | |
| language: | |
| - en | |
| tags: | |
| - transformers | |
| - safetensors | |
| - qwen2 | |
| - text-generation | |
| - conversational | |
| - autotrain_compatible | |
| - text-generation-inference | |
| - endpoints_compatible | |
| - region:us | |
| license: "unknown" | |
| inference: false | |
| quantized_by: pbatra | |
| # DeepSeek-R1-Distill-Qwen-7B | |
| This repository contains quantized versions of the model from the original repository: [deepseek-ai/DeepSeek-R1-Distill-Qwen-7B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-7B). | |
| | Name | Quantization Method | Size (GB) | | |
| |------|---------------------|-----------| | |
| | deepseek-r1-distill-qwen-7b.Q8_0.gguf | q8_0 | 7.54 | | |
| | deepseek-r1-distill-qwen-7b.Q4_0.gguf | q4_0 | 4.13 | | |