metadata
base_model: deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
language:
- en
tags:
- transformers
- safetensors
- qwen2
- text-generation
- conversational
- autotrain_compatible
- text-generation-inference
- endpoints_compatible
- region:us
license: unknown
inference: false
quantized_by: pbatra
DeepSeek-R1-Distill-Qwen-7B
This repository contains quantized versions of the model from the original repository: deepseek-ai/DeepSeek-R1-Distill-Qwen-7B.
| Name | Quantization Method | Size (GB) |
|---|---|---|
| deepseek-r1-distill-qwen-7b.Q8_0.gguf | q8_0 | 7.54 |
| deepseek-r1-distill-qwen-7b.Q4_0.gguf | q4_0 | 4.13 |