README.md

---
base_model: "deepseek-ai/DeepSeek-R1-Distill-Qwen-7B"
language:
  - en
tags:
  - transformers
  - safetensors
  - qwen2
  - text-generation
  - conversational
  - autotrain_compatible
  - text-generation-inference
  - endpoints_compatible
  - region:us
license: "unknown"
inference: false
quantized_by: pbatra
---

# DeepSeek-R1-Distill-Qwen-7B

This repository contains quantized versions of the model from the original repository: [deepseek-ai/DeepSeek-R1-Distill-Qwen-7B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-7B).

| Name | Quantization Method | Size (GB) |
|------|---------------------|-----------|
| deepseek-r1-distill-qwen-7b.Q8_0.gguf | q8_0 | 7.54 |
| deepseek-r1-distill-qwen-7b.Q4_0.gguf | q4_0 | 4.13 |