Upload README.md with huggingface_hub

README.md

@@ -0,0 +1,27 @@
+---
+base_model: "deepseek-ai/DeepSeek-R1-Distill-Qwen-7B"
+language:
+  - en
+tags:
+  - transformers
+  - safetensors
+  - qwen2
+  - text-generation
+  - conversational
+  - autotrain_compatible
+  - text-generation-inference
+  - endpoints_compatible
+  - region:us
+license: "unknown"
+inference: false
+quantized_by: pbatra
+---
+
+# DeepSeek-R1-Distill-Qwen-7B
+
+This repository contains quantized versions of the model from the original repository: [deepseek-ai/DeepSeek-R1-Distill-Qwen-7B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-7B).
+
+| Name | Quantization Method | Size (GB) |
+|------|---------------------|-----------|
+| deepseek-r1-distill-qwen-7b.Q8_0.gguf | q8_0 | 7.54 |
+| deepseek-r1-distill-qwen-7b.Q4_0.gguf | q4_0 | 4.13 |