File size: 889 Bytes
d5f7f03
 
fdcbf3b
 
 
 
 
 
 
d5f7f03
 
fdcbf3b
d5f7f03
fdcbf3b
d5f7f03
fdcbf3b
d5f7f03
fdcbf3b
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
---
base_model:
- mobiuslabsgmbh/DeepSeek-R1-ReDistill-Qwen-7B-v1.1
library_name: transformers
tags:
- DeepSeek-R1-Distill-Qwen-7B
language:
- en
pipeline_tag: text-generation
---

# Melvin56/DeepSeek-R1-ReDistill-Qwen-7B-v1.1-GGUF

Original Model : [mobiuslabsgmbh/DeepSeek-R1-ReDistill-Qwen-7B-v1.1](https://huggingface.co/mobiuslabsgmbh/DeepSeek-R1-ReDistill-Qwen-7B-v1.1)

All quants are made using the imatrix option

| Model                                            |   Size (GB)   | Params  |
|:-------------------------------------------------|:-------------:|:-------:|
| Q2_K_S |  2.82 GB | 7.62B  |
| Q2_K |  3.01 GB | 7.62B  |
| Q3_K_M |  3.80 GB | 7.62B  |
| Q3_K_M |  3.80 GB | 7.62B  |
| Q4_0   |  4.43 GB | 7.62B  |
| Q4_K_M |  4.68 GB | 7.62B  |
| Q5_K_M |  5.45 GB | 7.62B  |
| Q6_K   |  6.25 GB | 7.62B  |
| Q8_0   |  8.10 GB | 7.62B  |
| F16    | 15.23 GB | 7.62B  |