Melvin56/DeepSeek-R1-ReDistill-Qwen-7B-v1.1-GGUF

Original Model : mobiuslabsgmbh/DeepSeek-R1-ReDistill-Qwen-7B-v1.1

All quants are made using the imatrix option

Model Size (GB) Params
Q2_K_S 2.82 GB 7.62B
Q2_K 3.01 GB 7.62B
Q3_K_M 3.80 GB 7.62B
Q3_K_M 3.80 GB 7.62B
Q4_0 4.43 GB 7.62B
Q4_K_M 4.68 GB 7.62B
Q5_K_M 5.45 GB 7.62B
Q6_K 6.25 GB 7.62B
Q8_0 8.10 GB 7.62B
F16 15.23 GB 7.62B
Downloads last month
115
GGUF
Model size
7.62B params
Architecture
qwen2

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for Melvin56/DeepSeek-R1-ReDistill-Qwen-7B-v1.1-GGUF

Collection including Melvin56/DeepSeek-R1-ReDistill-Qwen-7B-v1.1-GGUF