--- base_model: - mobiuslabsgmbh/DeepSeek-R1-ReDistill-Qwen-7B-v1.1 library_name: transformers tags: - DeepSeek-R1-Distill-Qwen-7B language: - en pipeline_tag: text-generation --- # Melvin56/DeepSeek-R1-ReDistill-Qwen-7B-v1.1-GGUF Original Model : [mobiuslabsgmbh/DeepSeek-R1-ReDistill-Qwen-7B-v1.1](https://huggingface.co/mobiuslabsgmbh/DeepSeek-R1-ReDistill-Qwen-7B-v1.1) All quants are made using the imatrix option | Model | Size (GB) | Params | |:-------------------------------------------------|:-------------:|:-------:| | Q2_K_S | 2.82 GB | 7.62B | | Q2_K | 3.01 GB | 7.62B | | Q3_K_M | 3.80 GB | 7.62B | | Q3_K_M | 3.80 GB | 7.62B | | Q4_0 | 4.43 GB | 7.62B | | Q4_K_M | 4.68 GB | 7.62B | | Q5_K_M | 5.45 GB | 7.62B | | Q6_K | 6.25 GB | 7.62B | | Q8_0 | 8.10 GB | 7.62B | | F16 | 15.23 GB | 7.62B |