metadata
base_model:
- huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2
library_name: transformers
tags:
- abliterated
- uncensored
- DeepSeek-R1-Distill-Qwen-7B
language:
- en
pipeline_tag: text-generation
Melvin56/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2-GGUF
Original Model : huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2
All quants are made using the imatrix option
| Model | Size | Params |
|---|---|---|
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q3_K_M | 3.54 GB | 7.62B |
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q4_0 | 4.13 GB | 7.62B |
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q4_K_M | 4.36 GB | 7.62B |
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q5_K_M | 5.07 GB | 7.62B |
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q6_K | 5.82 GB | 7.62B |
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q8_0 | 7.54 GB | 7.62B |
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 F16 | 14.19 GB | 7.62B |