---
base_model:
- huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2
library_name: transformers
tags:
- abliterated
- uncensored
- DeepSeek-R1-Distill-Qwen-7B
language:
- en
pipeline_tag: text-generation
---

# Melvin56/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2-GGUF

Original Model : [huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2](https://huggingface.co/huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2)

All quants are made using the imatrix option

| Model                                            |   Size   | Params  |
|:-------------------------------------------------|:--------:|:-------:|
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q3_K_M |  3.54 GB | 7.62B  |
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q4_0   |  4.13 GB | 7.62B  |
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q4_K_M |  4.36 GB | 7.62B  |
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q5_K_M |  5.07 GB | 7.62B  |
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q6_K   |  5.82 GB | 7.62B  |
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q8_0   |  7.54 GB | 7.62B  |
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 F16    | 14.19 GB | 7.62B  |