File size: 1,133 Bytes
0f4b74f
 
9e42ba4
0f4b74f
 
 
 
cc8a26c
9e42ba4
 
 
0f4b74f
 
bbb38cf
 
9e42ba4
5e22d5a
02613d0
 
c3bd39d
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
---
base_model:
- huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2
library_name: transformers
tags:
- abliterated
- uncensored
- DeepSeek-R1-Distill-Qwen-7B
language:
- en
pipeline_tag: text-generation
---

# Melvin56/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2-GGUF

Original Model : [huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2](https://huggingface.co/huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2)

All quants are made using the imatrix option

| Model                                            |   Size   | Params  |
|:-------------------------------------------------|:--------:|:-------:|
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q3_K_M |  3.54 GB | 7.62B  |
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q4_0   |  4.13 GB | 7.62B  |
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q4_K_M |  4.36 GB | 7.62B  |
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q5_K_M |  5.07 GB | 7.62B  |
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q6_K   |  5.82 GB | 7.62B  |
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q8_0   |  7.54 GB | 7.62B  |
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 F16    | 14.19 GB | 7.62B  |