|
--- |
|
base_model: |
|
- huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 |
|
library_name: transformers |
|
tags: |
|
- abliterated |
|
- uncensored |
|
- DeepSeek-R1-Distill-Qwen-7B |
|
language: |
|
- en |
|
pipeline_tag: text-generation |
|
--- |
|
|
|
# Melvin56/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2-GGUF |
|
|
|
Original Model : [huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2](https://huggingface.co/huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2) |
|
|
|
All quants are made using the imatrix option |
|
|
|
| Model | Size | Params | |
|
|:-------------------------------------------------|:--------:|:-------:| |
|
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q3_K_M | 3.54 GB | 7.62B | |
|
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q4_0 | 4.13 GB | 7.62B | |
|
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q4_K_M | 4.36 GB | 7.62B | |
|
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q5_K_M | 5.07 GB | 7.62B | |
|
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q6_K | 5.82 GB | 7.62B | |
|
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q8_0 | 7.54 GB | 7.62B | |
|
| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 F16 | 14.19 GB | 7.62B | |
|
|
