Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer

Abliterated version of Qwen/Qwen2.5-32B-Instruct, utilizing code from refusal_direction.

For more information about the Abliterated technique, refer to this article and check out @FailSpy.

GGUF

Try to remove admonition and moral appeal

Downloads last month
14
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for zetasepic/Qwen2.5-32B-Instruct-abliterated-v2-6.5bpw-exl2

Base model

Qwen/Qwen2.5-32B
Quantized
(126)
this model