Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
featherless-ai-quants
/
huihui-ai-Qwen2.5-32B-Instruct-abliterated-GGUF
like
0
Follow
Quants by Featherless.ai
33
Text Generation
GGUF
Inference Endpoints
conversational
Model card
Files
Files and versions
Community
Deploy
Use this model
main
huihui-ai-Qwen2.5-32B-Instruct-abliterated-GGUF
1 contributor
History:
2 commits
m8than
Upload folder using huggingface_hub
811a9b5
verified
9 days ago
huihui-ai-Qwen2.5-32B-Instruct-abliterated-Q6_K
Upload folder using huggingface_hub
9 days ago
huihui-ai-Qwen2.5-32B-Instruct-abliterated-Q8_0
Upload folder using huggingface_hub
9 days ago
.gitattributes
Safe
4.52 kB
Upload folder using huggingface_hub
9 days ago
README.md
Safe
3.7 kB
Upload folder using huggingface_hub
9 days ago
featherless-quants.png
Safe
1.61 MB
LFS
Upload folder using huggingface_hub
9 days ago
huihui-ai-Qwen2.5-32B-Instruct-abliterated-IQ4_XS.gguf
Safe
17.9 GB
LFS
Upload folder using huggingface_hub
9 days ago
huihui-ai-Qwen2.5-32B-Instruct-abliterated-Q2_K.gguf
Safe
12.3 GB
LFS
Upload folder using huggingface_hub
9 days ago
huihui-ai-Qwen2.5-32B-Instruct-abliterated-Q3_K_L.gguf
Safe
17.2 GB
LFS
Upload folder using huggingface_hub
9 days ago
huihui-ai-Qwen2.5-32B-Instruct-abliterated-Q3_K_M.gguf
Safe
15.9 GB
LFS
Upload folder using huggingface_hub
9 days ago
huihui-ai-Qwen2.5-32B-Instruct-abliterated-Q3_K_S.gguf
Safe
14.4 GB
LFS
Upload folder using huggingface_hub
9 days ago
huihui-ai-Qwen2.5-32B-Instruct-abliterated-Q4_K_M.gguf
Safe
19.9 GB
LFS
Upload folder using huggingface_hub
9 days ago
huihui-ai-Qwen2.5-32B-Instruct-abliterated-Q4_K_S.gguf
Safe
18.8 GB
LFS
Upload folder using huggingface_hub
9 days ago
huihui-ai-Qwen2.5-32B-Instruct-abliterated-Q5_K_M.gguf
Safe
23.3 GB
LFS
Upload folder using huggingface_hub
9 days ago
huihui-ai-Qwen2.5-32B-Instruct-abliterated-Q5_K_S.gguf
Safe
22.6 GB
LFS
Upload folder using huggingface_hub
9 days ago