Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
AbominationScience-12B-v4-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
refs/pr/1
AbominationScience-12B-v4-GGUF
1 contributor
History:
7 commits
MaziyarPanahi
9f920c9b9c51cede510bd11d968356efd5009c778133f2757e80b460626e2d1c
f6a42b0
verified
about 2 months ago
.gitattributes
Safe
1.96 kB
9f920c9b9c51cede510bd11d968356efd5009c778133f2757e80b460626e2d1c
about 2 months ago
AbominationScience-12B-v4-GGUF_imatrix.dat
7.05 MB
LFS
9f920c9b9c51cede510bd11d968356efd5009c778133f2757e80b460626e2d1c
about 2 months ago
AbominationScience-12B-v4.Q5_K_M.gguf
8.73 GB
LFS
07762d1c8c9a2157c8f801dc2a6b88efaf706397bfb789911eba69bd59c213f9
about 2 months ago
AbominationScience-12B-v4.Q5_K_S.gguf
8.52 GB
LFS
5fe2c85b66e256f47bf2ee036ccc1b9722324bc39c4bcfc28efc15a9f1910a91
about 2 months ago
AbominationScience-12B-v4.Q6_K.gguf
10.1 GB
LFS
98689a86a1e10189c1c987784fe5a6938d51028d23f87e3266da646ef7a5a575
about 2 months ago
AbominationScience-12B-v4.Q8_0.gguf
13 GB
LFS
d2b99fff1008bdc82180c59afc5c2ba7274e853e5b73d07422573f81faf22f39
about 2 months ago
AbominationScience-12B-v4.fp16.gguf
24.5 GB
LFS
cdfd9be84b2005e1acb00e8c2ee4783513065a6833ce8e033ca1d4e48206f09f
about 2 months ago
README.md
Safe
3.03 kB
9f920c9b9c51cede510bd11d968356efd5009c778133f2757e80b460626e2d1c
about 2 months ago