Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

AetherArchitectural
/

GGUF-Quantization-Script

Text Generation

text-generation-inference

Model card Files Files and versions Community

GGUF-Quantization-Script

5 contributors

History: 26 commits

FantasiaFoundry's picture

FantasiaFoundry

Atribute credits directly.

0f7005a verified 9 months ago

imatrix
Upload 2 files 11 months ago
.gitattributes

1.52 kB

initial commit 11 months ago
README.md

2.53 kB

Atribute credits directly. 9 months ago
gguf-imat.py

8.33 kB

Add checks for F16.gguf and imatrix.dat, as well make HF model removal optional by default. (#11) 9 months ago