Hugging Face's logo

AetherArchitectural
/
GGUF-Quantization-Script

Text Generation
GGUF
quantized
text-generation-inference
Model card Files Community
37
FantasiaFoundry commited on
Commit
7bde159
·
verified ·
1 Parent(s): 32d703a

Expand example.

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -10,7 +10,7 @@ tags:
10
 
11
  **GGUF-IQ-Imatrix-Quantization-Script:**
12
 
13
- ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65ddabb9bbffb280f4b45d8e/zQNp-muoarsSglA8cyHal.png)
14
 
15
  Simple python script (`gguf-imat.py`) to generate various GGUF-IQ-Imatrix quantizations from a Hugging Face `author/model` input, for Windows and NVIDIA hardware.
16
 
 
10
 
11
  **GGUF-IQ-Imatrix-Quantization-Script:**
12
 
13
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65ddabb9bbffb280f4b45d8e/vwlPdqxrSdILCHM24n_M2.png)
14
 
15
  Simple python script (`gguf-imat.py`) to generate various GGUF-IQ-Imatrix quantizations from a Hugging Face `author/model` input, for Windows and NVIDIA hardware.
16