Not-For-All-Audiences

Eval Results

Inference Endpoints

Model card Files Files and versions Community

Quantum-Citrus-9B-GGUF-IQ-Imatrix

1 contributor

History: 12 commits

ABX-AI

Rename Quantum-Citrus-v2-9B-Q5_K_M-imat.gguf to Quantum-Citrus-9B-Q5_K_M-imat.gguf

4c9023a verified 11 months ago

.gitattributes

2.87 kB

Rename Quantum-Citrus-v2-9B-Q5_K_M-imat.gguf to Quantum-Citrus-9B-Q5_K_M-imat.gguf 11 months ago
Quantum-Citrus-9B-IQ3_M-imat.gguf

4.06 GB
LFS

Rename Quantum-Citrus-v2-9B-IQ3_M-imat.gguf to Quantum-Citrus-9B-IQ3_M-imat.gguf 11 months ago
Quantum-Citrus-9B-IQ3_S-imat.gguf

3.94 GB
LFS

Rename Quantum-Citrus-v2-9B-IQ3_S-imat.gguf to Quantum-Citrus-9B-IQ3_S-imat.gguf 11 months ago
Quantum-Citrus-9B-IQ3_XXS-imat.gguf

3.5 GB
LFS

Rename Quantum-Citrus-v2-9B-IQ3_XXS-imat.gguf to Quantum-Citrus-9B-IQ3_XXS-imat.gguf 11 months ago
Quantum-Citrus-9B-IQ4_NL-imat.gguf

5.11 GB
LFS

Rename Quantum-Citrus-v2-9B-IQ4_NL-imat.gguf to Quantum-Citrus-9B-IQ4_NL-imat.gguf 11 months ago
Quantum-Citrus-9B-IQ4_XS-imat.gguf

4.84 GB
LFS

Rename Quantum-Citrus-v2-9B-IQ4_XS-imat.gguf to Quantum-Citrus-9B-IQ4_XS-imat.gguf 11 months ago
Quantum-Citrus-9B-Q4_K_M-imat.gguf

5.42 GB
LFS

Rename Quantum-Citrus-v2-9B-Q4_K_M-imat.gguf to Quantum-Citrus-9B-Q4_K_M-imat.gguf 11 months ago
Quantum-Citrus-9B-Q4_K_S-imat.gguf

5.13 GB
LFS

Rename Quantum-Citrus-v2-9B-Q4_K_S-imat.gguf to Quantum-Citrus-9B-Q4_K_S-imat.gguf 11 months ago
Quantum-Citrus-9B-Q5_K_M-imat.gguf

6.36 GB
LFS

Rename Quantum-Citrus-v2-9B-Q5_K_M-imat.gguf to Quantum-Citrus-9B-Q5_K_M-imat.gguf 11 months ago
Quantum-Citrus-v2-9B-Q5_K_S-imat.gguf

6.2 GB
LFS

Upload 11 files 11 months ago
Quantum-Citrus-v2-9B-Q6_K-imat.gguf

7.37 GB
LFS

Upload 11 files 11 months ago
README.md

2.34 kB

Update README.md 11 months ago
imatrix.dat

6.24 MB
LFS

Upload 11 files 11 months ago