Hugging Face's logo

ABX-AI
/
Cosmic-Citrus-9B-GGUF-IQ-Imatrix

Transformers
GGUF
mergekit
Merge
Not-For-All-Audiences
Inference Endpoints
Model card Files Community
ABX-AI commited on
Commit
89694cf
·
verified ·
1 Parent(s): 5e37aaf

Upload 11 files

Browse files
Files changed (12) hide show
  1. .gitattributes +11 -0
  2. Cosmic-Citrus-9B-IQ3_M-imat.gguf +3 -0
  3. Cosmic-Citrus-9B-IQ3_S-imat.gguf +3 -0
  4. Cosmic-Citrus-9B-IQ3_XXS-imat.gguf +3 -0
  5. Cosmic-Citrus-9B-IQ4_NL-imat.gguf +3 -0
  6. Cosmic-Citrus-9B-IQ4_XS-imat.gguf +3 -0
  7. Cosmic-Citrus-9B-Q4_K_M-imat.gguf +3 -0
  8. Cosmic-Citrus-9B-Q4_K_S-imat.gguf +3 -0
  9. Cosmic-Citrus-9B-Q5_K_M-imat.gguf +3 -0
  10. Cosmic-Citrus-9B-Q5_K_S-imat.gguf +3 -0
  11. Cosmic-Citrus-9B-Q6_K-imat.gguf +3 -0
  12. imatrix.dat +3 -0
.gitattributes CHANGED
@@ -33,3 +33,14 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Cosmic-Citrus-9B-IQ3_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Cosmic-Citrus-9B-IQ3_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Cosmic-Citrus-9B-IQ3_XXS-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Cosmic-Citrus-9B-IQ4_NL-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Cosmic-Citrus-9B-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Cosmic-Citrus-9B-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Cosmic-Citrus-9B-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Cosmic-Citrus-9B-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Cosmic-Citrus-9B-Q5_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Cosmic-Citrus-9B-Q6_K-imat.gguf filter=lfs diff=lfs merge=lfs -text
46
+ imatrix.dat filter=lfs diff=lfs merge=lfs -text
Cosmic-Citrus-9B-IQ3_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7cff3a0fd86e1669c8ab17309f649bd366a1aa04184ade3e48b85ef0d82c40b6
3
+ size 4064970720
Cosmic-Citrus-9B-IQ3_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:09a6cb9f1fb3d403c758c3c0bb9714bbd484d33e3686da17e9323a84b285f48a
3
+ size 3936847840
Cosmic-Citrus-9B-IQ3_XXS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1cf455bd340e2c78885c0673b8ddf584aee2edb53970530e1baaba475399ebd5
3
+ size 3497388000
Cosmic-Citrus-9B-IQ4_NL-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7130613a492a12bb42e10169493c13dae696d8a305ea28dcf9303d7818b036eb
3
+ size 5111621600
Cosmic-Citrus-9B-IQ4_XS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c21631bb0980f916e7d81c5f7af7a4ab49e3fc28ab1fe6309373632a5f62ef73
3
+ size 4840138720
Cosmic-Citrus-9B-Q4_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d652d5a42ddf8d1701cd8c4f3a5855f872143f95435f863ed78a244fafda766
3
+ size 5415053280
Cosmic-Citrus-9B-Q4_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df1b85881bdcf864d384bdf6c5405b035b6536c303afb48cd2ef8d56292faa2f
3
+ size 5129447392
Cosmic-Citrus-9B-Q5_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45755c66539e6f858104013b88411dbb6c314dc97960f33a1bc7f6b8f09344ae
3
+ size 6364669920
Cosmic-Citrus-9B-Q5_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fb448f5ae80ea34cc90a1e481f16ed3466d4d8682614102f06d0d1fc535505f4
3
+ size 6197553120
Cosmic-Citrus-9B-Q6_K-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3565e783de172c105a9488bb8e2afc85800e84a1d3798d3838e0ec8ca29e2f06
3
+ size 7373637600
imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa2c084eb2b0ec7d0a156b84526909b3601f381dd9db2bce92cc1f7331a1e940
3
+ size 6235174