Hugging Face's logo

Lewdiculous
/
L3-TheSpice-8b-v0.1.3-GGUF-IQ-Imatrix

GGUF
Inference Endpoints
imatrix
Model card Files Community
3
Lewdiculous commited on
Commit
2cb04e3
•
1 Parent(s): e543172

UPDATED QUANTS! Use KCPP 1.64+

Browse files
Files changed (12) hide show
  1. L3-TheSpice-8b-v0.1.3-F16.gguf +3 -0
  2. L3-TheSpice-8b-v0.1.3-IQ3_M-imat.gguf +3 -0
  3. L3-TheSpice-8b-v0.1.3-IQ3_XXS-imat.gguf +3 -0
  4. L3-TheSpice-8b-v0.1.3-IQ4_NL-imat.gguf +3 -0
  5. L3-TheSpice-8b-v0.1.3-IQ4_XS-imat.gguf +3 -0
  6. L3-TheSpice-8b-v0.1.3-Q4_K_M-imat.gguf +3 -0
  7. L3-TheSpice-8b-v0.1.3-Q4_K_S-imat.gguf +3 -0
  8. L3-TheSpice-8b-v0.1.3-Q5_K_M-imat.gguf +3 -0
  9. L3-TheSpice-8b-v0.1.3-Q5_K_S-imat.gguf +3 -0
  10. L3-TheSpice-8b-v0.1.3-Q6_K-imat.gguf +3 -0
  11. L3-TheSpice-8b-v0.1.3-Q8_0-imat.gguf +3 -0
  12. imatrix.dat +3 -0
L3-TheSpice-8b-v0.1.3-F16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4998724eb8419c66291dcc904e07fc66137f11fcdb58eb00cb47c228c002f552
3
+ size 16068890432
L3-TheSpice-8b-v0.1.3-IQ3_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd511de6eed8c8f885d86c3aebe5a8e30bfc3b5c31892dde9cc8900b77516343
3
+ size 3784822944
L3-TheSpice-8b-v0.1.3-IQ3_XXS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bcccacc7a506bbd247748dc76f0b1decdaf6bd6bf72555d7418da51fa6ba20ad
3
+ size 3274911904
L3-TheSpice-8b-v0.1.3-IQ4_NL-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0fbc1b9e331fadbd8c72d4d89f4ffae665a7db012e436b82c20056aa0276ad97
3
+ size 4677988512
L3-TheSpice-8b-v0.1.3-IQ4_XS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3cd2b26753ced130d9b64add51d42c0022605fe63091d6fdbd06895617ca2921
3
+ size 4447662240
L3-TheSpice-8b-v0.1.3-Q4_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4797db2c245281f17c93992bfb66b10d356675677a922cde9bb5874d8c678ee
3
+ size 4920733856
L3-TheSpice-8b-v0.1.3-Q4_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:39b0733324b1a8efb007dca15d0a57027312ab247c10a571d47080265b65e0f5
3
+ size 4692668576
L3-TheSpice-8b-v0.1.3-Q5_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0b3c9cc5f5e45b198ad130ac08894ec034fc9bc8f76a67f07494224e65f5548
3
+ size 5732987040
L3-TheSpice-8b-v0.1.3-Q5_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:34a149ed3f2c0878f81694c95037fe8a7474dd435f6996c85a347423789fd100
3
+ size 5599293600
L3-TheSpice-8b-v0.1.3-Q6_K-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4cb2ee497ce3ee887fdc7bc449ebbe9cfb95e95c04d91bcc26ceed75ac33f443
3
+ size 6596006048
L3-TheSpice-8b-v0.1.3-Q8_0-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:54661386dbab9dbf86f2bb66ab306a1715368cabb81cf5056cff5c5f91c67b19
3
+ size 8540770464
imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:062d11cf913deec30cbe234d8dfb50b3f84eac73802436b4adc637f97a9a0618
3
+ size 4988193