Hugging Face's logo

SpongeEngine
/
gemma-2-9b-it-abliterated-i1-GGUF

GGUF
English
SpongeQuant
i1-GGUF
Inference Endpoints
imatrix
conversational
Model card Files Community
dclipca commited on
Commit
c05321f
·
verified ·
1 Parent(s): 3253448

Upload folder using huggingface_hub

Browse files
Files changed (24) hide show
  1. .gitattributes +22 -0
  2. README.md +26 -0
  3. gemma-2-9b-it-abliterated-i1-IQ2_S.gguf +3 -0
  4. gemma-2-9b-it-abliterated-i1-IQ2_XS.gguf +3 -0
  5. gemma-2-9b-it-abliterated-i1-IQ2_XXS.gguf +3 -0
  6. gemma-2-9b-it-abliterated-i1-IQ3_M.gguf +3 -0
  7. gemma-2-9b-it-abliterated-i1-IQ3_S.gguf +3 -0
  8. gemma-2-9b-it-abliterated-i1-IQ3_XS.gguf +3 -0
  9. gemma-2-9b-it-abliterated-i1-IQ3_XXS.gguf +3 -0
  10. gemma-2-9b-it-abliterated-i1-IQ4_NL.gguf +3 -0
  11. gemma-2-9b-it-abliterated-i1-IQ4_XS.gguf +3 -0
  12. gemma-2-9b-it-abliterated-i1-Q2_K.gguf +3 -0
  13. gemma-2-9b-it-abliterated-i1-Q2_K_S.gguf +3 -0
  14. gemma-2-9b-it-abliterated-i1-Q3_K_L.gguf +3 -0
  15. gemma-2-9b-it-abliterated-i1-Q3_K_M.gguf +3 -0
  16. gemma-2-9b-it-abliterated-i1-Q3_K_S.gguf +3 -0
  17. gemma-2-9b-it-abliterated-i1-Q4_0.gguf +3 -0
  18. gemma-2-9b-it-abliterated-i1-Q4_1.gguf +3 -0
  19. gemma-2-9b-it-abliterated-i1-Q4_K_M.gguf +3 -0
  20. gemma-2-9b-it-abliterated-i1-Q4_K_S.gguf +3 -0
  21. gemma-2-9b-it-abliterated-i1-Q5_K_M.gguf +3 -0
  22. gemma-2-9b-it-abliterated-i1-Q5_K_S.gguf +3 -0
  23. gemma-2-9b-it-abliterated-i1-Q6_K.gguf +3 -0
  24. gemma-2-9b-it-abliterated.imatrix.dat +3 -0
.gitattributes CHANGED
@@ -33,3 +33,25 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ gemma-2-9b-it-abliterated-i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
37
+ gemma-2-9b-it-abliterated-i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
38
+ gemma-2-9b-it-abliterated-i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
39
+ gemma-2-9b-it-abliterated-i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ gemma-2-9b-it-abliterated-i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ gemma-2-9b-it-abliterated-i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
42
+ gemma-2-9b-it-abliterated-i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ gemma-2-9b-it-abliterated-i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
44
+ gemma-2-9b-it-abliterated-i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
45
+ gemma-2-9b-it-abliterated-i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
46
+ gemma-2-9b-it-abliterated-i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
47
+ gemma-2-9b-it-abliterated-i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
48
+ gemma-2-9b-it-abliterated-i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
49
+ gemma-2-9b-it-abliterated-i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
50
+ gemma-2-9b-it-abliterated-i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
51
+ gemma-2-9b-it-abliterated-i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
52
+ gemma-2-9b-it-abliterated-i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
53
+ gemma-2-9b-it-abliterated-i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
54
+ gemma-2-9b-it-abliterated-i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
55
+ gemma-2-9b-it-abliterated-i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
56
+ gemma-2-9b-it-abliterated-i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
57
+ gemma-2-9b-it-abliterated.imatrix.dat filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: IlyaGusev/gemma-2-9b-it-abliterated
3
+ language:
4
+ - en
5
+ license: mit
6
+ quantized_by: SpongeQuant
7
+ tags:
8
+ - SpongeQuant
9
+ - i1-GGUF
10
+ ---
11
+
12
+
13
+ Quantized to `i1-GGUF` using [SpongeQuant](https://github.com/SpongeEngine/SpongeQuant), the Oobabooga of LLM quantization. Chat & support at [Sponge Engine](https://discord.gg/azNmr2Gdgy).
14
+
15
+ <figure>
16
+ <img src="https://huggingface.co/spaces/SpongeEngine/README/resolve/main/006.png" alt="6. Solar system parameters">
17
+ <figcaption>6. Solar system parameters</figcaption>
18
+ </figure>
19
+
20
+ <figure>
21
+ <audio controls>
22
+ <source src="https://huggingface.co/spaces/SpongeEngine/README/resolve/main/031.mp3" type="audio/mp3">
23
+ Your browser does not support the audio element.
24
+ </audio>
25
+ <figcaption>31. String Quartet No. 13 in B-flat Major, Opus 130: V. Cavatina – Budapest String Quartet (Ludwig Van Beethoven)</figcaption>
26
+ </figure>
gemma-2-9b-it-abliterated-i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:58965000d43a69f26d6b175680de7ec33b96fded1018b625839f20276455d8bc
3
+ size 3211486176
gemma-2-9b-it-abliterated-i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3dfcb0e3f3aa93b9db455db252bc7dbbe4c3b48a064d256b24293954d0773499
3
+ size 3067380704
gemma-2-9b-it-abliterated-i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6243fd6398ae34b32cab807aa1722f99e767c86e3fec4db9cb2ad648024a62b0
3
+ size 2824930272
gemma-2-9b-it-abliterated-i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dbf83a31e8e2f4b231bd492c647c5b8efb2d346cad64d0fadd994ef794a9eabd
3
+ size 4494615520
gemma-2-9b-it-abliterated-i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c4599fbe6e4a814e819d37c39963f3a9dd158615da8d24f67f522a74d78f90b6
3
+ size 4337664992
gemma-2-9b-it-abliterated-i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:edecb2eb125e57204e1e1c09579875cda4f165d3ae389747423c3d12d6786301
3
+ size 4144989152
gemma-2-9b-it-abliterated-i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed21e264e8dc69edb8a97a290ed1c1dd9a257db8e17fd0e78ccf405245fd5b14
3
+ size 3796739040
gemma-2-9b-it-abliterated-i1-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:24056d1b23c019b7cdea22e74e33edd237c5e8202070467ad1cce040f084939f
3
+ size 5443142624
gemma-2-9b-it-abliterated-i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a49e4be74e090ca7ee370848e9c874a8badaa340737cddf34d0d93c7fbe406c
3
+ size 5183030240
gemma-2-9b-it-abliterated-i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9708ec78ed45076fbbadd2a46500c3f9b65e3a5d74603c3d6dcf7f4d9f9fb77d
3
+ size 3805397984
gemma-2-9b-it-abliterated-i1-Q2_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:221339385f6d6adc82222d682fe3896ee570b6415486a520093f6ab1a273f245
3
+ size 3552510944
gemma-2-9b-it-abliterated-i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:58e7e5a17d0fbfc35f4493f526c8decc9e37a07e8676b9da99e9fd3f56dbeb23
3
+ size 5132452832
gemma-2-9b-it-abliterated-i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:93b75c6452ac47b2e8f49e196108048dfc3224c907212841c80818838262de89
3
+ size 4761781216
gemma-2-9b-it-abliterated-i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ddcb292539cd3a9ddbf74853c01f1c27a6bbd06655657a0fe6e5574c794384cd
3
+ size 4337664992
gemma-2-9b-it-abliterated-i1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae087e96c56defcf877873164e45c0be01aec871c18995c01af214fd2613d8e9
3
+ size 5459198944
gemma-2-9b-it-abliterated-i1-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a560b747bf102a6447f4e9b3620f38dcf2e0d927f57a752219de5c59900eaad7
3
+ size 5963367392
gemma-2-9b-it-abliterated-i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:18ba0bdc7166e07230f5162c1914b641f267a93322d190bb02051074d6dab5a2
3
+ size 5761057760
gemma-2-9b-it-abliterated-i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1377ff26c06514c5f588fec31e8d83b847c581b4aec929f7638291cea1f02e7d
3
+ size 5478925280
gemma-2-9b-it-abliterated-i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab025d0fb5cc4e318839eb8cc7dcdd24d12a8db400e92e026bef8f67b381413c
3
+ size 6647366624
gemma-2-9b-it-abliterated-i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aefde163161b1aac11f2337db4686f633a52d3ede6825ee804e5af720307d70d
3
+ size 6483592160
gemma-2-9b-it-abliterated-i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:14242c5df5117f5e69c4796dbd6c86ba165c9a8cb162f7c3f9099a4b1994bd77
3
+ size 7589069792
gemma-2-9b-it-abliterated.imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb5ae2bcfd9236fa01b9ba7018b45e5a3b7095649dafafb3d69c4d8c2179edf3
3
+ size 6116891