Hugging Face's logo

Undi95
/
Toppy-M-7B-GGUF

GGUF
Not-For-All-Audiences
nsfw
Merge
Inference Endpoints
Model card Files Community
3
Undi95 commited on
Commit
36f8a22
•
1 Parent(s): 2f6b845

Upload folder using huggingface_hub

Browse files
Files changed (5) hide show
  1. .gitattributes +4 -0
  2. Toppy-M-7B.q4_k_s.gguf +3 -0
  3. Toppy-M-7B.q5_k_m.gguf +3 -0
  4. Toppy-M-7B.q6_k.gguf +3 -0
  5. Toppy-M-7B.q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Toppy-M-7B.q4_k_s.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Toppy-M-7B.q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Toppy-M-7B.q6_k.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Toppy-M-7B.q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Toppy-M-7B.q4_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e56af72ff922a486320d17831bb7886ef4e1f3fda2326e28fcc150796fa3ec0
3
+ size 4140373632
Toppy-M-7B.q5_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00c2a431fccc675dca708825f8c258d790f257f96cfc8fa9106761abf201ba0c
3
+ size 5131409024
Toppy-M-7B.q6_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c14099ae0976acbd3923f4d27d9325ad96c7c46b6c3b2bd6197c83332de28d80
3
+ size 5942064768
Toppy-M-7B.q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:889c3df14dacf4276440cc1667f4bc434edf0e7106b3476aa55eb54f9d3a55d3
3
+ size 7695857280