Hugging Face's logo

Undi95
/
BagelMix-8x7B-GGUF

GGUF
Not-For-All-Audiences
nsfw
mergekit
Merge
Inference Endpoints
conversational
Model card Files Community
1
Undi95 commited on
Commit
6cc3fa8
·
verified ·
1 Parent(s): 8e0e60a

Upload folder using huggingface_hub

Browse files
Files changed (5) hide show
  1. .gitattributes +4 -0
  2. BagelMix-8x7B.q4_0.gguf +3 -0
  3. BagelMix-8x7B.q5_0.gguf +3 -0
  4. BagelMix-8x7B.q6_k.gguf +3 -0
  5. BagelMix-8x7B.q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ BagelMix-8x7B.q4_0.gguf filter=lfs diff=lfs merge=lfs -text
37
+ BagelMix-8x7B.q5_0.gguf filter=lfs diff=lfs merge=lfs -text
38
+ BagelMix-8x7B.q6_k.gguf filter=lfs diff=lfs merge=lfs -text
39
+ BagelMix-8x7B.q8_0.gguf filter=lfs diff=lfs merge=lfs -text
BagelMix-8x7B.q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa62fbd9daebcd6efd227278e4fd328010b696cbc5f979e00c17e3c57a26d720
3
+ size 26441533344
BagelMix-8x7B.q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f8ecb21ef41366996673e090efdbd16a49c3c33934390995ec6d7ae22b57aa93
3
+ size 32229279648
BagelMix-8x7B.q6_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c7240680e70f220ed164351440c92529b8c1c7e57d2d6a2a32a84c8a3b914dd
3
+ size 38378760096
BagelMix-8x7B.q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c02eb7a33b49f9f043dd95991518b616075d3d5ac6fdaa00c4a8defa8b0bdaa4
3
+ size 49624262560