Hugging Face's logo

MaziyarPanahi
/
Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation
GGUF
5 languages
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
mixtral
Mixture of Experts
Model card Files Community
37

Upload folder using huggingface_hub

#26
by MaziyarPanahi - opened
base: refs/heads/main
←
from: refs/pr/26
Discussion Files changed
+24
-0
Files changed (7) hide show
  1. .gitattributes +6 -0
  2. Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00001-of-00003.gguf +3 -0
  3. Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00002-of-00003.gguf +3 -0
  4. Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00003-of-00003.gguf +3 -0
  5. Mixtral-8x22B-Instruct-v0.1.Q3_K_S-00001-of-00003.gguf +3 -0
  6. Mixtral-8x22B-Instruct-v0.1.Q3_K_S-00002-of-00003.gguf +3 -0
  7. Mixtral-8x22B-Instruct-v0.1.Q3_K_S-00003-of-00003.gguf +3 -0
.gitattributes CHANGED
@@ -61,3 +61,9 @@ Mixtral-8x22B-Instruct-v0.1.Q3_K_S-00005-of-00005.gguf filter=lfs diff=lfs merge
61
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
62
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
63
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
61
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
62
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
63
  Mixtral-8x22B-Instruct-v0.1.Q2_K-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
64
+ Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
65
+ Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
66
+ Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
67
+ Mixtral-8x22B-Instruct-v0.1.Q3_K_S-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
68
+ Mixtral-8x22B-Instruct-v0.1.Q3_K_S-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
69
+ Mixtral-8x22B-Instruct-v0.1.Q3_K_S-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00001-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da22b5c47cd340265b8eba3663523d48082b3e60963c8150505f50d5c9e294ff
3
+ size 20945968960
Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00002-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e43f053deeee2ddf9ab313987f3916e6ff63081341d8f299d1d6311212d1428
3
+ size 20330263232
Mixtral-8x22B-Instruct-v0.1.IQ3_XS-00003-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc313417d29a437eb4fc6ec80a9c31b198b61a2938b44482ee25e36620ad3b7a
3
+ size 16957892928
Mixtral-8x22B-Instruct-v0.1.Q3_K_S-00001-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b54432611482438535e26a2f303ca7a74c388cd45f9bd222afb17c20521a220
3
+ size 21962825536
Mixtral-8x22B-Instruct-v0.1.Q3_K_S-00002-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa051be48897b8d0f495795994c048f8d696f07905dddfb75fd60e02578491ea
3
+ size 21875602112
Mixtral-8x22B-Instruct-v0.1.Q3_K_S-00003-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe530500dde151f7b59f38f8d39e2391567e2161ffbda336c230b403cc61d91a
3
+ size 17665681728