Hugging Face's logo

MaziyarPanahi
/
WizardLM-2-8x22B-GGUF

Text Generation
Transformers
GGUF
Safetensors
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mistral
arxiv:2304.12244
arxiv:2306.08568
arxiv:2308.09583
Inference Endpoints
text-generation-inference
Model card Files Community
15
MaziyarPanahi commited on
Commit
25f2341
•
1 Parent(s): d1876e7

Upload folder using huggingface_hub (#1)

Browse files

- bc69f1b19f22afb9fb22e9155ee9ad626d7efaf83b3732b4cf688e683e608acf (3427dbc730e25776939b154fd937b08bf0086fc9)
- f4893524b07c0ef52917e08e4bab1d4b372d108fdf6e45fda557676364dc1845 (9f06166f328f21d58ff4eb8492ca3537b4fe3835)
- f3e002d75fab11e80d07efc6f367ba511fe7d59b68f17a33a94338c2231b831d (8f22e38069d473ca3ed4a3d0220b9b63c4364125)
- 76b243f920f399c07982d03149ac530d08f144380e8f2c4b6744778fb91a8d92 (f171a9886d682fb60fba8768e89550d160b0db3c)
- 5d5dbcf6702c60ff3b7fba7f1b429529732289689c858c69feac25fa82bb3a65 (75cd4f55cb8b5e252384c725e4ecad0f380f8059)

Files changed (6) hide show
  1. .gitattributes +5 -0
  2. WizardLM-2-8x22B.Q2_K-00001-of-00005.gguf +3 -0
  3. WizardLM-2-8x22B.Q2_K-00002-of-00005.gguf +3 -0
  4. WizardLM-2-8x22B.Q2_K-00003-of-00005.gguf +3 -0
  5. WizardLM-2-8x22B.Q2_K-00004-of-00005.gguf +3 -0
  6. WizardLM-2-8x22B.Q2_K-00005-of-00005.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ WizardLM-2-8x22B.Q2_K-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
37
+ WizardLM-2-8x22B.Q2_K-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
38
+ WizardLM-2-8x22B.Q2_K-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
39
+ WizardLM-2-8x22B.Q2_K-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
40
+ WizardLM-2-8x22B.Q2_K-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
WizardLM-2-8x22B.Q2_K-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:906b9d1f7a91fe5e3acb123bd45cc032096bcd4214d5ae2f4a24185eaf980bf4
3
+ size 11843728320
WizardLM-2-8x22B.Q2_K-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:53a3fe6da0e7076c168ff7c94b454ec98d0c46c575d27ece5236be21c61af3f6
3
+ size 12267708608
WizardLM-2-8x22B.Q2_K-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d6434c42e263006300fddbd9f3b923a6cc690ddd350847579c65dc178ed0bea
3
+ size 11188527232
WizardLM-2-8x22B.Q2_K-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af766c6d298310821a4ab132bc8e6a21817023ca428ffa2bb6a54b9d2da45600
3
+ size 12016738464
WizardLM-2-8x22B.Q2_K-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a7fd3949c13b60d1369f86663cef9ca4e900037e9c621ab39db2790ec64b519
3
+ size 4786462016