TheBloke
/

Qwen-7B-Chat-GPTQ

Text Generation

4-bit precision

Model card Files Files and versions Community

TheBloke commited on Nov 21, 2023

Commit

eb5f2e8

·

1 Parent(s): 3925783

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -10,7 +10,7 @@
     },
     "bf16": false,
     "emb_dropout_prob": 0.0,
-    "fp16": false,
     "fp32": false,
     "hidden_size": 4096,
     "initializer_range": 0.02,

     },
     "bf16": false,
     "emb_dropout_prob": 0.0,
+    "fp16": true,
     "fp32": false,
     "hidden_size": 4096,
     "initializer_range": 0.02,