Prasanth99
/

zephyr_v2

Generated from Trainer

4-bit precision

Model card Files Files and versions Community

Prasanth99 commited on Apr 4, 2024

Commit

7486699

·

verified ·

1 Parent(s): e1acd70

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -23,7 +23,7 @@
         "damp_percent": 0.1,
         "desc_act": true,
         "disable_exllama": true,
-        "group_size": 64,
         "max_input_length": null,
         "model_seqlen": 4096,
         "module_name_preceding_first_block": [

         "damp_percent": 0.1,
         "desc_act": true,
         "disable_exllama": true,
+        "group_size": 128,
         "max_input_length": null,
         "model_seqlen": 4096,
         "module_name_preceding_first_block": [