shauray
/

Llava-v1.5-7B-hf

Text Generation

Model card Files Files and versions Community

shauray commited on Oct 9, 2023

Commit

7e6c1a6

·

1 Parent(s): 9a078cf

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -52,7 +52,7 @@
     "num_key_value_heads": 32,
     "pad_token_id": 0,
     "pretraining_tp": 1,
-    "rms_norm_eps": 1e-06,
     "rope_scaling": null,
     "tie_word_embeddings": false,
     "torch_dtype": "float16",

     "num_key_value_heads": 32,
     "pad_token_id": 0,
     "pretraining_tp": 1,
+    "rms_norm_eps": 1e-05,
     "rope_scaling": null,
     "tie_word_embeddings": false,
     "torch_dtype": "float16",