shauray
/

Llava-v1.5-7B-hf

Text Generation

Model card Files Files and versions Community

shauray commited on Oct 10, 2023

Commit

e3dea11

·

1 Parent(s): f9de62e

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -19,7 +19,7 @@
     "num_hidden_layers": 32,
     "num_key_value_heads": 32,
     "pretraining_tp": 1,
-    "rms_norm_eps": 1e-06,
     "rope_scaling": null,
     "tie_word_embeddings": false,
     "torch_dtype": "float16",

     "num_hidden_layers": 32,
     "num_key_value_heads": 32,
     "pretraining_tp": 1,
+    "rms_norm_eps": 1e-05,
     "rope_scaling": null,
     "tie_word_embeddings": false,
     "torch_dtype": "float16",