mistral-community
/

Mistral-7B-v0.2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

alpindale commited on Mar 23

Commit

651f3a3

•

1 Parent(s): 3e3f3cf

Update config.json

need this for training

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -2,7 +2,7 @@
   "architectures": [
     "MistralForCausalLM"
   ],
-  "attention_dropout": 0.0,
   "bos_token_id": 1,
   "eos_token_id": 2,
   "hidden_act": "silu",

   "architectures": [
     "MistralForCausalLM"
   ],
+  "attention_dropout": 0.6,
   "bos_token_id": 1,
   "eos_token_id": 2,
   "hidden_act": "silu",