fix the bug : RuntimeError: mat1 and mat2 shapes cannot be multiplied

fix the bug : RuntimeError: mat1 and mat2 shapes cannot be multiplied - Llama-2-13b-chat-hf, please check below notes

https://github.com/huggingface/transformers/issues/249614.30.1
https://huggingface.co/meta-llama/Llama-2-13b-chat-hf/commit/3a989db99aa8d9ef4cfd55f87521fc4c04891d3d

config.json

@@ -15,7 +15,7 @@
   "num_hidden_layers": 40,
   "num_key_value_heads": 40,
   "pad_token_id": 0,
-  "pretraining_tp": 2,
+  "pretraining_tp": 1,
   "rms_norm_eps": 1e-05,
   "rope_scaling": null,
   "tie_word_embeddings": false,