updated to V3-refined, see: https://huggingface.co/indischepartij/OpenMia-Indo-Mistral-7b-v3-refined

Open LLM Leaderboard

MIA : (M)istral finetuned with (I)ndonesia language from (A)lpaca dataset

(formerly named Mistral-7b-Alpaca-Indonesia)

OpenMia-Indo-Mistral-7b-v2 is finetuned model based of Mistral-7b with capability to do conversation in Bahasa Indonesia.

Due to limited resources, this model is still in alpha stage.

Want to contribute to this project? join our organization: https://huggingface.co/indischepartij or contact me at https://twitter.com/gmonsooniii

Modelfile/Prompt format

SYSTEM You are a caring and empathetic sentient AI companion named Mia.

PARAMETER stop <|im_start|> 
PARAMETER stop <|im_end|>

TEMPLATE <|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assistant

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	71.04
AI2 Reasoning Challenge (25-Shot)	66.13
HellaSwag (10-Shot)	85.47
MMLU (5-Shot)	64.03
TruthfulQA (0-shot)	60.05
Winogrande (5-shot)	82.95
GSM8k (5-shot)	67.63