Deathsquad10/Tinyllama2.0-test3

Model Card for Model ID Trying to implement Llama3 Tokenizer with Tinyllama

Model Details

Model Description

Tasks	Version	Filter	n-shot	Metric		Value		Stderr
arc_challenge	1	none	0	acc	↑	0.2312	±	0.0123
		none	0	acc_norm	↑	0.2602	±	0.0128
arc_easy	1	none	0	acc	↑	0.2593	±	0.0090
		none	0	acc_norm	↑	0.2572	±	0.0090
boolq	2	none	0	acc	↑	0.5685	±	0.0087
hellaswag	1	none	0	acc	↑	0.2583	±	0.0044
		none	0	acc_norm	↑	0.2642	±	0.0044
openbookqa	1	none	0	acc	↑	0.1260	±	0.0149
		none	0	acc_norm	↑	0.2800	±	0.0201
piqa	1	none	0	acc	↑	0.5457	±	0.0116
		none	0	acc_norm	↑	0.5158	±	0.0117
winogrande	1	none	0	acc	↑	0.5130	±	0.0140