Edentns
/

DataVortexTL-1.1B-v0.1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

JeongwonChoi commited on Jan 16

Commit

6d90905

•

1 Parent(s): d6984dd

Update README.md

Files changed (1) hide show

README.md +7 -11

README.md CHANGED Viewed

@@ -59,22 +59,18 @@ text = """\
 ### **[Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)**
-On Benchmarking ...
-| Task             | 0-shot | 5-shot | 10-shot | 50-shot |
-| :--------------- | -----: | -----: | ------: | ------: |
-| kobest_boolq     |    0.0 |    0.0 |     0.0 |     0.0 |
-| kobest_copa      |    0.0 |    0.0 |     0.0 |     0.0 |
-| kobest_hellaswag |    0.0 |    0.0 |     0.0 |     0.0 |
-| kobest_sentineg  |    0.0 |    0.0 |     0.0 |     0.0 |
 ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
-On Benchmarking ...
 | Average | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
 | ------: | -----: | -----------: | ------: | ------------: | --------------: |
-|       0 |      0 |            0 |       0 |             0 |               0 |
 ## **Implementation Code**

 ### **[Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)**
+| Task             |   0-shot |   5-shot |  10-shot |  50-shot |
+| :--------------- | -------: | -------: | -------: | -------: |
+| kobest_boolq     | 0.334282 | 0.516446 | 0.500478 | 0.498941 |
+| kobest_copa      | 0.515061 | 0.504321 | 0.492927 |  0.50809 |
+| kobest_hellaswag |  0.36253 | 0.357733 | 0.355873 | 0.376502 |
+| kobest_sentineg  | 0.481146 | 0.657411 | 0.687417 | 0.635703 |
 ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
 | Average | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
 | ------: | -----: | -----------: | ------: | ------------: | --------------: |
+|    31.5 |  25.26 |        33.53 |   24.56 |         43.34 |           30.81 |
 ## **Implementation Code**