scb10x
/

llama-3-typhoon-v1.5-8b-instruct

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

kunato commited on May 9, 2024

Commit

2abbda1

·

verified ·

1 Parent(s): 9c514e6

Update README.md

Files changed (1) hide show

README.md +6 -6

README.md CHANGED Viewed

@@ -28,12 +28,12 @@ For release post, please see our [blog](https://blog.opentyphoon.ai/typhoon-1-5-
 | Model | ONET | IC | TGAT | TPAT-1 | A-Level | Average (ThaiExam) | M3Exam | MMLU |
 | --- | --- | --- | --- | --- | --- | --- | --- | --- |
-| Typhoon-1.0 (mistral) | 0.379 | 0.393 | 0.700 | 0.414 | 0.324 | 0.442 | 0.391 | 0.5469 |
-| Typhoon-1.5 8B (llama3) | ***0.446*** | ***0.431*** | ***0.722*** | ***0.526*** | ***0.407*** | ***0.5028*** | ***0.46*** | ***0.6136*** |
-| Salior 7B | 0.372 | 0.379 | 0.678 | 0.405 | 0.396 | 0.446 | 0.411 | 0.5528 |
-| SeaLLM 2.0 7B | 0.327 | 0.311 | 0.656 | 0.414 | 0.321 | 0.4058 | 0.354 | 0.5792 |
-| OpenThaiGPT 1.0.0b 7B | 0.238 | 0.249 | 0.444 | 0.319 | 0.289 | 0.3078 | 0.268 | 0.3693 |
-| SambaLingo-Thai-Chat 7B | 0.251 | 0.241 | 0.522 | 0.302 | 0.262 | 0.3156 | 0.309 | 0.3879 |
 ## Usage Example

 | Model | ONET | IC | TGAT | TPAT-1 | A-Level | Average (ThaiExam) | M3Exam | MMLU |
 | --- | --- | --- | --- | --- | --- | --- | --- | --- |
+| Typhoon-1.0 (Mistral) | 0.379 | 0.393 | 0.700 | 0.414 | 0.324 | 0.442 | 0.391 | 0.5469 |
+| Typhoon-1.5 8B (Llama3) | ***0.446*** | ***0.431*** | ***0.722*** | ***0.526*** | ***0.407*** | ***0.506*** | ***0.460*** | ***0.614*** |
+| Sailor 7B | 0.372 | 0.379 | 0.678 | 0.405 | 0.396 | 0.446 | 0.411 | 0.553 |
+| SeaLLM 2.0 7B | 0.327 | 0.311 | 0.656 | 0.414 | 0.321 | 0.406 | 0.354 | 0.579 |
+| OpenThaiGPT 1.0.0b 7B | 0.238 | 0.249 | 0.444 | 0.319 | 0.289 | 0.308 | 0.268 | 0.369 |
+| SambaLingo-Thai-Chat 7B | 0.251 | 0.241 | 0.522 | 0.302 | 0.262 | 0.316 | 0.309 | 0.388 |
 ## Usage Example