Hugging Face's logo

nectec
/
OpenThaiLLM-DoodNiLT-V1.0.0-Beta-7B

Text Generation
Transformers
Safetensors
Thai
English
Chinese
qwen2
text-generation-inference
climate
finance
biology
chemistry
medical
code
legal
conversational
Inference Endpoints
Model card Files Community
5
SuperkingbasSKB commited on
Commit
18ca6a3
•
1 Parent(s): 8ea52e4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -81,9 +81,9 @@ print(response)
81
  ```
82
 
83
  ## Evaluation Performance Few-shot (5 shot)
84
- | Model | ONET | IC | TGAT | TPAT-1 | A-Level | Average ThaiExam) | MMLU | M3Exam (1 shot) | M6Exam(5shot) |
85
  | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
86
- | OpenthaiLLM-Prebuilt-7B | **0.5493** | **0.6315** | **0.6307** | **0.4655** | **0.37** | **0.5294** | **0.7054** | **0.5705** | **0.596** |
87
  | llama-3-typhoon-v1.5-8b | 0.3765 | 0.3473 | 0.5538 | 0.4137 | 0.2913 | 0.3965 | 0.4312 | 0.6451 |
88
  | OpenThaiGPT-1.0.0-7B | 0.3086 | 0.3052 | 0.4153 | 0.3017 | 0.2755 | 0.3213 | 0.255 | 0.3512 |
89
  | Meta-Llama-3.1-8B | 0.3641 | 0.2631 | 0.2769 | 0.3793 | 0.1811 | 0.2929 | 0.4239 | 0.6591 |
 
81
  ```
82
 
83
  ## Evaluation Performance Few-shot (5 shot)
84
+ | Model | ONET | IC | TGAT | TPAT-1 | A-Level | Average ThaiExam) | MMLU | M3Exam (1 shot) |
85
  | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
86
+ | OpenthaiLLM-Prebuilt-7B | **0.5493** | **0.6315** | **0.6307** | **0.4655** | **0.37** | **0.5294** | **0.7054** | **0.5705** |
87
  | llama-3-typhoon-v1.5-8b | 0.3765 | 0.3473 | 0.5538 | 0.4137 | 0.2913 | 0.3965 | 0.4312 | 0.6451 |
88
  | OpenThaiGPT-1.0.0-7B | 0.3086 | 0.3052 | 0.4153 | 0.3017 | 0.2755 | 0.3213 | 0.255 | 0.3512 |
89
  | Meta-Llama-3.1-8B | 0.3641 | 0.2631 | 0.2769 | 0.3793 | 0.1811 | 0.2929 | 0.4239 | 0.6591 |