kunato commited on
Commit
37a0b60
1 Parent(s): ff4a5eb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -7,7 +7,7 @@ license: llama3
7
  ---
8
  **Llama-3-Typhoon-1.5X-8B-instruct: Thai Large Language Model (Instruct)**
9
 
10
- **Llama-3-Typhoon-1.5X-8B-instruct** is an 8 billion parameter instruct model designed for Thai 🇹🇭 language. It demonstrates competitive performance with GPT-3.5-turbo, and is optimized for **production** environments, **Retrieval-Augmented Generation (RAG), constrained generation**, and **reasoning** tasks.
11
 
12
  Built on Typhoon 1.5 8B and Llama 3 8B Instruct. This model is a result of our experiment on **cross-lingual transfer**. It utilizes the [task-arithmetic model editing](https://arxiv.org/abs/2212.04089) technique, combining the Thai understanding capability of Typhoon with the human alignment performance of Llama 3 Instruct.
13
 
@@ -28,7 +28,7 @@ We evaluated the model's performance in **Language & Knowledge Capabilities** an
28
  - Assessed using multiple-choice question-answering datasets such as ThaiExam and MMLU.
29
  - **Instruction Following Capabilities**:
30
  - Evaluated based on our beta users' feedback, focusing on two factors:
31
- - **Human Alignment & Reasoning**: Ability to generate responses that are understandable and reasoned across multiple steps.
32
  - Evaluated using [MT-Bench](https://arxiv.org/abs/2306.05685) — How LLMs can answer embedded knowledge to align with human needs.
33
  - **Instruction-following**: Ability to adhere to specified constraints in the instruction
34
  - Evaluated using [IFEval](https://arxiv.org/abs/2311.07911) — How LLMs can follow specified constraints, such as formatting and brevity.
@@ -63,7 +63,7 @@ Remark: We developed the TH pair by translating the original datasets into Thai
63
 
64
  ## Insight
65
 
66
- Utilized model editing technique. We found that the most critical feature for generating Thai answers is located in the backend (the upper layers of the transformer block). Accordingly, we incorporated a high ratio of Typhoon in these backend layers.
67
 
68
  ## **Usage Example**
69
 
@@ -127,7 +127,7 @@ This model is experimental and might not be fully evaluated for all use cases. D
127
 
128
  ## **SCB 10X Typhoon Team**
129
 
130
- - Kunat Pipatanakul, Potsawee Manakul, Sittipong Sripaisarnmongkol, Pathomporn Chokchainant, Kasima Tharnpipitchai
131
  - If you find Typhoon-1.5X useful for your work, please cite it using:
132
 
133
  ```
 
7
  ---
8
  **Llama-3-Typhoon-1.5X-8B-instruct: Thai Large Language Model (Instruct)**
9
 
10
+ **Llama-3-Typhoon-1.5X-8B-instruct** is an 8 billion parameter instruct model designed for Thai 🇹🇭 language. It demonstrates competitive performance with GPT-3.5-turbo, and is optimized for **application** use cases, **Retrieval-Augmented Generation (RAG), constrained generation**, and **reasoning** tasks.
11
 
12
  Built on Typhoon 1.5 8B and Llama 3 8B Instruct. This model is a result of our experiment on **cross-lingual transfer**. It utilizes the [task-arithmetic model editing](https://arxiv.org/abs/2212.04089) technique, combining the Thai understanding capability of Typhoon with the human alignment performance of Llama 3 Instruct.
13
 
 
28
  - Assessed using multiple-choice question-answering datasets such as ThaiExam and MMLU.
29
  - **Instruction Following Capabilities**:
30
  - Evaluated based on our beta users' feedback, focusing on two factors:
31
+ - **Human Alignment & Reasoning**: Ability to generate responses that are clear and logically structured across multiple steps.
32
  - Evaluated using [MT-Bench](https://arxiv.org/abs/2306.05685) — How LLMs can answer embedded knowledge to align with human needs.
33
  - **Instruction-following**: Ability to adhere to specified constraints in the instruction
34
  - Evaluated using [IFEval](https://arxiv.org/abs/2311.07911) — How LLMs can follow specified constraints, such as formatting and brevity.
 
63
 
64
  ## Insight
65
 
66
+ We utilized **model editing** techniques and found that the most critical feature for generating accurate Thai answers is located in the backend (the upper layers of the transformer block). Accordingly, we incorporated a high ratio of Typhoon components in these backend layers to enhance our model’s performance.
67
 
68
  ## **Usage Example**
69
 
 
127
 
128
  ## **SCB 10X Typhoon Team**
129
 
130
+ - Kunat Pipatanakul, Potsawee Manakul, Sittipong Sripaisarnmongkol, Natapong Nitarach, Pathomporn Chokchainant, Kasima Tharnpipitchai
131
  - If you find Typhoon-1.5X useful for your work, please cite it using:
132
 
133
  ```