Update README.md
Browse files
README.md
CHANGED
@@ -157,7 +157,6 @@ fp16: false
|
|
157 |
tf32: false
|
158 |
|
159 |
gradient_checkpointing: true
|
160 |
-
# early_stopping_patience: 3
|
161 |
resume_from_checkpoint: true
|
162 |
local_rank:
|
163 |
logging_steps: 1
|
@@ -166,11 +165,9 @@ flash_attention: true
|
|
166 |
|
167 |
|
168 |
warmup_ratio: 0.01
|
169 |
-
# evals_per_epoch: 5
|
170 |
eval_steps: 10
|
171 |
eval_table_size:
|
172 |
eval_table_max_new_tokens: 128
|
173 |
-
# saves_per_epoch: 5
|
174 |
save_steps: 10
|
175 |
save_total_limit: 10
|
176 |
debug:
|
@@ -178,19 +175,33 @@ deepspeed:
|
|
178 |
weight_decay: 0.0
|
179 |
fsdp:
|
180 |
fsdp_config:
|
181 |
-
|
182 |
|
183 |
</details><br>
|
184 |
|
185 |
-
#
|
186 |
|
187 |
-
This model was
|
188 |
It achieves the following results on the evaluation set:
|
189 |
- Loss: 0.8657
|
190 |
|
191 |
## Model description
|
192 |
|
193 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
194 |
|
195 |
## Intended uses & limitations
|
196 |
|
|
|
157 |
tf32: false
|
158 |
|
159 |
gradient_checkpointing: true
|
|
|
160 |
resume_from_checkpoint: true
|
161 |
local_rank:
|
162 |
logging_steps: 1
|
|
|
165 |
|
166 |
|
167 |
warmup_ratio: 0.01
|
|
|
168 |
eval_steps: 10
|
169 |
eval_table_size:
|
170 |
eval_table_max_new_tokens: 128
|
|
|
171 |
save_steps: 10
|
172 |
save_total_limit: 10
|
173 |
debug:
|
|
|
175 |
weight_decay: 0.0
|
176 |
fsdp:
|
177 |
fsdp_config:
|
178 |
+
```
|
179 |
|
180 |
</details><br>
|
181 |
|
182 |
+
# ping98k/typhoon-7b-en-to-th-lora
|
183 |
|
184 |
+
This model was finetune on the scb_mt_enth_2020 dataset.
|
185 |
It achieves the following results on the evaluation set:
|
186 |
- Loss: 0.8657
|
187 |
|
188 |
## Model description
|
189 |
|
190 |
+
### prompt
|
191 |
+
```
|
192 |
+
Why can camels survive for long without water?<translate>
|
193 |
+
```
|
194 |
+
### output
|
195 |
+
```
|
196 |
+
ทำไมอูฐสามารถอยู่รอดได้นานโดยไม่มีน้ำ
|
197 |
+
```
|
198 |
+
### known issue
|
199 |
+
model not train with end translate token correctly. some time model will output `<translate>` or `</translate>`
|
200 |
+
```
|
201 |
+
ทำไมอูฐสามารถอยู่รอดได้นานโดยไม่มีน้ำ<translate>
|
202 |
+
|
203 |
+
ทำไมอูฐสามารถอยู่รอดได้นานโดยไม่มีน้ำ</translate>
|
204 |
+
```
|
205 |
|
206 |
## Intended uses & limitations
|
207 |
|