ping98k commited on
Commit
3b18263
·
verified ·
1 Parent(s): ea3fc38

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -7
README.md CHANGED
@@ -157,7 +157,6 @@ fp16: false
157
  tf32: false
158
 
159
  gradient_checkpointing: true
160
- # early_stopping_patience: 3
161
  resume_from_checkpoint: true
162
  local_rank:
163
  logging_steps: 1
@@ -166,11 +165,9 @@ flash_attention: true
166
 
167
 
168
  warmup_ratio: 0.01
169
- # evals_per_epoch: 5
170
  eval_steps: 10
171
  eval_table_size:
172
  eval_table_max_new_tokens: 128
173
- # saves_per_epoch: 5
174
  save_steps: 10
175
  save_total_limit: 10
176
  debug:
@@ -178,19 +175,33 @@ deepspeed:
178
  weight_decay: 0.0
179
  fsdp:
180
  fsdp_config:
181
-
182
 
183
  </details><br>
184
 
185
- # work/out
186
 
187
- This model was trained from scratch on the None dataset.
188
  It achieves the following results on the evaluation set:
189
  - Loss: 0.8657
190
 
191
  ## Model description
192
 
193
- More information needed
 
 
 
 
 
 
 
 
 
 
 
 
 
 
194
 
195
  ## Intended uses & limitations
196
 
 
157
  tf32: false
158
 
159
  gradient_checkpointing: true
 
160
  resume_from_checkpoint: true
161
  local_rank:
162
  logging_steps: 1
 
165
 
166
 
167
  warmup_ratio: 0.01
 
168
  eval_steps: 10
169
  eval_table_size:
170
  eval_table_max_new_tokens: 128
 
171
  save_steps: 10
172
  save_total_limit: 10
173
  debug:
 
175
  weight_decay: 0.0
176
  fsdp:
177
  fsdp_config:
178
+ ```
179
 
180
  </details><br>
181
 
182
+ # ping98k/typhoon-7b-en-to-th-lora
183
 
184
+ This model was finetune on the scb_mt_enth_2020 dataset.
185
  It achieves the following results on the evaluation set:
186
  - Loss: 0.8657
187
 
188
  ## Model description
189
 
190
+ ### prompt
191
+ ```
192
+ Why can camels survive for long without water?<translate>
193
+ ```
194
+ ### output
195
+ ```
196
+ ทำไมอูฐสามารถอยู่รอดได้นานโดยไม่มีน้ำ
197
+ ```
198
+ ### known issue
199
+ model not train with end translate token correctly. some time model will output `<translate>` or `</translate>`
200
+ ```
201
+ ทำไมอูฐสามารถอยู่รอดได้นานโดยไม่มีน้ำ<translate>
202
+
203
+ ทำไมอูฐสามารถอยู่รอดได้นานโดยไม่มีน้ำ</translate>
204
+ ```
205
 
206
  ## Intended uses & limitations
207