Update README.md
Browse files
README.md
CHANGED
@@ -31,4 +31,11 @@ The topic is about racecars
|
|
31 |
<|startoftext|>[INST]
|
32 |
Who was the was the second president of the United States?
|
33 |
[/INST]
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
34 |
```
|
|
|
31 |
<|startoftext|>[INST]
|
32 |
Who was the was the second president of the United States?
|
33 |
[/INST]
|
34 |
+
```
|
35 |
+
|
36 |
+
# Training script:
|
37 |
+
Fully opensourced at: https://github.com/hengjiUSTC/learn-llm/blob/main/trl_finetune.py. Run on aws g4dn.12xlarge instance for 4 hours.
|
38 |
+
|
39 |
+
```
|
40 |
+
python3 trl_finetune.py --config configs/yi_6b.yml
|
41 |
```
|