uer commited on
Commit
7cb84a0
1 Parent(s): 820052c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -43,9 +43,9 @@ python3 preprocess.py --corpus_path corpora/lyric.txt \
43
 
44
  ```
45
  python3 pretrain.py --dataset_path lyric_dataset.pt \
46
- --pretrained_model_path gpt2-base-chinese-cluecorpussmall/pytorch_model.bin\
47
  --vocab_path models/google_zh_vocab.txt \
48
- --output_model_path models/lyric_gpt2_seq512_model.bin \
49
  --config_path models/bert_base_config.json \
50
  --world_size 8 --gpu_ranks 0 1 2 3 4 5 6 7 \
51
  --total_steps 100000 --save_checkpoint_steps 10000 --report_steps 5000 \
@@ -58,7 +58,7 @@ python3 pretrain.py --dataset_path lyric_dataset.pt \
58
  Finally, we convert the pre-trained model into Huggingface's format:
59
 
60
  ```
61
- python3 scripts/convert_gpt2_from_uer_to_huggingface.py --input_model_path lyric_gpt2_seq512_model.bin-100000 \
62
  --output_model_path pytorch_model.bin \
63
  --layers_num 12
64
  ```
 
43
 
44
  ```
45
  python3 pretrain.py --dataset_path lyric_dataset.pt \
46
+ --pretrained_model_path models/cluecorpussmall_gpt2_seq512_model.bin-250000 \
47
  --vocab_path models/google_zh_vocab.txt \
48
+ --output_model_path models/lyric_gpt2_base_model.bin \
49
  --config_path models/bert_base_config.json \
50
  --world_size 8 --gpu_ranks 0 1 2 3 4 5 6 7 \
51
  --total_steps 100000 --save_checkpoint_steps 10000 --report_steps 5000 \
 
58
  Finally, we convert the pre-trained model into Huggingface's format:
59
 
60
  ```
61
+ python3 scripts/convert_gpt2_from_uer_to_huggingface.py --input_model_path lyric_gpt2_base_model.bin-100000 \
62
  --output_model_path pytorch_model.bin \
63
  --layers_num 12
64
  ```