42dot
/

42dot_LLM-PLM-1.3B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

ykhwang commited on Sep 14, 2023

Commit

5e08339

·

1 Parent(s): f36cfbf

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -25,7 +25,7 @@ license: cc-by-nc-4.0
 ### Pre-training
-Pre-training took 8 days using 256 * NVIDIA A100 GPUs. Related settings are listed below.
 | Params | Global batch size\* | Initial learning rate | Train iter.\* | Max length\* | Weight decay |
 | -- | -- | -- | -- | -- | -- |

 ### Pre-training
+Pre-training took about 49K GPU hours (NVIDIA A100). Related settings are listed below.
 | Params | Global batch size\* | Initial learning rate | Train iter.\* | Max length\* | Weight decay |
 | -- | -- | -- | -- | -- | -- |