File size: 1,117 Bytes
9823b01 e658dc0 38db0dc e658dc0 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 |
---
datasets:
- ccdv/govreport-summarization
metrics:
- rouge
- bleu
pipeline_tag: summarization
---
# Hyperparameters
learning_rate=2e-5
per_device_train_batch_size=14
per_device_eval_batch_size=14
weight_decay=0.01
save_total_limit=3
num_train_epochs=3
predict_with_generate=True
fp16=True
# Training Output
global_step=3003,
training_loss=2.0113779983241042,
metrics={'train_runtime': 12268.4376,
'train_samples_per_second': 3.427,
'train_steps_per_second': 0.245,
'total_flos': 1.2147019450889011e+17,
'train_loss': 2.0113779983241042,
'epoch': 3.0}
# Training Results
| Epoch | Training Loss | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Bleu | Gen Len |
|:----- |:------------ |:--------------- |:-------- | :------- |:-------- |:--------- |:-------- |:--------- |
1| 2.035800| 1.906599| 0.365400| 0.150500| 0.243200 |0.243500 |0.366300| 227.230300|
2| 1.976100| 1.878923| 0.393700| 0.167800| 0.263500 |0.263800 |0.423600| 193.114200|
3| 1.956800| 1.871454| 0.409300| 0.175100| 0.273400 |0.273600 |0.457000| 172.294500| |