JELAshford commited on
Commit
dc662bc
1 Parent(s): 9bde3a3

End of training

Browse files
Files changed (2) hide show
  1. README.md +5 -4
  2. model.safetensors +1 -1
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [distilgpt2](https://huggingface.co/distilgpt2) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 3.6445
19
 
20
  ## Model description
21
 
@@ -41,14 +41,15 @@ The following hyperparameters were used during training:
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
  - num_epochs: 3.0
 
44
 
45
  ### Training results
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
- | 3.761 | 1.0 | 2334 | 3.6677 |
50
- | 3.6486 | 2.0 | 4668 | 3.6473 |
51
- | 3.605 | 3.0 | 7002 | 3.6445 |
52
 
53
 
54
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [distilgpt2](https://huggingface.co/distilgpt2) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 3.6439
19
 
20
  ## Model description
21
 
 
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
  - num_epochs: 3.0
44
+ - mixed_precision_training: Native AMP
45
 
46
  ### Training results
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
+ | 3.7609 | 1.0 | 2334 | 3.6672 |
51
+ | 3.6483 | 2.0 | 4668 | 3.6468 |
52
+ | 3.6047 | 3.0 | 7002 | 3.6439 |
53
 
54
 
55
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c72de254194abdc82b8b0c645a491374b6303e9d67a35518828e800627ca58e9
3
  size 327657928
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:09303794cc504211a1798e1a48c7ef49bd06aae28b0008b656d7ba277d13d72d
3
  size 327657928