Hugging Face's logo

LDDon
/
distilroberta-base-finetuned-wikitext2

Fill-Mask
Transformers
TensorBoard
Safetensors
roberta
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
LDDon commited on
Commit
5100107
•
1 Parent(s): 000b4b5

End of training

Browse files
Files changed (5) hide show
  1. README.md +7 -7
  2. model.safetensors +1 -1
  3. runs/Apr14_12-06-53_cb6a4e3c1638/events.out.tfevents.1713096498.cb6a4e3c1638.2987.2 +3 -0
  4. runs/Apr14_12-06-53_cb6a4e3c1638/events.out.tfevents.1713097102.cb6a4e3c1638.2987.3 +3 -0
  5. training_args.bin +1 -1
README.md CHANGED
@@ -13,9 +13,9 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  # distilroberta-base-finetuned-wikitext2
15
 
16
- This model is a fine-tuned version of [distilroberta-base](https://huggingface.co/distilroberta-base) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 1.8615
19
 
20
  ## Model description
21
 
@@ -46,14 +46,14 @@ The following hyperparameters were used during training:
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
- | 2.0802 | 1.0 | 2406 | 1.9351 |
50
- | 1.9894 | 2.0 | 4812 | 1.8849 |
51
- | 1.9445 | 3.0 | 7218 | 1.8342 |
52
 
53
 
54
  ### Framework versions
55
 
56
  - Transformers 4.40.0.dev0
57
- - Pytorch 2.2.1
58
- - Datasets 2.15.0
59
  - Tokenizers 0.15.2
 
13
 
14
  # distilroberta-base-finetuned-wikitext2
15
 
16
+ This model is a fine-tuned version of [distilroberta-base](https://huggingface.co/distilroberta-base) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 1.7293
19
 
20
  ## Model description
21
 
 
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
+ | No log | 1.0 | 125 | 1.8151 |
50
+ | No log | 2.0 | 250 | 1.7528 |
51
+ | No log | 3.0 | 375 | 1.7018 |
52
 
53
 
54
  ### Framework versions
55
 
56
  - Transformers 4.40.0.dev0
57
+ - Pytorch 2.2.1+cu121
58
+ - Datasets 2.18.0
59
  - Tokenizers 0.15.2
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b6add090abf84cd7bc05c1eb0c927cb22472712510363358df8683c99ee63642
3
  size 328693404
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:447e7978185573185d1f19a5a1c3b92cc4b4f380db64082a716b3487c836bf57
3
  size 328693404
runs/Apr14_12-06-53_cb6a4e3c1638/events.out.tfevents.1713096498.cb6a4e3c1638.2987.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf30215700dc461d0f5bb0ec203ffbc0450b6e1e49ef7884458df7bbda910a31
3
+ size 5875
runs/Apr14_12-06-53_cb6a4e3c1638/events.out.tfevents.1713097102.cb6a4e3c1638.2987.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:db58f08bd592f1f1587b9dd3f0b8275e90f605d014c2c7f24bce11e77a24d577
3
+ size 359
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:eee9e1701969b8ff2b2b68cf4c462f1c1e4687eaaf785eaf9fa3278baac129a0
3
  size 4984
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa748f9ed5fb8c766e713fc19461346e15deff6989fa799753d031c100458e49
3
  size 4984