TSingye/DYG_DistillGPT-2

README.md

@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [distilbert/distilgpt2](https://huggingface.co/distilbert/distilgpt2) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.7060
+- Loss: 0.4678
 
 ## Model description
 
@@ -41,17 +41,22 @@ The following hyperparameters were used during training:
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
 - lr_scheduler_warmup_steps: 100
-- num_epochs: 5
+- num_epochs: 10
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| No log        | 1.0   | 8    | 1.3841          |
-| No log        | 2.0   | 16   | 1.0863          |
-| No log        | 3.0   | 24   | 0.9460          |
-| No log        | 4.0   | 32   | 0.7906          |
-| No log        | 5.0   | 40   | 0.7060          |
+| No log        | 1.0   | 8    | 0.6735          |
+| No log        | 2.0   | 16   | 0.6331          |
+| No log        | 3.0   | 24   | 0.6168          |
+| No log        | 4.0   | 32   | 0.5801          |
+| No log        | 5.0   | 40   | 0.5487          |
+| No log        | 6.0   | 48   | 0.5625          |
+| No log        | 7.0   | 56   | 0.5189          |
+| No log        | 8.0   | 64   | 0.4941          |
+| No log        | 9.0   | 72   | 0.4708          |
+| No log        | 10.0  | 80   | 0.4678          |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a94fc5dcb4cf219602c17323c177a32d8e6f706229e73d729af96463b2ceaca5
+oid sha256:4ee3117a24598f7eadd427c7afbeb946cb5f1acd4cca5426a1fb4aed1f8e364c
 size 327657928

runs/May14_16-26-45_06490c7a1391/events.out.tfevents.1715704009.06490c7a1391.536.2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:71c440d36022a4ee487d8bec88ea39fb18d797cae39b3cc2df43556001605c27
+size 8198

runs/May14_16-26-45_06490c7a1391/events.out.tfevents.1715706444.06490c7a1391.536.3

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9aeb955a265f0ee740b25c803b2a140d43792b8aabb095a40d0e9d4f6aa0e38f
+size 354

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c4deeb167d7face715e1c1ab0b5d3383d7124c986cf5fcd2ed91519077ec920f
+oid sha256:5bd21876bb25b0e411aab90fe09c4e6df541afec275ca4cb73d1a73f61272153
 size 5048