End of training

README.md

@@ -0,0 +1,59 @@
+---
+license: apache-2.0
+base_model: distilgpt2
+tags:
+- generated_from_trainer
+model-index:
+- name: distilgpt2-0404
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# distilgpt2-0404
+
+This model is a fine-tuned version of [distilgpt2](https://huggingface.co/distilgpt2) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 2.5551
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 2e-05
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 3.0
+
+### Training results
+
+| Training Loss | Epoch | Step  | Validation Loss |
+|:-------------:|:-----:|:-----:|:---------------:|
+| 2.4511        | 1.0   | 23726 | 2.6581          |
+| 2.3019        | 2.0   | 47452 | 2.5781          |
+| 2.2763        | 3.0   | 71178 | 2.5551          |
+
+
+### Framework versions
+
+- Transformers 4.40.0.dev0
+- Pytorch 2.2.1+cu121
+- Datasets 2.18.0
+- Tokenizers 0.15.2

generation_config.json

@@ -0,0 +1,6 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 50256,
+  "eos_token_id": 50256,
+  "transformers_version": "4.40.0.dev0"
+}

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ad13d003082e69917e9f91bde8b68c3aa8a63f7f9093c3abc81cf9c2a0f3ea65
+oid sha256:1812f17a9fb1b5ee237a1122976a3c77a0240f87c8613c827a27191ff249ba4d
 size 327657928

runs/Apr04_13-47-46_DESKTOP-UKDCQ6G/events.out.tfevents.1712209679.DESKTOP-UKDCQ6G.1036.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b60093713808e630629268dc7e1045347eb35fb0b77017014b4c3a6312d60bb3
-size 35892
+oid sha256:671e6e5c5c08775cf2379559acc10e8b73c0ada1bdbf0a7047ceebc3b250f9d0
+size 36528

runs/Apr04_13-47-46_DESKTOP-UKDCQ6G/events.out.tfevents.1712216587.DESKTOP-UKDCQ6G.1036.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:65e913bd89432d60a987364f7b48e5a64926ea1a0490d979b81901329f292d0d
+size 364