Model save

README.md

@@ -1,6 +1,6 @@
 ---
 license: apache-2.0
-base_model: google/t5-efficient-tiny
+base_model: t5-small
 tags:
 - generated_from_trainer
 metrics:
@@ -15,14 +15,14 @@ should probably proofread and complete it, then remove this comment. -->
 
 # denoice-finetuned-xsum
 
-This model is a fine-tuned version of [google/t5-efficient-tiny](https://huggingface.co/google/t5-efficient-tiny) on an unknown dataset.
+This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: nan
-- Rouge1: 0.0
-- Rouge2: 0.0
-- Rougel: 0.0
-- Rougelsum: 0.0
-- Gen Len: 0.0
+- Loss: 0.7794
+- Rouge1: 71.0141
+- Rouge2: 53.0457
+- Rougel: 71.0918
+- Rougelsum: 71.0572
+- Gen Len: 16.5681
 
 ## Model description
 
@@ -42,19 +42,22 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 2e-05
-- train_batch_size: 16
-- eval_batch_size: 16
+- train_batch_size: 500
+- eval_batch_size: 500
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 1
-- mixed_precision_training: Native AMP
+- num_epochs: 5
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
-|:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
-| 0.0           | 1.0   | 2361 | nan             | 0.0    | 0.0    | 0.0    | 0.0       | 0.0     |
+| Training Loss | Epoch | Step | Validation Loss | Rouge1  | Rouge2  | Rougel  | Rougelsum | Gen Len |
+|:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:-------:|
+| No log        | 1.0   | 76   | 0.8037          | 70.2689 | 52.2689 | 70.2756 | 70.2269   | 16.5707 |
+| No log        | 2.0   | 152  | 0.7922          | 70.7975 | 52.7278 | 70.8142 | 70.8439   | 16.5576 |
+| No log        | 3.0   | 228  | 0.7846          | 70.8221 | 52.6361 | 70.9459 | 70.8784   | 16.5314 |
+| No log        | 4.0   | 304  | 0.7805          | 71.0252 | 53.0551 | 71.0992 | 71.0725   | 16.5576 |
+| No log        | 5.0   | 380  | 0.7794          | 71.0141 | 53.0457 | 71.0918 | 71.0572   | 16.5681 |
 
 
 ### Framework versions

config.json

@@ -54,7 +54,7 @@
       "prefix": "translate English to Romanian: "
     }
   },
-  "torch_dtype": "float32",
+  "torch_dtype": "float16",
   "transformers_version": "4.36.2",
   "use_cache": true,
   "vocab_size": 32128

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:17d81a94215036f891ab2bb3eda7668b7428308e88cf178cda16a094607b907f
-size 242041896
+oid sha256:17d5275952f252ade0dc40af67210bf2ab984ef5084b8bb994cb41b03336f7e6
+size 121028528

tokenizer.json

@@ -2,14 +2,12 @@
   "version": "1.0",
   "truncation": {
     "direction": "Right",
-    "max_length": 20,
+    "max_length": 512,
     "strategy": "LongestFirst",
     "stride": 0
   },
   "padding": {
-    "strategy": {
-      "Fixed": 20
-    },
+    "strategy": "BatchLongest",
     "direction": "Right",
     "pad_to_multiple_of": null,
     "pad_id": 0,

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4a9c0de4633bd97f9a4ecf1628ba3d8b368bfd3cbdcbf3f3dbbaf9e57c0545a3
+oid sha256:ae791766be47cce07d2ca7d0d9f1606c27b3feded8f1d4b33d89bd37e39fe22a
 size 4411