fine_tuned_t5_small_model_sec_5_v13

README.md

@@ -18,13 +18,13 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 2.9991
-- Rouge1: 0.4046
-- Rouge2: 0.1585
-- Rougel: 0.2567
-- Rougelsum: 0.2569
-- Gen Len: 94.9263
-- Bert F1: 0.8757
+- Loss: 2.9766
+- Rouge1: 0.3717
+- Rouge2: 0.1454
+- Rougel: 0.2451
+- Rougelsum: 0.2447
+- Gen Len: 167.6053
+- Bert F1: 0.86
 
 ## Model description
 
@@ -54,12 +54,12 @@ The following hyperparameters were used during training:
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len | Bert F1 |
-|:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|:-------:|
-| 3.5483        | 1.0   | 95   | 3.1402          | 0.409  | 0.1649 | 0.2588 | 0.2594    | 97.2947 | 0.8751  |
-| 3.1867        | 2.0   | 190  | 3.0364          | 0.4075 | 0.1591 | 0.2556 | 0.2558    | 97.8263 | 0.8754  |
-| 3.1221        | 3.0   | 285  | 3.0062          | 0.407  | 0.1599 | 0.2569 | 0.2572    | 95.0579 | 0.8759  |
-| 3.0951        | 4.0   | 380  | 2.9991          | 0.4046 | 0.1585 | 0.2567 | 0.2569    | 94.9263 | 0.8757  |
+| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len  | Bert F1 |
+|:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:--------:|:-------:|
+| 3.5821        | 1.0   | 95   | 3.1263          | 0.3818 | 0.1448 | 0.2426 | 0.2422    | 146.6684 | 0.8607  |
+| 3.1907        | 2.0   | 190  | 3.0156          | 0.3772 | 0.144  | 0.2436 | 0.2433    | 156.6421 | 0.8616  |
+| 3.1261        | 3.0   | 285  | 2.9852          | 0.3717 | 0.143  | 0.2425 | 0.2423    | 165.4684 | 0.86    |
+| 3.1135        | 4.0   | 380  | 2.9766          | 0.3717 | 0.1454 | 0.2451 | 0.2447    | 167.6053 | 0.86    |
 
 
 ### Framework versions

generation_config.json

@@ -1,8 +1,8 @@
 {
   "decoder_start_token_id": 0,
   "eos_token_id": 1,
-  "max_length": 150,
-  "min_length": 50,
+  "max_length": 250,
+  "min_length": 200,
   "num_beams": 4,
   "pad_token_id": 0,
   "temperature": 3,

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:49c6b7bb20bfcf17ef7f84c6a0cee5dc4ffbe490923b1e1eb9ee196ac82dcae1
+oid sha256:fc921c33e2a7cfbb62cbe0773f737f26c5cf7d2cae5406744bf09846e0ca6934
 size 242041896