google/flan-t5-small

README.md

@@ -4,9 +4,24 @@ tags:
 - generated_from_trainer
 datasets:
 - samsum
+metrics:
+- rouge
 model-index:
 - name: flan-t5-small-samsum
-  results: []
+  results:
+  - task:
+      name: Sequence-to-sequence Language Modeling
+      type: text2text-generation
+    dataset:
+      name: samsum
+      type: samsum
+      config: samsum
+      split: test
+      args: samsum
+    metrics:
+    - name: Rouge1
+      type: rouge
+      value: 41.8884
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -15,6 +30,13 @@ should probably proofread and complete it, then remove this comment. -->
 # flan-t5-small-samsum
 
 This model is a fine-tuned version of [google/flan-t5-small](https://huggingface.co/google/flan-t5-small) on the samsum dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.7427
+- Rouge1: 41.8884
+- Rouge2: 17.881
+- Rougel: 34.4405
+- Rougelsum: 38.1283
+- Gen Len: 16.8437
 
 ## Model description
 
@@ -33,13 +55,20 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 5e-05
+- learning_rate: 1e-05
 - train_batch_size: 16
 - eval_batch_size: 16
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 0
+- num_epochs: 1
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Rouge1  | Rouge2 | Rougel  | Rougelsum | Gen Len |
+|:-------------:|:-----:|:----:|:---------------:|:-------:|:------:|:-------:|:---------:|:-------:|
+| 1.9011        | 1.0   | 32   | 1.7427          | 41.8884 | 17.881 | 34.4405 | 38.1283   | 16.8437 |
+
 
 ### Framework versions