End of training

README.md

@@ -1,4 +1,6 @@
 ---
+language:
+- en
 license: apache-2.0
 base_model: openai/whisper-tiny
 tags:
@@ -6,19 +8,19 @@ tags:
 metrics:
 - wer
 model-index:
-- name: whisper-finetuned-bial2
+- name: bhattasp/whisper-finetuned-bial2
   results: []
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
-# whisper-finetuned-bial2
+# bhattasp/whisper-finetuned-bial2
 
-This model is a fine-tuned version of [openai/whisper-tiny](https://huggingface.co/openai/whisper-tiny) on the None dataset.
+This model is a fine-tuned version of [openai/whisper-tiny](https://huggingface.co/openai/whisper-tiny) on the bial2 dataset.
 It achieves the following results on the evaluation set:
-- Loss: 3.0133
-- Wer: 0.3644
+- Loss: 0.3088
+- Wer: 29.3953
 
 ## Model description
 
@@ -38,23 +40,21 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 1e-05
-- train_batch_size: 1
+- train_batch_size: 16
 - eval_batch_size: 8
 - seed: 42
-- gradient_accumulation_steps: 2
-- total_train_batch_size: 2
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 3
+- lr_scheduler_warmup_steps: 500
+- training_steps: 2000
 - mixed_precision_training: Native AMP
 
 ### Training results
 
-| Training Loss | Epoch  | Step | Validation Loss | Wer    |
-|:-------------:|:------:|:----:|:---------------:|:------:|
-| 0.4274        | 0.9997 | 1847 | 2.1904          | 0.5347 |
-| 0.2169        | 2.0    | 3695 | 2.5839          | 0.2946 |
-| 0.1196        | 2.9992 | 5541 | 3.0133          | 0.3644 |
+| Training Loss | Epoch  | Step | Validation Loss | Wer     |
+|:-------------:|:------:|:----:|:---------------:|:-------:|
+| 0.1482        | 4.3290 | 1000 | 0.3253          | 31.3301 |
+| 0.0563        | 8.6580 | 2000 | 0.3088          | 29.3953 |
 
 
 ### Framework versions

generation_config.json

@@ -32,16 +32,6 @@
   "bos_token_id": 50257,
   "decoder_start_token_id": 50258,
   "eos_token_id": 50257,
-  "forced_decoder_ids": [
-    [
-      1,
-      null
-    ],
-    [
-      2,
-      50359
-    ]
-  ],
   "is_multilingual": true,
   "lang_to_id": {
     "<|af|>": 50327,
@@ -144,6 +134,7 @@
     "<|yo|>": 50325,
     "<|zh|>": 50260
   },
+  "language": "english",
   "max_initial_timestamp_index": 50,
   "max_length": 448,
   "no_timestamps_token_id": 50363,
@@ -240,6 +231,7 @@
     50361,
     50362
   ],
+  "task": "transcribe",
   "task_to_id": {
     "transcribe": 50359,
     "translate": 50358