metadata
license: apache-2.0
base_model: openai/whisper-tiny
tags:
- generated_from_trainer
model-index:
- name: whisper-tiny-kor-430k-hf-ep100
results: []
whisper-tiny-kor-430k-hf-ep100
This model is a fine-tuned version of openai/whisper-tiny on the None dataset. It achieves the following results on the evaluation set:
- Loss: 0.4802
- Cer: 7.0810
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 128
- eval_batch_size: 32
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 500
- num_epochs: 100
- mixed_precision_training: Native AMP
Training results
| Training Loss | Epoch | Step | Validation Loss | Cer |
|---|---|---|---|---|
| 0.0276 | 1.0 | 2969 | 0.1394 | 10.5081 |
| 0.0115 | 2.0 | 5938 | 0.1684 | 9.0941 |
| 0.0082 | 3.0 | 8907 | 0.1932 | 8.4145 |
| 0.0063 | 4.0 | 11876 | 0.2197 | 7.8659 |
| 0.0052 | 5.0 | 14845 | 0.2516 | 7.7668 |
| 0.0047 | 6.0 | 17814 | 0.2314 | 8.0565 |
| 0.004 | 7.0 | 20783 | 0.2270 | 8.3521 |
| 0.0037 | 8.0 | 23752 | 0.2540 | 7.8283 |
| 0.0033 | 9.0 | 26721 | 0.2586 | 7.9098 |
| 0.0028 | 10.0 | 29690 | 0.2891 | 7.4437 |
| 0.0029 | 11.0 | 32659 | 0.2796 | 7.7976 |
| 0.0025 | 12.0 | 35628 | 0.2630 | 8.2731 |
| 0.0025 | 13.0 | 38597 | 0.2955 | 7.8518 |
| 0.0025 | 14.0 | 41566 | 0.2812 | 7.4797 |
| 0.002 | 15.0 | 44535 | 0.2859 | 7.9954 |
| 0.0023 | 16.0 | 47504 | 0.3172 | 7.2374 |
| 0.002 | 17.0 | 50473 | 0.3382 | 7.5966 |
| 0.0018 | 18.0 | 53442 | 0.3320 | 7.6383 |
| 0.0018 | 19.0 | 56411 | 0.3197 | 7.6900 |
| 0.0015 | 20.0 | 59380 | 0.3305 | 8.3678 |
| 0.0016 | 21.0 | 62349 | 0.3409 | 7.5117 |
| 0.0015 | 22.0 | 65318 | 0.3382 | 7.8556 |
| 0.0016 | 23.0 | 68287 | 0.3282 | 7.5863 |
| 0.0015 | 24.0 | 71256 | 0.3220 | 8.2449 |
| 0.0013 | 25.0 | 74225 | 0.3272 | 7.7731 |
| 0.0015 | 26.0 | 77194 | 0.3557 | 7.8019 |
| 0.0014 | 27.0 | 80163 | 0.3807 | 7.3311 |
| 0.0012 | 28.0 | 83132 | 0.3398 | 7.8117 |
| 0.0013 | 29.0 | 86101 | 0.3892 | 7.6089 |
| 0.001 | 30.0 | 89070 | 0.3876 | 7.7875 |
| 0.0011 | 31.0 | 92039 | 0.3942 | 7.3922 |
| 0.0012 | 32.0 | 95008 | 0.3836 | 8.0308 |
| 0.0011 | 33.0 | 97977 | 0.3745 | 7.9775 |
| 0.001 | 34.0 | 100946 | 0.3605 | 8.0117 |
| 0.001 | 35.0 | 103915 | 0.3615 | 7.4853 |
| 0.001 | 36.0 | 106884 | 0.3563 | 7.5916 |
| 0.0009 | 37.0 | 109853 | 0.3469 | 7.4750 |
| 0.0009 | 38.0 | 112822 | 0.3940 | 7.5919 |
| 0.0009 | 39.0 | 115791 | 0.3771 | 7.5443 |
| 0.0009 | 40.0 | 118760 | 0.3392 | 7.6593 |
| 0.0009 | 41.0 | 121729 | 0.3498 | 7.6393 |
| 0.0009 | 42.0 | 124698 | 0.3705 | 7.4474 |
| 0.0008 | 43.0 | 127667 | 0.3758 | 7.2274 |
| 0.0008 | 44.0 | 130636 | 0.3944 | 7.6919 |
| 0.0009 | 45.0 | 133605 | 0.3885 | 7.5565 |
| 0.0008 | 46.0 | 136574 | 0.3830 | 7.4628 |
| 0.0008 | 47.0 | 139543 | 0.3972 | 7.8546 |
| 0.0008 | 48.0 | 142512 | 0.3875 | 7.4916 |
| 0.0007 | 49.0 | 145481 | 0.3438 | 7.2606 |
| 0.0007 | 50.0 | 148450 | 0.3540 | 7.1581 |
| 0.0008 | 51.0 | 151419 | 0.3768 | 7.1712 |
| 0.0007 | 52.0 | 154388 | 0.4050 | 7.2286 |
| 0.0007 | 53.0 | 157357 | 0.3785 | 7.4637 |
| 0.0008 | 54.0 | 160326 | 0.4145 | 7.4800 |
| 0.0008 | 55.0 | 163295 | 0.4042 | 7.3791 |
| 0.0006 | 56.0 | 166264 | 0.3885 | 7.6994 |
| 0.0006 | 57.0 | 169233 | 0.4153 | 7.5440 |
| 0.0006 | 58.0 | 172202 | 0.4111 | 7.3408 |
| 0.0006 | 59.0 | 175171 | 0.4147 | 7.2872 |
| 0.0006 | 60.0 | 178140 | 0.4209 | 7.6270 |
| 0.0006 | 61.0 | 181109 | 0.4041 | 7.4258 |
| 0.0006 | 62.0 | 184078 | 0.4032 | 7.5324 |
| 0.0006 | 63.0 | 187047 | 0.4214 | 7.3687 |
| 0.0005 | 64.0 | 190016 | 0.3991 | 7.2750 |
| 0.0005 | 65.0 | 192985 | 0.3885 | 7.1731 |
| 0.0006 | 66.0 | 195954 | 0.4087 | 7.5063 |
| 0.0005 | 67.0 | 198923 | 0.3760 | 7.4913 |
| 0.0005 | 68.0 | 201892 | 0.3929 | 7.3314 |
| 0.0005 | 69.0 | 204861 | 0.4044 | 7.5173 |
| 0.0005 | 70.0 | 207830 | 0.4075 | 7.2712 |
| 0.0005 | 71.0 | 210799 | 0.4170 | 7.2415 |
| 0.0005 | 72.0 | 213768 | 0.4148 | 7.1142 |
| 0.0005 | 73.0 | 216737 | 0.4271 | 7.3020 |
| 0.0005 | 74.0 | 219706 | 0.4281 | 7.1863 |
| 0.0004 | 75.0 | 222675 | 0.4202 | 7.1543 |
| 0.0005 | 76.0 | 225644 | 0.4320 | 7.2910 |
| 0.0005 | 77.0 | 228613 | 0.4328 | 7.3995 |
| 0.0005 | 78.0 | 231582 | 0.4304 | 7.2255 |
| 0.0005 | 79.0 | 234551 | 0.4537 | 7.0023 |
| 0.0005 | 80.0 | 237520 | 0.4544 | 7.2048 |
| 0.0004 | 81.0 | 240489 | 0.4485 | 7.2167 |
| 0.0005 | 82.0 | 243458 | 0.4564 | 7.1794 |
| 0.0004 | 83.0 | 246427 | 0.4608 | 7.2145 |
| 0.0004 | 84.0 | 249396 | 0.4724 | 7.2098 |
| 0.0004 | 85.0 | 252365 | 0.4726 | 7.1424 |
| 0.0004 | 86.0 | 255334 | 0.4754 | 7.2832 |
| 0.0005 | 87.0 | 258303 | 0.4765 | 7.1709 |
| 0.0004 | 88.0 | 261272 | 0.4610 | 7.1358 |
| 0.0004 | 89.0 | 264241 | 0.4697 | 7.0797 |
| 0.0004 | 90.0 | 267210 | 0.4717 | 7.0913 |
| 0.0004 | 91.0 | 270179 | 0.4756 | 7.1017 |
| 0.0004 | 92.0 | 273148 | 0.4766 | 7.2089 |
| 0.0004 | 93.0 | 276117 | 0.4763 | 7.1057 |
| 0.0004 | 94.0 | 279086 | 0.4764 | 7.1101 |
| 0.0004 | 95.0 | 282055 | 0.4759 | 7.2170 |
| 0.0004 | 96.0 | 285024 | 0.4772 | 7.1104 |
| 0.0004 | 97.0 | 287993 | 0.4781 | 7.0819 |
| 0.0004 | 98.0 | 290962 | 0.4798 | 7.0897 |
| 0.0004 | 99.0 | 293931 | 0.4800 | 7.0872 |
| 0.0004 | 100.0 | 296900 | 0.4802 | 7.0810 |
Framework versions
- Transformers 4.36.2
- Pytorch 2.0.1+cu117
- Datasets 2.16.1
- Tokenizers 0.15.0