Model save
Browse files
README.md
CHANGED
|
@@ -1,7 +1,7 @@
|
|
| 1 |
---
|
| 2 |
library_name: transformers
|
| 3 |
license: apache-2.0
|
| 4 |
-
base_model:
|
| 5 |
tags:
|
| 6 |
- generated_from_trainer
|
| 7 |
model-index:
|
|
@@ -14,7 +14,10 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 14 |
|
| 15 |
# for_test
|
| 16 |
|
| 17 |
-
This model is a fine-tuned version of [
|
|
|
|
|
|
|
|
|
|
| 18 |
|
| 19 |
## Model description
|
| 20 |
|
|
@@ -43,6 +46,27 @@ The following hyperparameters were used during training:
|
|
| 43 |
- num_epochs: 10
|
| 44 |
- mixed_precision_training: Native AMP
|
| 45 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 46 |
### Framework versions
|
| 47 |
|
| 48 |
- Transformers 4.44.2
|
|
|
|
| 1 |
---
|
| 2 |
library_name: transformers
|
| 3 |
license: apache-2.0
|
| 4 |
+
base_model: team-lucid/hubert-base-korean
|
| 5 |
tags:
|
| 6 |
- generated_from_trainer
|
| 7 |
model-index:
|
|
|
|
| 14 |
|
| 15 |
# for_test
|
| 16 |
|
| 17 |
+
This model is a fine-tuned version of [team-lucid/hubert-base-korean](https://huggingface.co/team-lucid/hubert-base-korean) on the None dataset.
|
| 18 |
+
It achieves the following results on the evaluation set:
|
| 19 |
+
- Loss: 10074.0381
|
| 20 |
+
- Cer: 0.8429
|
| 21 |
|
| 22 |
## Model description
|
| 23 |
|
|
|
|
| 46 |
- num_epochs: 10
|
| 47 |
- mixed_precision_training: Native AMP
|
| 48 |
|
| 49 |
+
### Training results
|
| 50 |
+
|
| 51 |
+
| Training Loss | Epoch | Step | Validation Loss | Cer |
|
| 52 |
+
|:-------------:|:------:|:----:|:---------------:|:------:|
|
| 53 |
+
| 5400.8619 | 0.6369 | 300 | 13304.7881 | 1.0451 |
|
| 54 |
+
| 4024.1566 | 1.2739 | 600 | 11936.0117 | 0.9169 |
|
| 55 |
+
| 3685.2072 | 1.9108 | 900 | 11838.9512 | 0.8402 |
|
| 56 |
+
| 3836.7075 | 2.5478 | 1200 | 11351.3096 | 0.8275 |
|
| 57 |
+
| 3289.8719 | 3.1847 | 1500 | 11245.4717 | 0.8273 |
|
| 58 |
+
| 3506.6528 | 3.8217 | 1800 | 11008.6963 | 0.8322 |
|
| 59 |
+
| 3340.1028 | 4.4586 | 2100 | 10811.1230 | 0.8335 |
|
| 60 |
+
| 2946.4978 | 5.0955 | 2400 | 10763.3887 | 0.8341 |
|
| 61 |
+
| 3180.8653 | 5.7325 | 2700 | 10414.3926 | 0.8348 |
|
| 62 |
+
| 3159.9134 | 6.3694 | 3000 | 10376.6455 | 0.8354 |
|
| 63 |
+
| 2967.3987 | 7.0064 | 3300 | 10216.6924 | 0.8394 |
|
| 64 |
+
| 3072.4803 | 7.6433 | 3600 | 9977.7178 | 0.8387 |
|
| 65 |
+
| 3011.5284 | 8.2803 | 3900 | 10170.3740 | 0.8414 |
|
| 66 |
+
| 3042.4953 | 8.9172 | 4200 | 10057.4072 | 0.8420 |
|
| 67 |
+
| 3046.5066 | 9.5541 | 4500 | 10074.0381 | 0.8429 |
|
| 68 |
+
|
| 69 |
+
|
| 70 |
### Framework versions
|
| 71 |
|
| 72 |
- Transformers 4.44.2
|