smangrul commited on
Commit
adb67de
·
1 Parent(s): 2a5d0af

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -8
README.md CHANGED
@@ -33,11 +33,17 @@ should probably proofread and complete it, then remove this comment. -->
33
 
34
  #
35
 
36
- This model is a fine-tuned version of [facebook/wav2vec2-xls-r-300m](https://huggingface.co/facebook/wav2vec2-xls-r-300m) on the MOZILLA-FOUNDATION/COMMON_VOICE_8_0 - MR dataset.
37
  It achieves the following results on the evaluation set:
38
  - Loss: 0.494580
39
  - Wer: 0.401524
40
 
 
 
 
 
 
 
41
  ## Model description
42
 
43
  More information needed
@@ -107,16 +113,16 @@ The following hyperparameters were used during training:
107
  | 13600 | 0.266300 | 0.498627 | 0.397513 |
108
  | 14000 | 0.259600 | 0.504610 | 0.401524 |
109
 
 
 
 
 
 
 
 
110
  ### Framework versions
111
 
112
  - Transformers 4.17.0.dev0
113
  - Pytorch 1.10.2+cu113
114
  - Datasets 1.18.3.dev0
115
  - Tokenizers 0.11.0
116
-
117
-
118
- ### Eval results on Common Voice 8 "test" (WER):
119
-
120
- | Without LM | With LM |
121
- |---|---|
122
- | 40.513437625350984 | 31.04693140794224 |
 
33
 
34
  #
35
 
36
+ This model is a fine-tuned version of [facebook/wav2vec2-xls-r-300m](https://huggingface.co/facebook/wav2vec2-xls-r-300m) on the MOZILLA-FOUNDATION/COMMON_VOICE_8_0 - MR and OPENSLR - SLR64 - MR datasets.
37
  It achieves the following results on the evaluation set:
38
  - Loss: 0.494580
39
  - Wer: 0.401524
40
 
41
+ ### Eval results on Common Voice 8 "test" (WER):
42
+
43
+ | Without LM | With LM |
44
+ |---|---|
45
+ | 40.513437625350984 | 31.04693140794224 |
46
+
47
  ## Model description
48
 
49
  More information needed
 
113
  | 13600 | 0.266300 | 0.498627 | 0.397513 |
114
  | 14000 | 0.259600 | 0.504610 | 0.401524 |
115
 
116
+ #### Evaluation Commands
117
+ To evaluate on `mozilla-foundation/common_voice_8_0` with split `test`
118
+
119
+ ```bash
120
+ python eval.py --model_id smangrul/xls-r-mr-model --dataset mozilla-foundation/common_voice_8_0 --config mr --split test
121
+ ```
122
+
123
  ### Framework versions
124
 
125
  - Transformers 4.17.0.dev0
126
  - Pytorch 1.10.2+cu113
127
  - Datasets 1.18.3.dev0
128
  - Tokenizers 0.11.0