File size: 1,757 Bytes
b9d4392
 
 
 
 
 
 
 
 
 
 
8d3bc4f
 
 
 
 
 
 
 
 
 
f893ded
8d3bc4f
 
 
 
 
 
 
 
 
 
 
 
b9d4392
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
---
language: 
  - en
tags:
- QA
- Question Answering
- SQuAD
license: "mit"
datasets:
- squad
metrics:
- squad

model-index:
- name: xtremedistil-l6-h256-uncased
  results:
  - task:
      type: question-answering             # Required. Example: automatic-speech-recognition
      name: Question Answering             # Optional. Example: Speech Recognition
    dataset:
      type: squad          # Required. Example: common_voice. Use dataset id from https://hf.co/datasets
      name: SQuAD          # Required. A pretty name for the dataset. Example: Common Voice (French)
      split: validation        # Optional. Example: test
     
    metrics:
      - type: squad         # Required. Example: wer. Use metric id from https://hf.co/metrics
        value: 62.66792809839168       # Required. Example: 20.90
        name: SQuAD EM         # Optional. Example: Test WER
        config: exact_match     # Optional. The name of the metric configuration used in `load_metric()`. Example: bleurt-large-512 in `load_metric("bleurt", "bleurt-large-512")`. See the `datasets` docs for more info: https://huggingface.co/docs/datasets/v2.1.0/en/loading#load-configurations
      - type: squad         # Required. Example: wer. Use metric id from https://hf.co/metrics
        value: 74.99490608582015       # Required. Example: 20.90
        name: SQuAD F1         # Optional. Example: Test WER
        config: F1
       
---

microsoft/xtremedistil-l6-h256-uncased fined-tuned on SQuAD (https://huggingface.co/datasets/squad)

Hyperparameters:
- epochs: 1
- lr: 1e-5
- train batch sie: 16
- optimizer: adamW
- lr_scheduler: linear
- num warming steps: 0
- max_length: 512

Results on the dev set:
- 'exact_match': 62.66792809839168
- 'f1': 74.99490608582015