File size: 2,997 Bytes
41e192d
 
 
 
 
 
4691813
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
d2e47ef
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
a696276
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33dceb6
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
b9743ab
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
---
tags:
- summarization
language:
- en
license: mit
model-index:
- name: facebook/bart-large-xsum
  results:
  - task:
      type: summarization
      name: Summarization
    dataset:
      name: cnn_dailymail
      type: cnn_dailymail
      config: 3.0.0
      split: test
    metrics:
    - name: ROUGE-1
      type: rouge
      value: 25.2697
      verified: true
    - name: ROUGE-2
      type: rouge
      value: 7.6638
      verified: true
    - name: ROUGE-L
      type: rouge
      value: 17.1808
      verified: true
    - name: ROUGE-LSUM
      type: rouge
      value: 21.7933
      verified: true
    - name: loss
      type: loss
      value: 3.5042972564697266
      verified: true
    - name: gen_len
      type: gen_len
      value: 27.4462
      verified: true
  - task:
      type: summarization
      name: Summarization
    dataset:
      name: xsum
      type: xsum
      config: default
      split: test
    metrics:
    - name: ROUGE-1
      type: rouge
      value: 45.4525
      verified: true
    - name: ROUGE-2
      type: rouge
      value: 22.3455
      verified: true
    - name: ROUGE-L
      type: rouge
      value: 37.2302
      verified: true
    - name: ROUGE-LSUM
      type: rouge
      value: 37.2323
      verified: true
    - name: loss
      type: loss
      value: 2.3128726482391357
      verified: true
    - name: gen_len
      type: gen_len
      value: 25.5435
      verified: true
  - task:
      type: summarization
      name: Summarization
    dataset:
      name: samsum
      type: samsum
      config: samsum
      split: train
    metrics:
    - name: ROUGE-1
      type: rouge
      value: 24.7852
      verified: true
    - name: ROUGE-2
      type: rouge
      value: 5.2533
      verified: true
    - name: ROUGE-L
      type: rouge
      value: 18.6792
      verified: true
    - name: ROUGE-LSUM
      type: rouge
      value: 20.629
      verified: true
    - name: loss
      type: loss
      value: 3.746837854385376
      verified: true
    - name: gen_len
      type: gen_len
      value: 23.1206
      verified: true
  - task:
      type: summarization
      name: Summarization
    dataset:
      name: samsum
      type: samsum
      config: samsum
      split: test
    metrics:
    - name: ROUGE-1
      type: rouge
      value: 24.9158
      verified: true
    - name: ROUGE-2
      type: rouge
      value: 5.5837
      verified: true
    - name: ROUGE-L
      type: rouge
      value: 18.8935
      verified: true
    - name: ROUGE-LSUM
      type: rouge
      value: 20.76
      verified: true
    - name: loss
      type: loss
      value: 3.775235891342163
      verified: true
    - name: gen_len
      type: gen_len
      value: 23.0928
      verified: true
---
### Bart model finetuned on xsum

docs: https://huggingface.co/transformers/model_doc/bart.html

finetuning: examples/seq2seq/ (as of Aug 20, 2020)

Metrics: ROUGE > 22 on xsum.

variants: search for distilbart

paper: https://arxiv.org/abs/1910.13461