lewtun HF staff autoevaluator HF staff commited on
Commit
cc842da
1 Parent(s): 254548d

Add evaluation results on the samsum config of samsum (#9)

Browse files

- Add evaluation results on the samsum config of samsum (e5fe732506ed92a7f775bbfcf3f8121bdb3d2439)


Co-authored-by: Evaluation Bot <[email protected]>

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -144,6 +144,39 @@ model-index:
144
  type: gen_len
145
  value: 183.3702
146
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
147
  ---
148
 
149
  # BigBirdPegasus model (large)
 
144
  type: gen_len
145
  value: 183.3702
146
  verified: true
147
+ - task:
148
+ type: summarization
149
+ name: Summarization
150
+ dataset:
151
+ name: samsum
152
+ type: samsum
153
+ config: samsum
154
+ split: test
155
+ metrics:
156
+ - name: ROUGE-1
157
+ type: rouge
158
+ value: 3.621
159
+ verified: true
160
+ - name: ROUGE-2
161
+ type: rouge
162
+ value: 0.1699
163
+ verified: true
164
+ - name: ROUGE-L
165
+ type: rouge
166
+ value: 3.2016
167
+ verified: true
168
+ - name: ROUGE-LSUM
169
+ type: rouge
170
+ value: 3.3269
171
+ verified: true
172
+ - name: loss
173
+ type: loss
174
+ value: 7.664482116699219
175
+ verified: true
176
+ - name: gen_len
177
+ type: gen_len
178
+ value: 233.8107
179
+ verified: true
180
  ---
181
 
182
  # BigBirdPegasus model (large)