Add evaluation results on the samsum config of samsum

#4
by autoevaluator HF staff - opened
Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -205,6 +205,39 @@ model-index:
205
  type: gen_len
206
  value: 294.7317
207
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
208
  ---
209
 
210
  # long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP
 
205
  type: gen_len
206
  value: 294.7317
207
  verified: true
208
+ - task:
209
+ type: summarization
210
+ name: Summarization
211
+ dataset:
212
+ name: samsum
213
+ type: samsum
214
+ config: samsum
215
+ split: test
216
+ metrics:
217
+ - name: ROUGE-1
218
+ type: rouge
219
+ value: 25.4769
220
+ verified: true
221
+ - name: ROUGE-2
222
+ type: rouge
223
+ value: 6.0336
224
+ verified: true
225
+ - name: ROUGE-L
226
+ type: rouge
227
+ value: 17.9249
228
+ verified: true
229
+ - name: ROUGE-LSUM
230
+ type: rouge
231
+ value: 22.0692
232
+ verified: true
233
+ - name: loss
234
+ type: loss
235
+ value: .nan
236
+ verified: true
237
+ - name: gen_len
238
+ type: gen_len
239
+ value: 53.8242
240
+ verified: true
241
  ---
242
 
243
  # long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP