lewtun HF staff commited on
Commit
a8abad7
·
1 Parent(s): 1a51049

Add evaluation results on the samsum config of samsum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the samsum config of the [samsum](https://huggingface.co/datasets/samsum) dataset by

@pszemraj
, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-samsum-e4148a42-11205498).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=samsum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=samsum).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -205,6 +205,39 @@ model-index:
205
  type: gen_len
206
  value: 294.7317
207
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
208
  ---
209
 
210
  # long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP
 
205
  type: gen_len
206
  value: 294.7317
207
  verified: true
208
+ - task:
209
+ type: summarization
210
+ name: Summarization
211
+ dataset:
212
+ name: samsum
213
+ type: samsum
214
+ config: samsum
215
+ split: test
216
+ metrics:
217
+ - name: ROUGE-1
218
+ type: rouge
219
+ value: 25.4769
220
+ verified: true
221
+ - name: ROUGE-2
222
+ type: rouge
223
+ value: 6.0336
224
+ verified: true
225
+ - name: ROUGE-L
226
+ type: rouge
227
+ value: 17.9249
228
+ verified: true
229
+ - name: ROUGE-LSUM
230
+ type: rouge
231
+ value: 22.0692
232
+ verified: true
233
+ - name: loss
234
+ type: loss
235
+ value: .nan
236
+ verified: true
237
+ - name: gen_len
238
+ type: gen_len
239
+ value: 53.8242
240
+ verified: true
241
  ---
242
 
243
  # long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP