lewtun HF staff autoevaluator HF staff commited on
Commit
f66377d
1 Parent(s): 9d87686

Add evaluation results on the 3.0.0 config of cnn_dailymail (#8)

Browse files

- Add evaluation results on the 3.0.0 config of cnn_dailymail (9e574ad3aca367f869c95dbd3df955d2f7bec1ff)


Co-authored-by: Evaluation Bot <[email protected]>

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -45,6 +45,39 @@ model-index:
45
  type: gen_len
46
  value: 209.2537
47
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
48
  ---
49
 
50
  # BigBirdPegasus model (large)
 
45
  type: gen_len
46
  value: 209.2537
47
  verified: true
48
+ - task:
49
+ type: summarization
50
+ name: Summarization
51
+ dataset:
52
+ name: cnn_dailymail
53
+ type: cnn_dailymail
54
+ config: 3.0.0
55
+ split: test
56
+ metrics:
57
+ - name: ROUGE-1
58
+ type: rouge
59
+ value: 9.0885
60
+ verified: true
61
+ - name: ROUGE-2
62
+ type: rouge
63
+ value: 1.0325
64
+ verified: true
65
+ - name: ROUGE-L
66
+ type: rouge
67
+ value: 7.3182
68
+ verified: true
69
+ - name: ROUGE-LSUM
70
+ type: rouge
71
+ value: 8.1455
72
+ verified: true
73
+ - name: loss
74
+ type: loss
75
+ value: .nan
76
+ verified: true
77
+ - name: gen_len
78
+ type: gen_len
79
+ value: 210.4762
80
+ verified: true
81
  ---
82
 
83
  # BigBirdPegasus model (large)