Commit
•
cc842da
1
Parent(s):
254548d
Add evaluation results on the samsum config of samsum (#9)
Browse files- Add evaluation results on the samsum config of samsum (e5fe732506ed92a7f775bbfcf3f8121bdb3d2439)
Co-authored-by: Evaluation Bot <[email protected]>
README.md
CHANGED
@@ -144,6 +144,39 @@ model-index:
|
|
144 |
type: gen_len
|
145 |
value: 183.3702
|
146 |
verified: true
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
147 |
---
|
148 |
|
149 |
# BigBirdPegasus model (large)
|
|
|
144 |
type: gen_len
|
145 |
value: 183.3702
|
146 |
verified: true
|
147 |
+
- task:
|
148 |
+
type: summarization
|
149 |
+
name: Summarization
|
150 |
+
dataset:
|
151 |
+
name: samsum
|
152 |
+
type: samsum
|
153 |
+
config: samsum
|
154 |
+
split: test
|
155 |
+
metrics:
|
156 |
+
- name: ROUGE-1
|
157 |
+
type: rouge
|
158 |
+
value: 3.621
|
159 |
+
verified: true
|
160 |
+
- name: ROUGE-2
|
161 |
+
type: rouge
|
162 |
+
value: 0.1699
|
163 |
+
verified: true
|
164 |
+
- name: ROUGE-L
|
165 |
+
type: rouge
|
166 |
+
value: 3.2016
|
167 |
+
verified: true
|
168 |
+
- name: ROUGE-LSUM
|
169 |
+
type: rouge
|
170 |
+
value: 3.3269
|
171 |
+
verified: true
|
172 |
+
- name: loss
|
173 |
+
type: loss
|
174 |
+
value: 7.664482116699219
|
175 |
+
verified: true
|
176 |
+
- name: gen_len
|
177 |
+
type: gen_len
|
178 |
+
value: 233.8107
|
179 |
+
verified: true
|
180 |
---
|
181 |
|
182 |
# BigBirdPegasus model (large)
|