bart-large-xsum / README.md
lewtun's picture
lewtun HF staff
Add evaluation results on samsum dataset
4c77055
|
raw
history blame
1.02 kB
metadata
tags:
  - summarization
language:
  - en
license: mit
model-index:
  - name: facebook/bart-large-xsum
    results:
      - task:
          type: summarization
          name: Summarization
        dataset:
          name: samsum
          type: samsum
          config: samsum
          split: train
        metrics:
          - name: ROUGE-1
            type: rouge
            value: 24.7852
            verified: true
          - name: ROUGE-2
            type: rouge
            value: 5.2533
            verified: true
          - name: ROUGE-L
            type: rouge
            value: 18.6792
            verified: true
          - name: ROUGE-LSUM
            type: rouge
            value: 20.629
            verified: true
          - name: loss
            type: loss
            value: 3.746837854385376
            verified: true
          - name: gen_len
            type: gen_len
            value: 23.1206
            verified: true

Bart model finetuned on xsum

docs: https://huggingface.co/transformers/model_doc/bart.html

finetuning: examples/seq2seq/ (as of Aug 20, 2020)

Metrics: ROUGE > 22 on xsum.

variants: search for distilbart

paper: https://arxiv.org/abs/1910.13461