This checkpoint is obtained after training BigBirdForQuestionAnswering (with extra pooler head) on natural_questions dataset for ~ 2 weeks on 2 K80 GPUs. Script for training can be found here: https://github.com/vasudevgupta7/bigbird

Exact Match 47.44

Use this model just like any other model from 🤗Transformers

from transformers import BigBirdForQuestionAnswering

model_id = "vasudevgupta/bigbird-roberta-natural-questions"
model = BigBirdForQuestionAnswering.from_pretrained(model_id)
tokenizer = BigBirdTokenizer.from_pretrained(model_id)

In case you are interested in predicting category (null, long, short, yes, no) as well, use BigBirdForNaturalQuestions (instead of BigBirdForQuestionAnswering) from my training script.

Downloads last month
34
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Dataset used to train vasudevgupta/bigbird-roberta-natural-questions

Spaces using vasudevgupta/bigbird-roberta-natural-questions 2