This checkpoint is obtained after training BigBirdForQuestionAnswering (with extra pooler head) on natural_questions dataset for ~ 2 weeks on 2 K80 GPUs. Script for training can be found here: https://github.com/vasudevgupta7/bigbird

Exact Match 47.44

Use this model just like any other model from 🤗Transformers

from transformers import BigBirdForQuestionAnswering

model_id = "vasudevgupta/bigbird-roberta-natural-questions"
model = BigBirdForQuestionAnswering.from_pretrained(model_id)
tokenizer = BigBirdTokenizer.from_pretrained(model_id)

In case you are interested in predicting category (null, long, short, yes, no) as well, use BigBirdForNaturalQuestions (instead of BigBirdForQuestionAnswering) from my training script.

Downloads last month
29
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Dataset used to train vasudevgupta/bigbird-roberta-natural-questions

Spaces using vasudevgupta/bigbird-roberta-natural-questions 2