lhbonifacio's picture
Update README.md
16d7ce6
|
raw
history blame
1.39 kB
metadata
language: pt
license: mit
tags:
  - msmarco
  - t5
  - pytorch
  - tensorflow
  - pt
  - pt-br
datasets:
  - msmarco
widget:
  - text: Texto de exemplo em português
inference: false

mt5-base-en-pt-msmarco Reranker finetuned on Multi MS MARCO

Introduction

mT5-base-en-pt-msmarco is a mT5-based model finetuned on a bilingual version of MS MARCO passage dataset. This bilingual dataset version is formed by the original MS MARCO dataset (in English) and a Portuguese translated version. Further information about the dataset or the translation method can be found on our paper mMARCO: A Multilingual Version of MS MARCO Passage Ranking Dataset and mMARCO repository.

Usage


from transformers import T5Tokenizer, MT5ForConditionalGeneration

model_name = 'unicamp-dl/mt5-base-en-pt-msmarco'
tokenizer  = T5Tokenizer.from_pretrained(model_name)
model      = MT5ForConditionalGeneration.from_pretrained(model_name)

Citation

If you use mt5-base-en-pt-msmarco, please cite:

@misc{bonifacio2021mmarco,
  title={mMARCO: A Multilingual Version of MS MARCO Passage Ranking Dataset}, 
  author={Luiz Henrique Bonifacio and Israel Campiotti and Roberto Lotufo and Rodrigo Nogueira},
  year={2021},
  eprint={2108.13897},
  archivePrefix={arXiv},
  primaryClass={cs.CL}

}