File size: 1,297 Bytes
2b989c7
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
---
language: pt
license: mit
tags:
- msmarco
- t5
- pytorch
- tensorflow
- pt
- pt-br
datasets:
- msmarco
widget:
- text: "Texto de exemplo em português"
inference: false
---
# mt5-base-en-pt-msmarco Reranker finetuned on Multi MS MARCO
## Introduction
mT5-base-en-pt-msmarco is a mT5-based model finetuned on a bilingual version of MS MARCO passage dataset. This bilingual dataset version is formed by the original MS MARCO dataset (in English) and a Portuguese translated version. 
Further information about the dataset or the translation method can be found on our [Cross-Lingual repository](https://github.com/unicamp-dl/cross-lingual-analysis).

## Usage
```python

from transformers import T5Tokenizer, MT5ForConditionalGeneration

model_name = 'unicamp-dl/mt5-base-en-pt-msmarco'
tokenizer  = T5Tokenizer.from_pretrained(model_name)
model      = MT5ForConditionalGeneration.from_pretrained(model_name)

```
# Citation
If you use mt5-base-en-pt-msmarco, please cite:

    @article{rosa2021cost,
      title={A cost-benefit analysis of cross-lingual transfer methods},
      author={Rosa, Guilherme Moraes and Bonifacio, Luiz Henrique and de Souza, Leandro Rodrigues and Lotufo, Roberto and Nogueira, Rodrigo},
      journal={arXiv preprint arXiv:2105.06813},
      year={2021}
    }