Update README.md
Browse files
README.md
CHANGED
@@ -104,7 +104,7 @@ language:
|
|
104 |
|
105 |
# xlm-roberta-longformer-base-16384
|
106 |
|
107 |
-
|
108 |
|
109 |
| Model | attention_window | hidden_size | num_hidden_layers | model_max_length |
|
110 |
| --- | --- | --- | --- | --- |
|
|
|
104 |
|
105 |
# xlm-roberta-longformer-base-16384
|
106 |
|
107 |
+
xlm-roberta-longformer is a multilingual [Longformer](https://arxiv.org/abs/2004.05150) initialized with [XLM-RoBERTa](https://huggingface.co/xlm-roberta-base)'s weights without further pretraining. It is intended to be fine-tuned on a downstream task.
|
108 |
|
109 |
| Model | attention_window | hidden_size | num_hidden_layers | model_max_length |
|
110 |
| --- | --- | --- | --- | --- |
|