Update README.md
Browse files
README.md
CHANGED
@@ -9,7 +9,7 @@ license: apache-2.0
|
|
9 |
|
10 |
This is the ClimateBERT language model based on the FULL-SELECT sample selection strategy.
|
11 |
|
12 |
-
Note:
|
13 |
|
14 |
Using the [DistilRoBERTa](https://huggingface.co/distilroberta-base) model as starting point, the ClimateBERT Language Model is additionally pretrained on a text corpus comprising climate-related research paper abstracts, corporate and general news and reports from companies. The underlying methodology can be found in our [language model research paper](https://arxiv.org/abs/2110.12010).
|
15 |
|
|
|
9 |
|
10 |
This is the ClimateBERT language model based on the FULL-SELECT sample selection strategy.
|
11 |
|
12 |
+
*Note: We generally recommend choosing this language model over those based on the other sample selection strategies (unless you have good reasons not to).*
|
13 |
|
14 |
Using the [DistilRoBERTa](https://huggingface.co/distilroberta-base) model as starting point, the ClimateBERT Language Model is additionally pretrained on a text corpus comprising climate-related research paper abstracts, corporate and general news and reports from companies. The underlying methodology can be found in our [language model research paper](https://arxiv.org/abs/2110.12010).
|
15 |
|