rttl commited on
Commit
f983e0a
1 Parent(s): 3c21b3e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -2
README.md CHANGED
@@ -27,8 +27,7 @@ This model reaches an accuracy of 91.3 on the dev set.
27
  - **Model Type:** Text Classification
28
  - **Language(s):** English
29
  - **License:** Apache-2.0
30
- - **Parent Model:** For more details about DistilBERT, we encourage users to check out [this model card](https://huggingface.co/distilbert-base-uncased).
31
  - **Resources for more information:**
32
- - The model was pre-trained with task-adaptive pre-training [TAPT](https://arxiv.org/pdf/2004.10964.pdf)
33
  - fine-tuned on sst with subtrees
34
  - fine-tuned on sst2
 
27
  - **Model Type:** Text Classification
28
  - **Language(s):** English
29
  - **License:** Apache-2.0
 
30
  - **Resources for more information:**
31
+ - The model was pre-trained with task-adaptive pre-training [TAPT](https://arxiv.org/pdf/2004.10964.pdf) with an increased masking rate, no corruption strategy, and using WWM, following [this paper](https://aclanthology.org/2023.eacl-main.217.pdf)
32
  - fine-tuned on sst with subtrees
33
  - fine-tuned on sst2