Tristan commited on
Commit
4fde4a1
·
1 Parent(s): cfcb367

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -4
README.md CHANGED
@@ -6,13 +6,15 @@ tags:
6
  ---
7
 
8
 
9
- # GPT-2
10
 
11
- This is a more up-to-date version of the original GPT2, which is a pretrained model on English language using a causal language modeling (CLM) objective.
 
 
12
 
13
- ## Intended uses & limitations
14
 
15
- You can use the raw model for text generation or fine-tune it to a downstream task. See the
16
 
17
  ## How to use
18
 
 
6
  ---
7
 
8
 
9
+ # OLM GPT-2 October 2022
10
 
11
+ This is a more up-to-date version of the [original GPT-2](https://huggingface.co/gpt2).
12
+ In addition to being more up-to-date, it also tends to perform better than the original GPT2 on standard benchmarks.
13
+ It was trained on a cleaned October 2022 snapshot of Common Crawl and Wikipedia.
14
 
15
+ ## Intended uses
16
 
17
+ You can use the raw model for text generation or fine-tune it to a downstream task.
18
 
19
  ## How to use
20