Tristan commited on
Commit
1371256
·
1 Parent(s): bd18710

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -12,6 +12,10 @@ This is a more up-to-date version of the [original GPT-2](https://huggingface.co
12
  In addition to being more up-to-date, it also tends to perform better than the original GPT2 on standard benchmarks.
13
  It was trained on a cleaned October 2022 snapshot of Common Crawl and Wikipedia.
14
 
 
 
 
 
15
  ## Intended uses
16
 
17
  You can use the raw model for text generation or fine-tune it to a downstream task.
 
12
  In addition to being more up-to-date, it also tends to perform better than the original GPT2 on standard benchmarks.
13
  It was trained on a cleaned October 2022 snapshot of Common Crawl and Wikipedia.
14
 
15
+ This model was created as part of the OLM project, which has the goal of continuously training and releasing models that are up-to-date and comparable in standard language model performance to their static counterparts.
16
+ This is important because we want our models to know about events like COVID or
17
+ a presidential election right after they happen.
18
+
19
  ## Intended uses
20
 
21
  You can use the raw model for text generation or fine-tune it to a downstream task.