Update README.md
Browse files
README.md
CHANGED
|
@@ -1,7 +1,7 @@
|
|
| 1 |
## About
|
| 2 |
Here we share a pretrained BERT model that is aware of math tokens. The math tokens are treated specially and tokenized using [pya0](https://github.com/approach0/pya0), which adds very limited new tokens for latex markup (total vocabulary is just 31,061).
|
| 3 |
|
| 4 |
-
This model is trained on 4 x 2 Tesla V100 with a total batch size of 64, using Math StackExchange data with 2.7 million sentence pairs for 7 epochs.
|
| 5 |
|
| 6 |
### Usage
|
| 7 |
Download and try it out
|
|
|
|
| 1 |
## About
|
| 2 |
Here we share a pretrained BERT model that is aware of math tokens. The math tokens are treated specially and tokenized using [pya0](https://github.com/approach0/pya0), which adds very limited new tokens for latex markup (total vocabulary is just 31,061).
|
| 3 |
|
| 4 |
+
This model is trained on 4 x 2 Tesla V100 with a total batch size of 64, using Math StackExchange data with 2.7 million sentence pairs trained for 7 epochs.
|
| 5 |
|
| 6 |
### Usage
|
| 7 |
Download and try it out
|