Commit
•
7ae75a4
1
Parent(s):
6bf2846
Update README.md (#8)
Browse files- Update README.md (12396bca9d3c694a748e09ebf4733520952dcbff)
Co-authored-by: Joaquim Cassano Santos <[email protected]>
README.md
CHANGED
|
@@ -32,7 +32,7 @@ The context size of the model is 4096 tokens. We use the GPTNeoX tokenizer with
|
|
| 32 |
|
| 33 |
The model has been trained on the [MosaicML](https://www.mosaicml.com/) platform on 128 H100-80GB GPUs using their [LLM Foundry](https://github.com/mosaicml/llm-foundry) and [Composer](https://github.com/mosaicml/composer) training library built on top of PyTorch.
|
| 34 |
|
| 35 |
-
##
|
| 36 |
You will need to install the latest versions of the following dependencies:
|
| 37 |
```
|
| 38 |
einops
|
|
|
|
| 32 |
|
| 33 |
The model has been trained on the [MosaicML](https://www.mosaicml.com/) platform on 128 H100-80GB GPUs using their [LLM Foundry](https://github.com/mosaicml/llm-foundry) and [Composer](https://github.com/mosaicml/composer) training library built on top of PyTorch.
|
| 34 |
|
| 35 |
+
## Dependencies
|
| 36 |
You will need to install the latest versions of the following dependencies:
|
| 37 |
```
|
| 38 |
einops
|