Update README.md
Browse files
README.md
CHANGED
|
@@ -7,7 +7,7 @@ library_name: transformers
|
|
| 7 |
|
| 8 |
**Model Summary:**
|
| 9 |
|
| 10 |
-
This model is part of the [GneissWeb](https://huggingface.co/datasets/ibm-granite/GneissWeb) ablations, detailed in this [technical report](https://arxiv.org/pdf/2502.14907). The model has 7 billion parameters and uses the LLama architecture. It is trained on a random subset of 350 billion English tokens from FineWeb
|
| 11 |
|
| 12 |
- Developers: IBM Research
|
| 13 |
|
|
|
|
| 7 |
|
| 8 |
**Model Summary:**
|
| 9 |
|
| 10 |
+
This model is part of the [GneissWeb](https://huggingface.co/datasets/ibm-granite/GneissWeb) ablations, detailed in this [technical report](https://arxiv.org/pdf/2502.14907). The model has 7 billion parameters and uses the LLama architecture. It is trained on a random subset of 350 billion English tokens from FineWeb.Edu.Score-2, tokenized using the StarCoder tokenizer.
|
| 11 |
|
| 12 |
- Developers: IBM Research
|
| 13 |
|