Update README.md
Browse files
README.md
CHANGED
@@ -72,7 +72,7 @@ widget:
|
|
72 |
|
73 |
**CaBLOOM-760M** is a 760M-parameter transformer-based causal language model for Catalan, Spanish, and English.
|
74 |
It is the result of a language adaptation technique performed on [BLOOM-1.1B](https://huggingface.co/bigscience/bloom-1b1),
|
75 |
-
which involves modifying the model's vocabulary and embedding layer
|
76 |
|
77 |
This model has been developed as part of a scientific research submitted to [LREC-COLING 2024](https://lrec-coling-2024.org/), and is currently undergoing a peer review process.
|
78 |
|
|
|
72 |
|
73 |
**CaBLOOM-760M** is a 760M-parameter transformer-based causal language model for Catalan, Spanish, and English.
|
74 |
It is the result of a language adaptation technique performed on [BLOOM-1.1B](https://huggingface.co/bigscience/bloom-1b1),
|
75 |
+
which involves modifying the model's vocabulary and embedding layer and continuously pre-training the model with 26B tokens in our target languages.
|
76 |
|
77 |
This model has been developed as part of a scientific research submitted to [LREC-COLING 2024](https://lrec-coling-2024.org/), and is currently undergoing a peer review process.
|
78 |
|