Update README.md
Browse files
README.md
CHANGED
@@ -13,8 +13,8 @@ should probably proofread and complete it, then remove this comment. -->
|
|
13 |
|
14 |
# Llama2-jp-123M
|
15 |
|
16 |
-
This model
|
17 |
-
|
18 |
- Loss: 2.6296
|
19 |
|
20 |
## Model description
|
|
|
13 |
|
14 |
# Llama2-jp-123M
|
15 |
|
16 |
+
This model was built by referring to the config in [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0), 123M The model is a pre-trained Llama2 of Parameters with only 1 epoch on a Japanese dataset.
|
17 |
+
The dataset used is [range3/wiki40b-ja](https://huggingface.co/datasets/range3/wiki40b-ja).
|
18 |
- Loss: 2.6296
|
19 |
|
20 |
## Model description
|