File size: 315 Bytes
cf08547 05c5821 cf08547 72de9a9 cf08547 d430072 cf08547 05c5821 |
1 2 3 4 5 6 7 8 9 10 11 |
---
library_name: transformers
language:
- ms
---
# Full Parameter Finetuning Qwen2 0.5B on Malaysian text
Continue pretraining https://huggingface.co/Qwen/Qwen2-0.5B on 12.86B tokens Malaysian dataset using 8192 context length.
WanDB at https://wandb.ai/huseinzol05/Qwen2-0.5B-fpf/workspace?nw=nwuserhuseinzol05 |