| library_name: transformers | |
| language: | |
| - ms | |
| # Full Parameter Finetuning Qwen2 0.5B on Malaysian text | |
| Continue pretraining https://huggingface.co/Qwen/Qwen2-0.5B on 12.86B tokens Malaysian dataset using 8192 context length. | |
| WanDB at https://wandb.ai/huseinzol05/Qwen2-0.5B-fpf/workspace?nw=nwuserhuseinzol05 |