Willy030125
/

finetune-indoMMLU-Merak-7B-v1

text-generation-inference

Model card Files Files and versions Community

finetune-indoMMLU-Merak-7B-v1 / README.md

Willy030125's picture

Create README.md

4873044 verified 10 months ago

|

139 Bytes

finetune-indoMMLU-Merak-7B-v1

lora r=8 lora_alpha=16 lora_dropout=0.05

learning_rate = 2e-4 lr_scheduler = "cosine" max_seq_length = 2048