Fine-tuned with all parameters?

#6
by MengboZhou - opened

I would like to know if Mistral is fine-tuned with all parameters? If so, can I understand it as having undergone further pre-training? How should I continue to train Mistral using modeling_mistral_yarn.py?

NousResearch org

Yes

Sign up or log in to comment