Hugging Face's logo

fireballoon
/
baichuan-vicuna-chinese-7b

Text Generation
Transformers
PyTorch
Chinese
English
llama
text-generation-inference
Model card Files Community
15

请问deepspeed zero3的参数是怎么配置的

#14
by Aibet - opened
Discussion
Aibet

我用的是fastchat的zero2的json读取方式，请问您的zero3的配置怎么使能的呢

fireballoon
 Owner

我的配置文件是：https://huggingface.co/fireballoon/baichuan-vicuna-7b/blob/main/zero3_bf16_config.yaml

Sign up or log in to comment