The error happens when when running:
model = AutoModel.from_pretrained(model_path, trust_remote_code=True).half().cuda()
· Sign up or log in to comment