Spaces:

xiaowang7777
/

fnlp-moss-moon-003-sft-int8

Runtime error

xiaowang7777 commited on Apr 24, 2023

Commit

a34b3b9

1 Parent(s): 0417eb1

push

Files changed (1) hide show

app.py CHANGED Viewed

@@ -18,7 +18,7 @@ with init_empty_weights():
 raw_model.tie_weights()
 model = load_checkpoint_and_dispatch(
   raw_model, model_path, device_map="balanced_low_0", no_split_module_classes=["MossBlock"], dtype=torch.float,
-  offload_folder="offload_folder", checkpoint=model_path
 )

 raw_model.tie_weights()
 model = load_checkpoint_and_dispatch(
   raw_model, model_path, device_map="balanced_low_0", no_split_module_classes=["MossBlock"], dtype=torch.float,
+  offload_folder="offload_folder"
 )