Spaces:

skadewdl3
/

reicpe-generation

Runtime error

skadewdl3 commited on Nov 22, 2023

Commit

3dc2d66

1 Parent(s): 1c2aafc

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -6,7 +6,6 @@ model = AutoModelForCausalLM.from_pretrained(
     "Trelis/Llama-2-7b-chat-hf-sharded-bf16",
     torch_dtype=torch.bfloat16,
     trust_remote_code=True,
-    device_map="auto",
     low_cpu_mem_usage=True,
     device_map = {"": 0}
 )

     "Trelis/Llama-2-7b-chat-hf-sharded-bf16",
     torch_dtype=torch.bfloat16,
     trust_remote_code=True,
     low_cpu_mem_usage=True,
     device_map = {"": 0}
 )