請問 Llama3-TAIDE-LX-8B-Chat-Alpha1是否可以設定cuda為GPU?
#11
by
JessyNTHUELEBC
- opened
參照網路其他模型的寫法，無法順利切換到GPU...
希望能得到您的解惑。
device = "cuda"
tokenizer = AutoTokenizer.from_pretrained("taide/Llama3-TAIDE-LX-8B-Chat-Alpha1", use_fast=False, token = my_token)
model = AutoModelForCausalLM.from_pretrained("taide/Llama3-TAIDE-LX-8B-Chat-Alpha1").to(device)
