Cannot pass hf token

#17
by magnatm - opened

As I open the page https://huggingface.co/spaces/Vokturz/can-it-run-llm all is see is an error message "Model NousResearch/Meta-Llama-3-8B-Instruct is a gated model, please ensure to pass in your access token and try again if you have access. You can find your access token here : https://huggingface.co/settings/tokens."
but there is no possibility to pass a token, thus making the app not usable. Could you please remove default model in UI so the app would run and it would be possible to input token and model path?

Is there a workaround for this?

Hi! Sorry for the delay, I had a lot of work. For some reason, the Huggingface API accepts the empty string '' as a valid access token and fails to fetch the model info. I changed it to None whenever access_token=='' and now it works :)

Vokturz changed discussion status to closed

Hi! Sorry for the delay, I had a lot of work. For some reason, the Huggingface API accepts the empty string '' as a valid access token and fails to fetch the model info. I changed it to None whenever access_token=='' and now it works :)

Thank you!

Sign up or log in to comment