Yuan Liu's picture

Yuan Liu

flashback29
·

AI & ML interests

None yet

Organizations

None yet

Posts 1

view post
Post
309
Just subscribed the PRO monthly, but still got rate limited when making the inference API call


const api_url = "https://api-inference.huggingface.co/models/meta-llama/Meta-Llama-3-8B";
  const payload = JSON.stringify({
    "query": input,
  });

  const body = {
      "headers" : {"Authorization": `Bearer ${API_TOKEN}`},
      "wait_for_model": true,
      "use_gpu": false,
      "method" : "POST",
      "contentType" : "application/json",
      "payload" : payload
    };
  
  var xmlHttp = new XMLHttpRequest();
  xmlHttp.open("POST", api_url, false);
  xmlHttp.send(body);
  return xmlHttp.responseText;

Need some help

models

None public yet

datasets

None public yet