cortecs
/

Llama-3-SauerkrautLM-70b-Instruct-GPTQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

markoarnauto commited on May 18

Commit

8d70a1e

•

1 Parent(s): 3d623bd

Upload README.md with huggingface_hub

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -20,7 +20,7 @@ Access the model:
 ```
 curl http://localhost:8000/v1/completions     -H "Content-Type: application/json"     -d ' {
         "model": "cortecs/Llama-3-SauerkrautLM-70b-Instruct-GPTQ",
-        "prompt": "San Francisco is a"
     } '
 ```

 ```
 curl http://localhost:8000/v1/completions     -H "Content-Type: application/json"     -d ' {
         "model": "cortecs/Llama-3-SauerkrautLM-70b-Instruct-GPTQ",
+        "prompt": "Berlin ist eine"
     } '
 ```