Add correct formatting to vLLM serve
Browse files
README.md
CHANGED
@@ -68,19 +68,21 @@ vllm serve ilsp/Llama-Krikri-8B-Base \
|
|
68 |
```
|
69 |
|
70 |
Then, the model can be used through Python using:
|
71 |
-
|
72 |
from openai import OpenAI
|
73 |
|
74 |
api_key = "token-abc123"
|
75 |
base_url = "http://localhost:8000/v1"
|
|
|
76 |
client = OpenAI(
|
77 |
api_key=api_key,
|
78 |
base_url=base_url,
|
79 |
)
|
|
|
80 |
response = client.completions.create(model="ilsp/Llama-Krikri-8B-Base",
|
81 |
prompt="Η εκπαίδευση μεγάλων γλωσσικών μοντέλων περιλαμβάνει")
|
82 |
print(response.choices[0].text)
|
83 |
-
|
84 |
|
85 |
# Evaluation
|
86 |
|
|
|
68 |
```
|
69 |
|
70 |
Then, the model can be used through Python using:
|
71 |
+
```python
|
72 |
from openai import OpenAI
|
73 |
|
74 |
api_key = "token-abc123"
|
75 |
base_url = "http://localhost:8000/v1"
|
76 |
+
|
77 |
client = OpenAI(
|
78 |
api_key=api_key,
|
79 |
base_url=base_url,
|
80 |
)
|
81 |
+
|
82 |
response = client.completions.create(model="ilsp/Llama-Krikri-8B-Base",
|
83 |
prompt="Η εκπαίδευση μεγάλων γλωσσικών μοντέλων περιλαμβάνει")
|
84 |
print(response.choices[0].text)
|
85 |
+
```
|
86 |
|
87 |
# Evaluation
|
88 |
|