droussis commited on
Commit
7e877a9
·
verified ·
1 Parent(s): 1d0f57c

Add correct formatting to vLLM serve

Browse files
Files changed (1) hide show
  1. README.md +4 -2
README.md CHANGED
@@ -68,19 +68,21 @@ vllm serve ilsp/Llama-Krikri-8B-Base \
68
  ```
69
 
70
  Then, the model can be used through Python using:
71
- '''python
72
  from openai import OpenAI
73
 
74
  api_key = "token-abc123"
75
  base_url = "http://localhost:8000/v1"
 
76
  client = OpenAI(
77
  api_key=api_key,
78
  base_url=base_url,
79
  )
 
80
  response = client.completions.create(model="ilsp/Llama-Krikri-8B-Base",
81
  prompt="Η εκπαίδευση μεγάλων γλωσσικών μοντέλων περιλαμβάνει")
82
  print(response.choices[0].text)
83
- '''
84
 
85
  # Evaluation
86
 
 
68
  ```
69
 
70
  Then, the model can be used through Python using:
71
+ ```python
72
  from openai import OpenAI
73
 
74
  api_key = "token-abc123"
75
  base_url = "http://localhost:8000/v1"
76
+
77
  client = OpenAI(
78
  api_key=api_key,
79
  base_url=base_url,
80
  )
81
+
82
  response = client.completions.create(model="ilsp/Llama-Krikri-8B-Base",
83
  prompt="Η εκπαίδευση μεγάλων γλωσσικών μοντέλων περιλαμβάνει")
84
  print(response.choices[0].text)
85
+ ```
86
 
87
  # Evaluation
88