apepkuss79
commited on
Commit
•
755a56e
1
Parent(s):
5db0f58
Update README.md
Browse files
README.md
CHANGED
@@ -45,13 +45,13 @@ quantized_by: Second State Inc.
|
|
45 |
- Run as LlamaEdge service
|
46 |
|
47 |
```bash
|
48 |
-
wasmedge --dir .:. --nn-preload default:GGML:AUTO:deepseek-llm-7b-chat
|
49 |
```
|
50 |
|
51 |
- Run as LlamaEdge command app
|
52 |
|
53 |
```bash
|
54 |
-
wasmedge --dir .:. --nn-preload default:GGML:AUTO:deepseek-llm-7b-chat
|
55 |
```
|
56 |
|
57 |
## Quantized GGUF Models
|
|
|
45 |
- Run as LlamaEdge service
|
46 |
|
47 |
```bash
|
48 |
+
wasmedge --dir .:. --nn-preload default:GGML:AUTO:deepseek-llm-7b-chat-Q5_K_M.gguf llama-api-server.wasm -p deepseek-chat
|
49 |
```
|
50 |
|
51 |
- Run as LlamaEdge command app
|
52 |
|
53 |
```bash
|
54 |
+
wasmedge --dir .:. --nn-preload default:GGML:AUTO:deepseek-llm-7b-chat-Q5_K_M.gguf llama-chat.wasm -p deepseek-chat
|
55 |
```
|
56 |
|
57 |
## Quantized GGUF Models
|