Update README.md
Browse files
README.md
CHANGED
@@ -6,6 +6,21 @@ language:
|
|
6 |
- vi
|
7 |
---
|
8 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
9 |
- Training script:
|
10 |
```bash
|
11 |
moe_mode="sparse"
|
|
|
6 |
- vi
|
7 |
---
|
8 |
|
9 |
+
- Deploying Gradio: Going to MoE-LLaVA serving tutorial and follow, or quickly, can use 👇👇👇
|
10 |
+
```bash
|
11 |
+
deepspeed --include localhost:0 moellava/serve/gradio_web_server.py \
|
12 |
+
--model-path="tuanio/moe-llava-qwen1.5-0.5b-vista_reason_conv-1ep"
|
13 |
+
```
|
14 |
+
|
15 |
+
Or CLI:
|
16 |
+
```bash
|
17 |
+
deepspeed --include localhost:0 moellava/serve/cli.py \
|
18 |
+
--model-path "tuanio/moe-llava-qwen1.5-0.5b-vista_reason_conv-1ep" \
|
19 |
+
--image-file "data/llm_data/coco2017/train2017/000000391895.jpg"
|
20 |
+
```
|
21 |
+
|
22 |
+
---
|
23 |
+
|
24 |
- Training script:
|
25 |
```bash
|
26 |
moe_mode="sparse"
|