update prompt
Browse files
README.md
CHANGED
@@ -28,10 +28,14 @@ We provide Bunny-Llama-3-8B-V, which is built upon [SigLIP](https://huggingface.
|
|
28 |
# sample images can be found in images folder
|
29 |
|
30 |
# fp16
|
31 |
-
./llava-cli -m ggml-model-f16.gguf --mmproj mmproj-model-f16.gguf --image example_2.png -c 4096 -
|
|
|
|
|
32 |
|
33 |
# int4
|
34 |
-
./llava-cli -m ggml-model-Q4_K_M.gguf --mmproj mmproj-model-f16.gguf --image example_2.png -c 4096 -
|
|
|
|
|
35 |
```
|
36 |
|
37 |
## Chat by [ollama](https://ollama.com/)
|
@@ -41,10 +45,12 @@ We provide Bunny-Llama-3-8B-V, which is built upon [SigLIP](https://huggingface.
|
|
41 |
|
42 |
# fp16
|
43 |
ollama create Bunny-Llama-3-8B-V-fp16 -f ./ollama-f16
|
44 |
-
ollama run Bunny-Llama-3-8B-V-fp16
|
|
|
45 |
|
46 |
# int4
|
47 |
ollama create Bunny-Llama-3-8B-V-int4 -f ./ollama-Q4_K_M
|
48 |
-
ollama run Bunny-Llama-3-8B-V-int4
|
|
|
49 |
```
|
50 |
|
|
|
28 |
# sample images can be found in images folder
|
29 |
|
30 |
# fp16
|
31 |
+
./llava-cli -m ggml-model-f16.gguf --mmproj mmproj-model-f16.gguf --image example_2.png -c 4096 -e \
|
32 |
+
-p "A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: <image>\nWhy is the image funny? ASSISTANT:" \
|
33 |
+
--temp 0.0
|
34 |
|
35 |
# int4
|
36 |
+
./llava-cli -m ggml-model-Q4_K_M.gguf --mmproj mmproj-model-f16.gguf --image example_2.png -c 4096 -e \
|
37 |
+
-p "A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: <image>\nWhy is the image funny? ASSISTANT:" \
|
38 |
+
--temp 0.0
|
39 |
```
|
40 |
|
41 |
## Chat by [ollama](https://ollama.com/)
|
|
|
45 |
|
46 |
# fp16
|
47 |
ollama create Bunny-Llama-3-8B-V-fp16 -f ./ollama-f16
|
48 |
+
ollama run Bunny-Llama-3-8B-V-fp16 'example_2.png
|
49 |
+
Why is the image funny?'
|
50 |
|
51 |
# int4
|
52 |
ollama create Bunny-Llama-3-8B-V-int4 -f ./ollama-Q4_K_M
|
53 |
+
ollama run Bunny-Llama-3-8B-V-int4 'example_2.png
|
54 |
+
Why is the image funny?'
|
55 |
```
|
56 |
|