Update README.md
Browse files
README.md
CHANGED
@@ -11,6 +11,7 @@ tags:
|
|
11 |
|
12 |
|
13 |
## VISION+
|
|
|
14 |
```script
|
15 |
|
16 |
If you want to use vision functionality:
|
@@ -18,7 +19,26 @@ If you want to use vision functionality:
|
|
18 |
Make sure you are using the latest version of KoboldCpp.
|
19 |
To use the multimodal capabilities of this model, such as vision, you also need to load the specified mmproj file, you can get it here.
|
20 |
|
|
|
|
|
21 |
You can load the mmproj by using the corresponding section in the interface:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
22 |
```
|
23 |
|
24 |
# MODEL_NAME
|
|
|
11 |
|
12 |
|
13 |
## VISION+
|
14 |
+
|
15 |
```script
|
16 |
|
17 |
If you want to use vision functionality:
|
|
|
19 |
Make sure you are using the latest version of KoboldCpp.
|
20 |
To use the multimodal capabilities of this model, such as vision, you also need to load the specified mmproj file, you can get it here.
|
21 |
|
22 |
+
https://huggingface.co/LeroyDyer/Mixtral_AI_Vision_128k/blob/main/mmproj-model-f16.gguf
|
23 |
+
|
24 |
You can load the mmproj by using the corresponding section in the interface:
|
25 |
+
|
26 |
+
|
27 |
+
KoboldCpp now supports Vision via Multimodal Projectors (aka LLaVA), allowing it to perceive and react to images! Load a suitable --mmproj file or select it in the GUI launcher to use vision capabilities. (Not working on Vulkan)
|
28 |
+
Note: This is NOT limited to only LLaVA models, any compatible model of the same size and architecture can gain vision capabilities!
|
29 |
+
Simply grab a 200mb mmproj file for your architecture here,
|
30 |
+
|
31 |
+
https://huggingface.co/koboldcpp/mmproj
|
32 |
+
|
33 |
+
load it with --mmproj and stick it into your favorite compatible model, and it will be able to see images as well!
|
34 |
+
|
35 |
+
|
36 |
+
|
37 |
+
|
38 |
+
|
39 |
+
|
40 |
+
|
41 |
+
|
42 |
```
|
43 |
|
44 |
# MODEL_NAME
|