Convert to GGUF model
#9
by
Wangderful
- opened
Has anyone tried to convert the trained model to GGUF model format? It needs to GGUF model: the vision model and the proejctor model. How to covert to two models? Does anyone has any ideas?
@Wangderful
there are already gguf versions
https://huggingface.co/cjpais/llava-1.6-mistral-7b-gguf
I woudn't recommend it too much since llava 1.6 is pretty old. Try using llava next interleave or internvl2. Both are great options.
@YaTharThShaRma999 Thank you very much! I will try the lava next interleave. Could you please clarify what internvl2 is? Is that the LLaVA-NeXT-Video shown in the github repository? But it seems the code is not available now.