Can You please Make Llava 1.6 qwen2 0.5B
Can You please Make Llava 1.6 qwen2 0.5B
Can you plz clarify which checkpoint you mean? If you mean Onevision-0.5, I have converted the weight but the PR is still not merged, I'll be working on it this week
I want a ultra-Fast Vision Like Using Qwen 0.5B q2_K and High llava Performance I only Matters about How fast and better it describes image to use with llama.cpp
Also To Run it on CPU
Thanks Very Much for Responsive My Query
Also Is There Any Way to convert this to GGUF
https://huggingface.co/llava-hf/llava-onevision-qwen2-0.5b-ov-hf/tree/main
Sorry, but afaik GGUF conversion doesn't support llava models with different vision towers. Current support is only for CLIP. I opened a feature request in their repo, since I am out of bandwidth to work on that and if they add a conversion script, will be happy to add a GGUF model here