liuhaotian

/

llava-v1.6-34b

like 329

@musicurgy it can be probably quanted by bnb but not gguf or gptq yet.

@musicurgy you can quantize it using HQQ: https://github.com/mobiusml/hqq/?tab=readme-ov-file#multimodal