GGUF llama.cpp quantized version of:

Recommended Prompt Format (ChatML)

<|im_start|>system 
Provide some context and/or instructions to the model.<|im_end|> 
<|im_start|>user 
The user’s message goes here<|im_end|> 
<|im_start|>assistant 
AI message goes here<|im_end|>

Quant Version: b3933 with imatrix

Downloads last month: 99

GGUF

Model size

7.61B params

Architecture

qwen2

2-bit

5-bit

8-bit

16-bit

32-bit

Inference Providers NEW

Image-Text-to-Text

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for AI-Engine/MiniCPM-V-2_6-GGUF

Base model

openbmb/MiniCPM-V-2_6

Quantized

(6)

this model