Q4_K_M quantization for Mistral-Small-Instruct-2501 model

Downloads last month: 22

GGUF

Model size

23.6B params

Architecture

llama

4-bit

Inference Providers NEW

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for dataplayer12/Mistral-Small-24B-Instruct-Q4_K_M-GGUF

Base model

mistralai/Mistral-Small-24B-Base-2501

Finetuned

mistralai/Mistral-Small-24B-Instruct-2501

Quantized

(49)

this model