Hugging Face's logo

solidrust
/
Mini-Mixtral-v0.2-2x7B-AWQ

Text Generation
Transformers
Safetensors
mixtral
Mixture of Experts
frankenmoe
Merge
mergekit
lazymergekit
unsloth/mistral-7b-v0.2
mistralai/Mistral-7B-Instruct-v0.2
quantized
4-bit precision
AWQ
Inference Endpoints
chatml
text-generation-inference
awq
Model card Files Community
Edit model card

NeuralNovel/Mini-Mixtral-v0.2 AWQ

image/jpeg

Model Summary

Mini-Mixtral-v0.2 is a Mixture of Experts (MoE) made with the following models using LazyMergekit:

Downloads last month
12
Safetensors
Model size
1.95B params
Tensor type
I32
·
FP16
·
Inference Examples
Text Generation
Inference API (serverless) has been turned off for this model.

Model tree for solidrust/Mini-Mixtral-v0.2-2x7B-AWQ

Base model

NeuralNovel/Mini-Mixtral-v0.2
Quantized
(3)
this model

Collection including solidrust/Mini-Mixtral-v0.2-2x7B-AWQ