mobiuslabsgmbh
/

Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ

Text Generation

Mixture of Experts

text-generation-inference

Model card Files Files and versions Community

Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ / tokenizer.model

Commit History

update qmodel with gs=128

cbbc082

mobicham commited on Feb 29

upload model

6d3c872

mobicham commited on Feb 23