mobiuslabsgmbh
/

Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ

Text Generation

Mixture of Experts

Model card Files Files and versions Community

Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-2bit-metaoffload-HQQ

Commit History

Update README.md

d8057bb
verified

mobicham commited on Feb 23

screencast

649cf7c
verified

appoose commited on Feb 23

adding streaming in the example provided

9ed79d7
verified

appoose commited on Feb 23

adding vram usage

48d4273
verified

appoose commited on Feb 23

adding initial metrics

956a729
verified

appoose commited on Feb 23

Update README.md

49119b7
verified

appoose commited on Feb 23

Update README.md

3d7f303
verified

mobicham commited on Feb 23

upload model

6d3c872

mobicham commited on Feb 23

Update README.md

8c0da45
verified

mobicham commited on Feb 23

initial commit

a671496
verified

mobicham commited on Feb 23