xxx777xxxASD
/

PrimaMonarch-EroSumika-2x10.7B-128k-bpw-4.0

Text Generation

Mixture of Experts

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

PrimaMonarch-EroSumika-2x10.7B-128k-bpw-4.0 / README.md

xxx777xxxASD's picture

Update README.md

52ff44c verified 12 months ago

|

history blame contribute delete

309 Bytes

metadata

license: apache-2.0
language:
  - en
tags:
  - merge
  - moe

ExLlamaV2 BPW 4.0 quant of xxx777xxxASD/PrimaMonarch-EroSumika-2x10.7B-128k

(Fits in 12GB VRAM/16k context/4-bit cache)