Hugging Face's logo

grimulkan
/
lzlv-longLORA-70b-rope8-32k-6bpw-h8-exl2

Text Generation
Transformers
llama
Inference Endpoints
Model card Files Community
1

This is an EXL2 6-bit quantization of lzlv-longLORA-70b-rope8-32k-fp16

Downloads last month
8
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported Inference Providers.