Hugging Face's logo

LoneStriker
/
miqu-1-103b-2.4bpw-h6-exl2

Text Generation
Transformers
Safetensors
llama
mergekit
Merge
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
2
New discussion

Any way to speed up generation on a Windows 11 PC, using a single 24GB card (4090), with Text-Generation-WebUI

2
#2 opened 8 months ago by clevnumb