Edit model card

[Request #53] - Click the link for more context.
aifeifei798/llama3-8B-DarkIdol-1.2

Use with the latest version of KoboldCpp, or this more up-to-date fork if you have issues.

⇲ Click here to expand/hide information – General chart with relative quant performance.

Recommended read:

"Which GGUF is right for me? (Opinionated)" by Artefact2

Click the image to view full size. "Which GGUF is right for me? (Opinionated)" by Artefact2 - Firs Graph

image

Downloads last month
920
GGUF
Model size
8.03B params
Architecture
llama

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference API
Inference API (serverless) has been turned off for this model.

Collection including LWDCLS/llama3-8B-DarkIdol-1.2-GGUF-IQ-Imatrix-Request