I hope I made it...

12.05.24: Reworked versions of the model have been uploaded to the v1.1 branch

Link to original model and script:

openlynn/Llama-3-Soliloquy-8B-v2: https://huggingface.co/openlynn/Llama-3-Soliloquy-8B-v2
FantasiaFoundry/GGUF-Quantization-Script: https://huggingface.co/FantasiaFoundry/GGUF-Quantization-Script

Downloads last month: 42

GGUF

Model size

8.03B params

Architecture

llama

4-bit

5-bit

6-bit

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.