QuantFactory/SOVL_Llama3_8B-GGUF

This is quantized version of ResplendentAI/SOVL_Llama3_8B created using llama.cpp

Model Description

I'm not gonna tell you this is the best model anyone has ever made. I'm not going to tell you that you will love chatting with SOVL.

What I am gonna say is thank you for taking the time out of your day. Without users like you, my work would be meaningless.

GGUF

Model size

8.03B params

Architecture

llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

Base model

Quantized

Adapter

Finetuned

Quantized

(5)

this model