GGUF quants for https://huggingface.co/mudler/Minerva-3B-Llama3-Instruct
To run with LocalAI (https://localai.io/):
local-ai run huggingface://mudler/Minerva-3B-Llama3-Instruct-v0.1-GGUF/localai.yaml
GGUF quants for https://huggingface.co/mudler/Minerva-3B-Llama3-Instruct
To run with LocalAI (https://localai.io/):
local-ai run huggingface://mudler/Minerva-3B-Llama3-Instruct-v0.1-GGUF/localai.yaml