LocalAI-Llama3.1-8b-Function-Call-v0.3

This model is a fine-tune on a custom dataset + glaive to work specifically and leverage all the LocalAI features of constrained grammar.

Specifically, the model once enters in tools mode will always reply with JSON.

To run on LocalAI:

local-ai run huggingface://mudler/LocalAI-Llama3.1-8b-Function-Call-v0.3-GGUF/localai-q4_k_m.yaml

If you like my work, consider up donating so can get resources for my fine-tunes!

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.