|
--- |
|
base_model: unsloth/llama-3.2-1b-instruct-unsloth-bnb-4bit |
|
tags: |
|
- text-generation-inference |
|
- transformers |
|
- unsloth |
|
- llama |
|
- trl |
|
- sft |
|
license: apache-2.0 |
|
language: |
|
- en |
|
--- |
|
|
|
|
|
<img src="https://cdn-uploads.huggingface.co/production/uploads/647374aa7ff32a81ac6d35d4/Dzbdzn27KEc3K6zNNi070.png" style="display: block;margin-left: auto;margin-right: auto;width: 50%;"> |
|
|
|
|
|
## Description |
|
|
|
A model tailored to be conversational and execute function calls with [LocalAI](https://github.com/mudler/LocalAI). This model is based on llama3.2 (1B). |
|
|
|
- llama3.2-1b version: https://huggingface.co/mudler/LocalAI-functioncall-llama3.2-1b-v0.4 |
|
- llama3.2-3b version: https://huggingface.co/mudler/LocalAI-functioncall-llama3.2-3b-v0.5 |
|
- phi-4 version: https://huggingface.co/mudler/LocalAI-functioncall-phi-4-v0.3 |
|
- qwen2.5 (7b) version: https://huggingface.co/mudler/LocalAI-functioncall-qwen2.5-7b-v0.5 |
|
|
|
## How to run |
|
|
|
With LocalAI: |
|
|
|
``` |
|
local-ai run LocalAI-functioncall-llama3.2-1b-v0.4 |
|
``` |
|
|
|
[![local-ai-banner.png](https://cdn-uploads.huggingface.co/production/uploads/647374aa7ff32a81ac6d35d4/bXvNcxQqQ-wNAnISmx3PS.png)](https://localai.io) |
|
|
|
## Updates |
|
|
|
This is the 4th iteration based on llama3.2 1B |