File size: 1,745 Bytes
e65fdf9 c7ee2d7 c4df544 c7ee2d7 c4df544 c7ee2d7 e65fdf9 c7ee2d7 e65fdf9 c7ee2d7 e65fdf9 c7ee2d7 e65fdf9 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 |
---
language:
- ms
- en
- zh
- ta
tags:
- llama-cpp
- gguf
- llm
- ollama
- llama
base_model: mesolitica/malaysian-Llama-3.2-3B-Instruct
---
# Supa-AI/malaysian-Llama-3.2-3B-Instruct-gguf
This model was converted to GGUF format from [`mesolitica/malaysian-Llama-3.2-3B-Instruct`](https://huggingface.co/mesolitica/malaysian-Llama-3.2-3B-Instruct) using llama.cpp.
Refer to the [original model card](https://huggingface.co/mesolitica/malaysian-Llama-3.2-3B-Instruct) for more details on the model.
## Available Versions
- `malaysian-Llama-3.2-3B-Instruct.q4_0.gguf` (q4_0)
- `malaysian-Llama-3.2-3B-Instruct.q4_1.gguf` (q4_1)
- `malaysian-Llama-3.2-3B-Instruct.q5_0.gguf` (q5_0)
- `malaysian-Llama-3.2-3B-Instruct.q5_1.gguf` (q5_1)
- `malaysian-Llama-3.2-3B-Instruct.q8_0.gguf` (q8_0)
- `malaysian-Llama-3.2-3B-Instruct.q3_k_s.gguf` (q3_K_S)
- `malaysian-Llama-3.2-3B-Instruct.q3_k_m.gguf` (q3_K_M)
- `malaysian-Llama-3.2-3B-Instruct.q3_k_l.gguf` (q3_K_L)
- `malaysian-Llama-3.2-3B-Instruct.q4_k_s.gguf` (q4_K_S)
- `malaysian-Llama-3.2-3B-Instruct.q4_k_m.gguf` (q4_K_M)
- `malaysian-Llama-3.2-3B-Instruct.q5_k_s.gguf` (q5_K_S)
- `malaysian-Llama-3.2-3B-Instruct.q5_k_m.gguf` (q5_K_M)
- `malaysian-Llama-3.2-3B-Instruct.q6_k.gguf` (q6_K)
## Use with llama.cpp
Replace `FILENAME` with one of the above filenames.
### CLI:
```bash
llama-cli --hf-repo Supa-AI/malaysian-Llama-3.2-3B-Instruct-gguf --hf-file FILENAME -p "Your prompt here"
```
### Server:
```bash
llama-server --hf-repo Supa-AI/malaysian-Llama-3.2-3B-Instruct-gguf --hf-file FILENAME -c 2048
```
## Model Details
- **Original Model:** [mesolitica/malaysian-Llama-3.2-3B-Instruct](https://huggingface.co/mesolitica/malaysian-Llama-3.2-3B-Instruct)
- **Format:** GGUF |