Update README.md
Browse files
README.md
CHANGED
@@ -1,14 +1,17 @@
|
|
1 |
-
---
|
2 |
-
language:
|
3 |
-
- ms
|
4 |
-
- en
|
5 |
-
- zh
|
6 |
-
- ta
|
7 |
-
tags:
|
8 |
-
- llama-cpp
|
9 |
-
- gguf
|
10 |
-
|
11 |
-
|
|
|
|
|
|
|
12 |
|
13 |
# Supa-AI/malaysian-Llama-3.2-3B-Instruct-gguf
|
14 |
This model was converted to GGUF format from [`mesolitica/malaysian-Llama-3.2-3B-Instruct`](https://huggingface.co/mesolitica/malaysian-Llama-3.2-3B-Instruct) using llama.cpp.
|
@@ -29,19 +32,19 @@ Refer to the [original model card](https://huggingface.co/mesolitica/malaysian-L
|
|
29 |
- `malaysian-Llama-3.2-3B-Instruct.q5_k_m.gguf` (q5_K_M)
|
30 |
- `malaysian-Llama-3.2-3B-Instruct.q6_k.gguf` (q6_K)
|
31 |
|
32 |
-
|
33 |
-
|
34 |
|
35 |
-
|
36 |
-
|
37 |
-
|
38 |
-
|
39 |
|
40 |
-
|
41 |
-
|
42 |
-
|
43 |
-
|
44 |
|
45 |
-
|
46 |
-
|
47 |
-
|
|
|
1 |
+
---
|
2 |
+
language:
|
3 |
+
- ms
|
4 |
+
- en
|
5 |
+
- zh
|
6 |
+
- ta
|
7 |
+
tags:
|
8 |
+
- llama-cpp
|
9 |
+
- gguf
|
10 |
+
- llm
|
11 |
+
- ollama
|
12 |
+
- llama
|
13 |
+
base_model: mesolitica/malaysian-Llama-3.2-3B-Instruct
|
14 |
+
---
|
15 |
|
16 |
# Supa-AI/malaysian-Llama-3.2-3B-Instruct-gguf
|
17 |
This model was converted to GGUF format from [`mesolitica/malaysian-Llama-3.2-3B-Instruct`](https://huggingface.co/mesolitica/malaysian-Llama-3.2-3B-Instruct) using llama.cpp.
|
|
|
32 |
- `malaysian-Llama-3.2-3B-Instruct.q5_k_m.gguf` (q5_K_M)
|
33 |
- `malaysian-Llama-3.2-3B-Instruct.q6_k.gguf` (q6_K)
|
34 |
|
35 |
+
## Use with llama.cpp
|
36 |
+
Replace `FILENAME` with one of the above filenames.
|
37 |
|
38 |
+
### CLI:
|
39 |
+
```bash
|
40 |
+
llama-cli --hf-repo Supa-AI/malaysian-Llama-3.2-3B-Instruct-gguf --hf-file FILENAME -p "Your prompt here"
|
41 |
+
```
|
42 |
|
43 |
+
### Server:
|
44 |
+
```bash
|
45 |
+
llama-server --hf-repo Supa-AI/malaysian-Llama-3.2-3B-Instruct-gguf --hf-file FILENAME -c 2048
|
46 |
+
```
|
47 |
|
48 |
+
## Model Details
|
49 |
+
- **Original Model:** [mesolitica/malaysian-Llama-3.2-3B-Instruct](https://huggingface.co/mesolitica/malaysian-Llama-3.2-3B-Instruct)
|
50 |
+
- **Format:** GGUF
|