Supa-AI commited on
Commit
e65fdf9
·
verified ·
1 Parent(s): c4df544

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -24
README.md CHANGED
@@ -1,14 +1,17 @@
1
- ---
2
- language:
3
- - ms
4
- - en
5
- - zh
6
- - ta
7
- tags:
8
- - llama-cpp
9
- - gguf
10
- base_model: mesolitica/malaysian-Llama-3.2-3B-Instruct
11
- ---
 
 
 
12
 
13
  # Supa-AI/malaysian-Llama-3.2-3B-Instruct-gguf
14
  This model was converted to GGUF format from [`mesolitica/malaysian-Llama-3.2-3B-Instruct`](https://huggingface.co/mesolitica/malaysian-Llama-3.2-3B-Instruct) using llama.cpp.
@@ -29,19 +32,19 @@ Refer to the [original model card](https://huggingface.co/mesolitica/malaysian-L
29
  - `malaysian-Llama-3.2-3B-Instruct.q5_k_m.gguf` (q5_K_M)
30
  - `malaysian-Llama-3.2-3B-Instruct.q6_k.gguf` (q6_K)
31
 
32
- ## Use with llama.cpp
33
- Replace `FILENAME` with one of the above filenames.
34
 
35
- ### CLI:
36
- ```bash
37
- llama-cli --hf-repo Supa-AI/malaysian-Llama-3.2-3B-Instruct-gguf --hf-file FILENAME -p "Your prompt here"
38
- ```
39
 
40
- ### Server:
41
- ```bash
42
- llama-server --hf-repo Supa-AI/malaysian-Llama-3.2-3B-Instruct-gguf --hf-file FILENAME -c 2048
43
- ```
44
 
45
- ## Model Details
46
- - **Original Model:** [mesolitica/malaysian-Llama-3.2-3B-Instruct](https://huggingface.co/mesolitica/malaysian-Llama-3.2-3B-Instruct)
47
- - **Format:** GGUF
 
1
+ ---
2
+ language:
3
+ - ms
4
+ - en
5
+ - zh
6
+ - ta
7
+ tags:
8
+ - llama-cpp
9
+ - gguf
10
+ - llm
11
+ - ollama
12
+ - llama
13
+ base_model: mesolitica/malaysian-Llama-3.2-3B-Instruct
14
+ ---
15
 
16
  # Supa-AI/malaysian-Llama-3.2-3B-Instruct-gguf
17
  This model was converted to GGUF format from [`mesolitica/malaysian-Llama-3.2-3B-Instruct`](https://huggingface.co/mesolitica/malaysian-Llama-3.2-3B-Instruct) using llama.cpp.
 
32
  - `malaysian-Llama-3.2-3B-Instruct.q5_k_m.gguf` (q5_K_M)
33
  - `malaysian-Llama-3.2-3B-Instruct.q6_k.gguf` (q6_K)
34
 
35
+ ## Use with llama.cpp
36
+ Replace `FILENAME` with one of the above filenames.
37
 
38
+ ### CLI:
39
+ ```bash
40
+ llama-cli --hf-repo Supa-AI/malaysian-Llama-3.2-3B-Instruct-gguf --hf-file FILENAME -p "Your prompt here"
41
+ ```
42
 
43
+ ### Server:
44
+ ```bash
45
+ llama-server --hf-repo Supa-AI/malaysian-Llama-3.2-3B-Instruct-gguf --hf-file FILENAME -c 2048
46
+ ```
47
 
48
+ ## Model Details
49
+ - **Original Model:** [mesolitica/malaysian-Llama-3.2-3B-Instruct](https://huggingface.co/mesolitica/malaysian-Llama-3.2-3B-Instruct)
50
+ - **Format:** GGUF