jsfs11 commited on
Commit
e1671e7
·
verified ·
1 Parent(s): c0ac1dc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -19,7 +19,7 @@ base_model:
19
  - MaziyarPanahi/Mistral-7B-Instruct-v0.3
20
  ---
21
 
22
- # jsfs11/MixtureofMerges-MoE-4x7bRP-v11-Q4_K_M-GGUF
23
  This model was converted to GGUF format from [`jsfs11/MixtureofMerges-MoE-4x7bRP-v11`](https://huggingface.co/jsfs11/MixtureofMerges-MoE-4x7bRP-v11) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
24
  Refer to the [original model card](https://huggingface.co/jsfs11/MixtureofMerges-MoE-4x7bRP-v11) for more details on the model.
25
  ## Use with llama.cpp
@@ -30,11 +30,11 @@ brew install ggerganov/ggerganov/llama.cpp
30
  Invoke the llama.cpp server or the CLI.
31
  CLI:
32
  ```bash
33
- llama-cli --hf-repo jsfs11/MixtureofMerges-MoE-4x7bRP-v11-Q4_K_M-GGUF --model mixtureofmerges-moe-4x7brp-v11-q4_k_m.gguf -p "The meaning to life and the universe is"
34
  ```
35
  Server:
36
  ```bash
37
- llama-server --hf-repo jsfs11/MixtureofMerges-MoE-4x7bRP-v11-Q4_K_M-GGUF --model mixtureofmerges-moe-4x7brp-v11-q4_k_m.gguf -c 2048
38
  ```
39
  Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
40
  ```
 
19
  - MaziyarPanahi/Mistral-7B-Instruct-v0.3
20
  ---
21
 
22
+ # jsfs11/MixtureofMerges-MoE-4x7bRP-v11-GGUF
23
  This model was converted to GGUF format from [`jsfs11/MixtureofMerges-MoE-4x7bRP-v11`](https://huggingface.co/jsfs11/MixtureofMerges-MoE-4x7bRP-v11) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
24
  Refer to the [original model card](https://huggingface.co/jsfs11/MixtureofMerges-MoE-4x7bRP-v11) for more details on the model.
25
  ## Use with llama.cpp
 
30
  Invoke the llama.cpp server or the CLI.
31
  CLI:
32
  ```bash
33
+ llama-cli --hf-repo jsfs11/MixtureofMerges-MoE-4x7bRP-v11-GGUF --model mixtureofmerges-moe-4x7brp-v11-q4_k_m.gguf -p "The meaning to life and the universe is"
34
  ```
35
  Server:
36
  ```bash
37
+ llama-server --hf-repo jsfs11/MixtureofMerges-MoE-4x7bRP-v11-GGUF --model mixtureofmerges-moe-4x7brp-v11-q4_k_m.gguf -c 2048
38
  ```
39
  Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
40
  ```