art-from-the-machine
commited on
Commit
•
c3d1d4c
1
Parent(s):
10f2d6b
Update README.md
Browse files
README.md
CHANGED
@@ -39,7 +39,7 @@ Example:
|
|
39 |
- **Context length:** 8,192
|
40 |
|
41 |
## Example Output
|
42 |
-
The fine-tuned [Mantella-Skyrim-Llama-3-8B-Q4_K_M.gguf](https://huggingface.co/art-from-the-machine/Mantella-Skyrim-Llama-3-8B-GGUF/blob/main/Mantella-Skyrim-Llama-3-8B-Q4_K_M.gguf) model has been tested in Mantella v0.11.2's debug mode, with the model running locally in koboldcpp. The character tested is Hulda. A list of questions are tested against both the fine-tuned model as well as an equivalent [Q4_K_M Llama 3 Instruct](https://huggingface.co/bartowski/Meta-Llama-3-8B-Instruct-GGUF/blob/main/Meta-Llama-3-8B-Instruct-Q4_K_M.gguf) base model for comparison. For both models, Mantella's `max_response_sentences` setting has been set to 4
|
43 |
<details>
|
44 |
<summary><b>Mantella-Skyrim-Llama-3-8B-Q4_K_M.gguf</b></summary>
|
45 |
|
|
|
39 |
- **Context length:** 8,192
|
40 |
|
41 |
## Example Output
|
42 |
+
The fine-tuned [Mantella-Skyrim-Llama-3-8B-Q4_K_M.gguf](https://huggingface.co/art-from-the-machine/Mantella-Skyrim-Llama-3-8B-GGUF/blob/main/Mantella-Skyrim-Llama-3-8B-Q4_K_M.gguf) model has been tested in Mantella v0.11.2's debug mode, with the model running locally in koboldcpp. The character tested is Hulda. A list of questions are tested against both the fine-tuned model as well as an equivalent [Q4_K_M Llama 3 Instruct](https://huggingface.co/bartowski/Meta-Llama-3-8B-Instruct-GGUF/blob/main/Meta-Llama-3-8B-Instruct-Q4_K_M.gguf) base model for comparison. For both models, Mantella's `max_response_sentences` setting has been set to 4.
|
43 |
<details>
|
44 |
<summary><b>Mantella-Skyrim-Llama-3-8B-Q4_K_M.gguf</b></summary>
|
45 |
|