Update README.md
Browse files
README.md
CHANGED
@@ -30,15 +30,15 @@ If you don't have huggingface-cli, please run `pip install huggingface_hub`.
|
|
30 |
|
31 |
To run this model, follow these steps:
|
32 |
|
33 |
-
1. Make a directory inside your models folder called `Kimiko-10.7B-v3`
|
34 |
|
35 |
2. Open a terminal inside your models folder
|
36 |
|
37 |
-
3. Run `huggingface-cli download royallab/Kimiko-10.7B-v3 --revision 4bpw --local-dir Kimiko-10.7B-v3 --local-dir-use-symlinks False`
|
38 |
|
39 |
1. The `--revision` flag corresponds to the branch name on the model repo. Please select the appropriate bpw branch for your system.
|
40 |
|
41 |
-
4. Inside TabbyAPI's config.yml, set `model_name` to `Kimiko-10.7B-v3` or you can use the `/model/load` endpoint after launching.
|
42 |
|
43 |
5. Launch TabbyAPI inside your python env by running `python main.py`
|
44 |
|
|
|
30 |
|
31 |
To run this model, follow these steps:
|
32 |
|
33 |
+
1. Make a directory inside your models folder called `Kimiko-10.7B-v3-exl2`
|
34 |
|
35 |
2. Open a terminal inside your models folder
|
36 |
|
37 |
+
3. Run `huggingface-cli download royallab/Kimiko-10.7B-v3-exl2 --revision 4bpw --local-dir Kimiko-10.7B-v3-exl2 --local-dir-use-symlinks False`
|
38 |
|
39 |
1. The `--revision` flag corresponds to the branch name on the model repo. Please select the appropriate bpw branch for your system.
|
40 |
|
41 |
+
4. Inside TabbyAPI's config.yml, set `model_name` to `Kimiko-10.7B-v3-exl2` or you can use the `/model/load` endpoint after launching.
|
42 |
|
43 |
5. Launch TabbyAPI inside your python env by running `python main.py`
|
44 |
|