brucethemoose
/

Capybara-Tess-Yi-34B-200K

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

brucethemoose commited on Nov 20, 2023

Commit

5a40fc8

•

1 Parent(s): ca29881

Update README.md

Files changed (1) hide show

README.md +8 -1

README.md CHANGED Viewed

@@ -7,7 +7,14 @@ language:
 library_name: transformers
 pipeline_tag: text-generation
 ---
-**NousResearch/Nous-Capybara-34B** and **migtissera/Tess-M-Creative-v1.0** ties merged with mergekit, using the following config:
 ```
 models:

 library_name: transformers
 pipeline_tag: text-generation
 ---
+**NousResearch/Nous-Capybara-34B** and **migtissera/Tess-M-Creative-v1.0** ties merged with mergekit.
+I would suggest an exllama version for local inference with 40K+ context:
+https://huggingface.co/brucethemoose/Capybara-Tess-Yi-34B-200K-exl2-4bpw-fiction
+https://huggingface.co/brucethemoose/Capybara-Tess-Yi-34B-200K-exl2-31bpw-fiction
+he following config:
 ```
 models: