Hugging Face's logo

brucethemoose
/
Capybara-Tess-Yi-34B-200K

Text Generation
Transformers
Safetensors
English
llama
Merge
text-generation-inference
Inference Endpoints
Model card Files Community
1
brucethemoose commited on
Commit
38613ae
•
1 Parent(s): 9cb9083

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -10,7 +10,7 @@ pipeline_tag: text-generation
10
 
11
  **NousResearch/Nous-Capybara-34B** and **migtissera/Tess-M-Creative-v1.0** ties merged with mergekit.
12
 
13
- I would suggest an exllama version for local inference with 40K+ context:
14
  https://huggingface.co/brucethemoose/Capybara-Tess-Yi-34B-200K-exl2-4bpw-fiction
15
  https://huggingface.co/brucethemoose/Capybara-Tess-Yi-34B-200K-exl2-31bpw-fiction
16
 
 
10
 
11
  **NousResearch/Nous-Capybara-34B** and **migtissera/Tess-M-Creative-v1.0** ties merged with mergekit.
12
 
13
+ I would suggest an exllama version for local inference with 40K+ context in 24GB:
14
  https://huggingface.co/brucethemoose/Capybara-Tess-Yi-34B-200K-exl2-4bpw-fiction
15
  https://huggingface.co/brucethemoose/Capybara-Tess-Yi-34B-200K-exl2-31bpw-fiction
16