jarradh
/

llama2_70b_chat_uncensored

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Update README.md

#10

by YokaiKoibito - opened Aug 12, 2023

base: refs/heads/main

←

from: refs/pr/10

Discussion Files changed

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -18,7 +18,7 @@ Uncensored refers to the [ehartford/wizard_vicuna_70k_unfiltered](https://huggin
 Special thanks to [George Sung](https://huggingface.co/georgesung) for creating [llama2_7b_chat_uncensored](https://huggingface.co/georgesung/llama2_7b_chat_uncensored), and to [Eric Hartford](https://huggingface.co/ehartford/) for creating [ehartford/wizard_vicuna_70k_unfiltered](https://huggingface.co/datasets/ehartford/wizard_vicuna_70k_unfiltered)
-The version here is the fp16 HuggingFace model.
 In 8 bit mode, the model fits into 84% of A100 80GB (67.2GB) 68747MiB
 In 4 bit mode, the model fits into 51% of A100 80GB (40.8GB) 41559MiB

 Special thanks to [George Sung](https://huggingface.co/georgesung) for creating [llama2_7b_chat_uncensored](https://huggingface.co/georgesung/llama2_7b_chat_uncensored), and to [Eric Hartford](https://huggingface.co/ehartford/) for creating [ehartford/wizard_vicuna_70k_unfiltered](https://huggingface.co/datasets/ehartford/wizard_vicuna_70k_unfiltered)
+The version here is the fp32 HuggingFace model.
 In 8 bit mode, the model fits into 84% of A100 80GB (67.2GB) 68747MiB
 In 4 bit mode, the model fits into 51% of A100 80GB (40.8GB) 41559MiB