File size: 1,391 Bytes
9c0276d cad3e14 3ebd805 41b9769 3ebd805 3c650ed 9bebf7e 714cc60 b7f9ccb c8d90f4 abaaa3e ffa4f55 9be5ab5 8fa68e8 9be5ab5 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 |
# Use .env.local to change these variables, or directly change your env
# DO NOT EDIT THIS FILE WITH SENSITIVE DATA
MONGODB_URL=#your mongodb URL here
MONGODB_DB_NAME=chat-ui
COOKIE_NAME=hf-chat
PUBLIC_MAX_INPUT_TOKENS=1024
PUBLIC_ORIGIN=#https://hf.co
PUBLIC_MODEL_NAME=OpenAssistant/oasst-sft-6-llama-30b # public facing link
PUBLIC_MODEL_ID=OpenAssistant/oasst-sft-6-llama-30b-xor # used to link to model page
PUBLIC_DISABLE_INTRO_TILES=false
PUBLIC_USER_MESSAGE_TOKEN=<|prompter|>
PUBLIC_ASSISTANT_MESSAGE_TOKEN=<|assistant|>
PUBLIC_SEP_TOKEN=</s>
PUBLIC_PREPROMPT="Below are a series of dialogues between various people and an AI assistant. The AI tries to be helpful, polite, honest, sophisticated, emotionally aware, and humble-but-knowledgeable. The assistant is happy to help with almost anything, and will do its best to understand exactly what is needed. It also tries to avoid giving false or misleading information, and it caveats when it isn't entirely sure about the right answer. That said, the assistant is practical and really does its best, and doesn't let caution get too much in the way of being useful."
# [{"endpoint": "https://api-inference.huggingface.co/models/...", authorization: "Bearer hf_<token>", weight: 1}] to load balance
# Eg if one endpoint has weight 2 and the other has weight 1, the first endpoint will be called twice as often
MODEL_ENDPOINTS=`[]` |