ai-dungeon / helper.py

Commit History

add timestamped logging, comment not used functions on helper
3a5837a

prgrmc commited on

initialize safety client once on helper function, then use it in run_action for inference
01c8c48

prgrmc commited on

add login from huggingface_hub to use prompt guard model
1cc10a2

prgrmc commited on

add login function from huggingface_hub
ebb4490

prgrmc commited on

add prompt guard for user prompt and safety check for LLM generated content after user feedback, add api key for prompt guard
fd206ac

prgrmc commited on

update system_prompt, add prompt guard for user prompt and safety check for LLM generated content
f13e44b

prgrmc commited on

add interence API mistral
31e50da

prgrmc commited on

update and clean scr
82596d2

prgrmc commited on

modify run_action on helper to adjust for spaces cpu computing-disable llama guard
74a57f9

prgrmc commited on

use a smaller model to fit into CPU on hugging face space
f64c5f4

prgrmc commited on

add token hf api key to model
12967f0

prgrmc commited on

Remove 8-bit quantization
7c921e8

prgrmc commited on

update requirements- Remove bitsandbytes dependency, update init pipeline-Disable 8-bit quantization
2e5cad6

prgrmc commited on

update bitsandbytes error
8b1855d

prgrmc commited on

update docker files for deploying to spaces
5f7211a

prgrmc commited on

add dockerfile to deploy, add monitoring prometheus
80c3580

prgrmc commited on

First commit project
fdcbf65

prgrmc commited on