add print statements for debugging
bc3ac0f
Allen Park
commited on
Spaces:
Running
Running
Commit History
add additional getting started section at the bottom
0108e87
Allen Park
commited on
add space
0a402b2
Allen Park
commited on
change huggingface and github links
a73aede
Allen Park
commited on
add styling
f21f2ed
Allen Park
commited on
remove low cpu memory usage
3328fae
Allen Park
commited on
make cpu memory usage low
0fbe7c9
Allen Park
commited on
add checkpointing
8d132dc
Allen Park
commited on
.to(device) for model and handle other checks
af1a93c
Allen Park
commited on
change to dynamic device
17a12ac
Allen Park
commited on
add .to(device) to attention_mask
4dd4e1f
Allen Park
commited on
uncommented device=cuda
d901060
Allen Park
commited on
comment out device='cuda' & input generate_kwargs
d59c183
Allen Park
commited on
use patronus lynx again
f833ec9
Allen Park
commited on
add HF_TOKEN env variable
0703e71
Allen Park
commited on
mistral model
64a90e6
Allen Park
commited on
bartowski open source model change
3172fe0
Allen Park
commited on
change model to mistralai
2410cc6
Allen Park
commited on
try using meta llama 3.1 8b
9f865e6
Allen Park
commited on
use quantized version of lynx 8b
84e8597
Allen Park
commited on
add .to(device) back
5724967
Allen Park
commited on
add attention mask and pad token id
76c4bfe
Allen Park
commited on
get rid of .to(device)
8275a94
Allen Park
commited on
add device=cuda; initialize tokenizer and model outside of function call; add inputs to device
60ffe71
Allen Park
commited on
pass inputs.input_ids not just inputs
b5e9a85
Allen Park
commited on
add accelerate pip package and add device_map='auto'
7d126a2
Allen Park
commited on
add 3 inputs for function and rename from greet to model_call
9d86cbe
Allen Park
commited on
add transformers pip package and remove TextIteratorStreamer from imports
e303329
Allen Park
commited on
make PROMPT not hardcoded and take input values from gradio interface
090dd00
Allen Park
commited on
add code to call lynx model
210b40c
Allen Park
commited on
add application file
d232ed1
Allen Park
commited on