jeffreykthomas
/

llama2-7b-ubuntu-GPTQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

llama2-7b-ubuntu-GPTQ / handler.py

Commit History

Update handler.py

cb24644

jeffreykthomas commited on Nov 2, 2023

Update handler.py

e718166

jeffreykthomas commited on Oct 24, 2023

Set full text response to false

f3c1668

jeffreykthomas commited on Oct 24, 2023

Changed dtype

2927230

jeffreykthomas commited on Oct 23, 2023

Refactored handler

96f6ccb

jeffreykthomas commited on Oct 23, 2023

Updated output

2ad1387

jeffreykthomas commited on Oct 23, 2023

Update types

3213cb7

jeffreykthomas commited on Oct 23, 2023

Output array

f37dd2f

jeffreykthomas commited on Oct 23, 2023

Updated inputs

e453c5d

jeffreykthomas commited on Oct 23, 2023

Create handler for inference endpoint

f25fc5b

jeffreykthomas commited on Oct 22, 2023