jeffreykthomas
/

llama2-7b-ubuntu-GPTQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

llama2-7b-ubuntu-GPTQ

Commit History

Update requirements.txt

6456606

jeffreykthomas commited on Nov 9, 2023

Update handler.py

cb24644

jeffreykthomas commited on Nov 2, 2023

Update handler.py

e718166

jeffreykthomas commited on Oct 24, 2023

Set full text response to false

f3c1668

jeffreykthomas commited on Oct 24, 2023

Update requirements.txt

10ac83e

jeffreykthomas commited on Oct 23, 2023

Update requirements.txt

5eb1d1c

jeffreykthomas commited on Oct 23, 2023

Update requirements.txt

4289210

jeffreykthomas commited on Oct 23, 2023

Cuda11.8 version

94bcc6d

jeffreykthomas commited on Oct 23, 2023

Updated transformers package

58e306a

jeffreykthomas commited on Oct 23, 2023

Downgrade transformers

fe5a9c4

jeffreykthomas commited on Oct 23, 2023

Updated to be more specific

ac4b3bd

jeffreykthomas commited on Oct 23, 2023

Changed dtype

2927230

jeffreykthomas commited on Oct 23, 2023

Refactored handler

96f6ccb

jeffreykthomas commited on Oct 23, 2023

Updated output

2ad1387

jeffreykthomas commited on Oct 23, 2023

Update types

3213cb7

jeffreykthomas commited on Oct 23, 2023

Output array

f37dd2f

jeffreykthomas commited on Oct 23, 2023

Updated inputs

e453c5d

jeffreykthomas commited on Oct 23, 2023

Updated bitsandbytes package

0fadd36

jeffreykthomas commited on Oct 22, 2023

Created requirements.txt

0d20ae9

jeffreykthomas commited on Oct 22, 2023

Create handler for inference endpoint

f25fc5b

jeffreykthomas commited on Oct 22, 2023

Upload tokenizer

ced1981

jeffreykthomas commited on Oct 21, 2023

Upload LlamaForCausalLM

3198a23

jeffreykthomas commited on Oct 21, 2023

Upload tokenizer

60ca8c3

jeffreykthomas commited on Oct 18, 2023

Upload LlamaForCausalLM

d2155a7

jeffreykthomas commited on Oct 18, 2023

initial commit

b947849

jeffreykthomas commited on Oct 18, 2023