AI-Sweden-Models
/

gpt-sw3-20b-instruct-4bit-gptq

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

TGI: gptq quantization is not supported for AutoModel

#1

by 4639-94d6 - opened Jan 10

Jan 10

This comment has been hidden

4639-94d6 changed discussion status to closed Aug 1

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment