TheBloke
/

Mistral-7B-Instruct-v0.2-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Not able to Load Model in my system with 12 GB GPU and Cuda Version 12.2

#2

by Rishu9401 - opened Feb 13

Feb 13

This comment has been hidden

Rishu9401 changed discussion status to closed Feb 13

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment