TheBloke
/

falcon-40b-instruct-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

falcon-40b-instruct-GPTQ / quantize_config.json

Commit History

Update for Transformers GPTQ support

57ac6ea

TheBloke commited on Aug 21, 2023

Update quantize_config.json

63a0720

TheBloke commited on Jun 5, 2023

Upload folder using huggingface_hub

78eaf71

TheBloke commited on Jun 1, 2023

Initial AutoGPTQ model commit

58a9172

TheBloke commited on May 27, 2023