abhinavkulkarni
/

tiiuae-falcon-7b-instruct-w4-g64-awq

Text Generation

RefinedWebModel

text-generation-inference

Model card Files Files and versions Community

abhinavkulkarni commited on Jul 12, 2023

Commit

911f42b

•

1 Parent(s): 8f8f68c

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -60,7 +60,7 @@ q_config = {
     "q_group_size": 64,
 }
-load_quant = hf_hub_download('abhinavkulkarni/falcon-7b-instruct-w4-g64-awq', 'pytorch_model.bin')
 with init_empty_weights():
     model = AutoModelForCausalLM.from_config(config=config,

     "q_group_size": 64,
 }
+load_quant = hf_hub_download('abhinavkulkarni/tiiaue-falcon-7b-instruct-w4-g64-awq', 'pytorch_model.bin')
 with init_empty_weights():
     model = AutoModelForCausalLM.from_config(config=config,