abhinavkulkarni
/

tiiuae-falcon-7b-instruct-w4-g64-awq

Text Generation

RefinedWebModel

text-generation-inference

Model card Files Files and versions Community

abhinavkulkarni commited on Sep 7, 2023

Commit

7220151

•

1 Parent(s): 9414f45

Upload config

Files changed (1) hide show

config.json +2 -2

config.json CHANGED Viewed

@@ -22,8 +22,8 @@
   "n_head": 71,
   "n_layer": 32,
   "parallel_attn": true,
-  "torch_dtype": "float16",
-  "transformers_version": "4.31.0",
   "use_cache": true,
   "vocab_size": 65024
 }

   "n_head": 71,
   "n_layer": 32,
   "parallel_attn": true,
+  "torch_dtype": "bfloat16",
+  "transformers_version": "4.33.1",
   "use_cache": true,
   "vocab_size": 65024
 }