aiplanet
/

effi-7b-awq

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

bhavyaaiplanet commited on Feb 9, 2024

Commit

c9f80ce

·

verified ·

1 Parent(s): 08ccf9b

Update README.md

Files changed (1) hide show

README.md +4 -4

README.md CHANGED Viewed

@@ -29,10 +29,10 @@ effi 7b AWQ is a quantized version of effi 7b whiich is a 7 billion parameter mo
 ### Qunatization Configuration
-- zero_point: true,
-- q_group_size: 128,
-- w_bit: 4,
-- version: "GEMM",
 - modules_to_not_convert: null

 ### Qunatization Configuration
+- zero_point: true
+- q_group_size: 128
+- w_bit: 4
+- version: "GEMM"
 - modules_to_not_convert: null