Intel
/

neural-chat-7b-v3-1-int4-inc

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

weiweiz1 commited on Aug 26

Commit

e27c27b

•

1 Parent(s): 3320708

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -30,7 +30,7 @@ python3 main.py \
 --iters 1000 \
 --enable_minmax_tuning \
 --disable_quanted_input \
---minmax_lr 0.0002 \
 --deployment_device 'gpu' \
 --scale_dtype 'fp32' \
 --eval_bs 32 \

 --iters 1000 \
 --enable_minmax_tuning \
 --disable_quanted_input \
+--minmax_lr 0.002 \
 --deployment_device 'gpu' \
 --scale_dtype 'fp32' \
 --eval_bs 32 \