BSOD
#2
by
AbraamSaint
- opened
Hi! If i trying to give to model a long text part to read it and write me some conclusions the model starting write and soon while bot writing reply for me i getting BSOD. I use text gen web ui. Almost all setting leaved default. GPU layers 0, because on other values the model load failed. Max new tokens i've set to 4096. Chat mode - instruct. Any ideas why it happening?
pc setup:
cpu threadripper 3960x
ram 128gb 3200
gpu rtx4090