LLAma 3.1 8B f16 looks better then Q3_KM
pinned
1
#3 opened 5 months ago
by
gopi87
Models Q4-K_M and Q5-K_M seems to use 'smaug-bpe' which fails to load the model.
1
#7 opened 5 months ago
by
sayanmndl21
IQ2_S model?
9
#4 opened 5 months ago
by
kerrmetric