is this filtered or unfiltered can it run on my 3090?
#4 opened 12 months ago
by
Avos0001
32k ctx doesn't work on this model for GGUF
#3 opened about 1 year ago
by
danieloneill

Using the new gguf quant method may result in a worse overall performance than that of the old gguf quants.
#2 opened about 1 year ago
by
TheYuriLover
Requesting IQ2_XXS and IQ2_XS quants.
#1 opened about 1 year ago
by
benxh