Peter Kis's picture

9 2 12

Peter Kis

NePe

·

AI & ML interests

None yet

Organizations

None yet

NePe's activity

New activity in google/gemma-2-27b-it 6 months ago

with load_in_4bit it just generates <pad> tokens

#16 opened 6 months ago by

New activity in rainjay/gemma-2-27b-it-4bit 6 months ago

it just keeps generating <pad> tokens

#1 opened 6 months ago by

New activity in TheBlokeAI/Mixtral-tiny-GPTQ about 1 year ago

Seems like the GPTQ versions are broken

#2 opened about 1 year ago by

What is this model?

#1 opened about 1 year ago by

New activity in TheBloke/Mixtral-8x7B-v0.1-GPTQ about 1 year ago

Build AutoGPTQ from source

#1 opened about 1 year ago by

New activity in open-llm-leaderboard/open_llm_leaderboard about 1 year ago

Impossible to search/filter for 13B GPTQ models.

#293 opened over 1 year ago by

New activity in elinas/alpaca-30b-lora-int4 almost 2 years ago

How to do inferance?

#2 opened almost 2 years ago by

New activity in mrsteyk/openchatgpt-neox-125m almost 2 years ago

Training

#3 opened almost 2 years ago by