Darkness Chou

darknessc's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

New activity in TheBloke/dolphin-2.6-mixtral-8x7b-GPTQ about 1 year ago

KeyError: 'model.layers.0.block_sparse_moe.experts.0.w1.g_idx' when running with tensor parallelism on vllm

1

#1 opened about 1 year ago by

KronusCon

New activity in TheBloke/Yi-34B-200K-Llamafied-GPTQ about 1 year ago

Can anyone tell me which parameters are suitable for deploying quantized models on the 4090?

#3 opened about 1 year ago by

darknessc