Hugging Face's logo

huihui-ai
/
Llama-3_1-Nemotron-51B-Instruct-abliterated

Text Generation
Transformers
Safetensors
PyTorch
English
nemotron-nas
nvidia
llama-3
abliterated
uncensored
conversational
custom_code
Model card Files Community
1

Did anyone manage to make this model work with vllm?

#1
by nyxia - opened
Discussion
nyxia

Getting same error as the original DeciLMConfig' object has no attribute 'num_key_value_heads_per_layer'

Sign up or log in to comment