MBZUAI
/

MobiLlama-05B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

num_key_value_heads bug?

#4

by cckm - opened Mar 1, 2024

cckm

Mar 1, 2024

num_key_value_heads seems to be unreferenced in https://huggingface.co/MBZUAI/MobiLlama-05B/blob/main/modelling_mobillama.py?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment