nvidia

/

Hymba-1.5B-Base

like 136

Follow

NVIDIA 12k

Dear authors,
thank you for the great work and making the model public.

I would like to reproduce the throughput results from figure 2. Could you assist me on this?
Currently, with transformers library and with all the requires Hymba dependencies, Hymba is much slower than Llama 1B in my generation experiments.

Thanks in advance!