Post
1782
I have some New Year presents for you, #MachineLearning and #AI community! We just opened our code for new state-of-the-art results that beat EAGLE-2 and Medusa #LLM inference.
We also shared the model check pt on @huggingface ! @MatthieuZ
Check the blog out: https://huggingface.co/blog/hba123/sotaspeculativedecoding
We also shared the model check pt on @huggingface ! @MatthieuZ
Check the blog out: https://huggingface.co/blog/hba123/sotaspeculativedecoding