INT8 Weight Only Quantization

#10
by deleted - opened
deleted
This comment has been hidden
Whisper Distillation org

Hey @Hank012 - do you have any further details on how you've quantised the model? E.g. library, hyper parameters, etc? A reproducible code snippet would be awesome here!

Sign up or log in to comment