I chose to quantize all quants again. You can testing the model using this Dataset.Since this is a small distill model please make the prompt more detailed.
Have nice day.
· Sign up or log in to comment