t5-large-quantized / README.md
leumastai's picture
Create README.md
cbd5012
metadata
license: mit
language:
  - en
tags:
  - onnx
  - quantization

This repository contains quantized T5-large model. This model is 5x lesser than the T5-large model and also the inference time has been reduced by 3x on CPU, whilst giving impressive results.