 Via careful data cleaning and filtering , our transformer-based pretrained model without any finetuning achieves remarkable results over various news summarization tasks.
<clarity>  Via careful data cleaning and filtering , our transformer-based pretrained model without any finetuning achieves remarkable results over various news summarization tasks.
 We collect a massive news corpus and conduct data cleaning and filtering , our transformer-based pretrained model without any finetuning achieves remarkable results over various news summarization tasks.