 We then apply the proposed self-supervised pre-training  to existing generation models BART and T5 for domain adaptation.
<clarity>  We then apply the proposed self-supervised pre-training  to existing generation models BART and T5 for domain adaptation.
 We then apply self-supervised pre-training to existing generation models BART and T5 for domain adaptation.