 We show that these two techniques significantly improve the efficiency of model pre-training and performance of downstream tasks.
<meaning-changed>  We show that these two techniques significantly improve the efficiency of model pre-training and performance of downstream tasks.
 We show that these two techniques significantly improve the efficiency of model pre-training and the performance of both natural languageunderstand (NLU) and natural langauge generation (NLG) tasks.