 Second, an enhanced mask decoder is used to replace the output softmax layer to predict the masked tokens for model pretraining .
<clarity>  Second, an enhanced mask decoder is used to replace the output softmax layer to predict the masked tokens for model pretraining .
 Second, an enhanced mask decoder is used to replace the output softmax layer to predict the masked tokens in model pre-training .