 Second, an enhanced mask decoder is used to replace the output softmax layer to predict the masked tokens for model pretraining .
<meaning-changed>  Second, an enhanced mask decoder is used to replace the output softmax layer to predict the masked tokens for model pretraining .
 Second, an enhanced mask decoder is used to incorporate absolute positions in the decoding layer to predict the masked tokens for model pretraining .