susnato
/

ernie-m-large_pytorch

susnato commited on Jan 30, 2023

Commit

6effaee

•

1 Parent(s): c9e8afa

Now it will convert the weights of 24 encoder layers rather than 12

Files changed (1) hide show

convert.py CHANGED Viewed

@@ -21,7 +21,7 @@ import torch
 from paddle import fluid
 import numpy as np
-def build_params_map(attention_num=12):
     """
     build params map from paddle-paddle's ERNIE to transformer's BERT
     :return:

 from paddle import fluid
 import numpy as np
+def build_params_map(attention_num=24):
     """
     build params map from paddle-paddle's ERNIE to transformer's BERT
     :return: