xgen-7b-8k-inst / tokenization_xgen.py

Commit History

add pad token and default eos token
b5bab0d

tianxie-sf commited on

.
b2d761b

rooa commited on