Commit History
Update decode method in tokenizer
4d0fc39
Always add gmask in token ids
3a99d79
Fix bug
53f0197
Fix eos token in tokenizer
aa51e62
Fix tokenizer config saving
7e69b85
Add gmask token id
36b7f2d
Update code for slim
63ce1ba
Drop icetk dependency
72985e8
Fix decode method for torch tensor
23ad39b
Fix generate
fb23542
Fix attention_mask and position_ids
373fd6b
Fix encode method
e22cddf
Fix batch input
e1494f2
Implement batch generation
cc96a22
Change padding side
db22499
Fix typo in tokenization_chatglm.py
1b54948
songxxzp
commited on
