Commit History

Update README.md
0f2ee3d

hungeni commited on

Extend vocab size from 32000 to 44800, prepare for continued pretrain
bebdb8e

hungeni commited on

Add LLamaTokenizerFast model
54e8886

hungeni commited on

Create README.md
4526342

hungeni commited on

Add Tokeninizer
4e15614

hungeni commited on

Extend vocab size from 32K to 41K, add 9K vocabs for Vietnamese
2659d1d

hungeni commited on

initial commit
b3078a5

hungeni commited on