kogpt-neox-tiny / vocab.json

Commit History

한국어위키, 나무위키, aihub 구어 웹데이터 1%만 사용해서 8k 토크나이저 학습
83acb85

heegyu commited on

tokenizer change
9574aef

heegyu commited on

Upload 2 files
6004cb3

heegyu commited on