ArthurZ HF staff jonatanklosko commited on
Commit
e3bd65e
1 Parent(s): 1819ebb

Changes for fast tokenizer (#5)

Browse files

- Add tokenizer.json (9d44cb6bf8fbd16ae5d2c0191debf5717fc5f466)


Co-authored-by: Jonatan Kłosko <[email protected]>

Files changed (1) hide show
  1. tokenizer.json +0 -0
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff