Models
Datasets
Spaces
Posts
Docs
Pricing
Log In
Sign Up

geniacllm
/

ja-en-tokenizer-unigram-v5

Model card Files Files and versions Community

ja-en-tokenizer-unigram-v5

2 contributors

History: 3 commits

miya-99999's picture

Update README.md

885b04f verified 7 months ago

.gitattributes

1.52 kB

initial commit 7 months ago
README.md

3.06 kB

Update README.md 7 months ago
special_tokens_map.json

676 Bytes

Upload 3 files 7 months ago
tokenizer.model

972 kB
LFS

Upload 3 files 7 months ago
tokenizer_config.json

1.97 kB

Upload 3 files 7 months ago