meelu
/

DA-BPE-LLAMA3.2-TOKEN

BPE Tokenization

Model card Files Files and versions Community

DA-BPE-LLAMA3.2-TOKEN / DA BPE Llama 3.2 Special Tokens Map.json

MikkelWK's picture

Upload 3 files

55990aa verified 23 days ago

141 Bytes

	{
	"pad_token": {
	"content": "[PAD]",
	"lstrip": false,
	"normalized": false,
	"rstrip": false,
	"single_word": false
	}
	}