Salesforce
/

xgen-7b-4k-base

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

xgen-7b-4k-base / tokenization_xgen.py

Commit History

Update tokenization_xgen.py

2a852ea

tianxie-sf commited on Aug 18, 2023

fix issue in get vocab (#9)

49019dd

tianxie-sf commited on Jul 7, 2023

update _convert_id_to_token (#7)

9936980

tianxie-sf commited on Jul 2, 2023

add pad token and default eos token (#6)

3ee890e

tianxie-sf commited on Jun 29, 2023

.

f70089e

rooa commited on Jun 28, 2023

.

d5c0667

rooa commited on Jun 28, 2023

.

4fb6c92

rooa commited on Jun 28, 2023