ethzanalytics
/

dolly-v2-7b-sharded-8bit

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions Community

dolly-v2-7b-sharded-8bit / generation_config.json

Commit History

increase number of 🅱️eams

9c80d24

pszemraj commited on Apr 26, 2023

update sampling parameters

13de30f

pszemraj commited on Apr 25, 2023

Update generation_config.json

1e1598b

pszemraj commited on Apr 25, 2023

Update generation_config.json

53e37e3

pszemraj commited on Apr 25, 2023

Update generation_config.json

ce8eb35

pszemraj commited on Apr 25, 2023

force max_length as None/null

63d6c43

pszemraj commited on Apr 25, 2023

add early_stopping and do_sample

e5f3fba

pszemraj commited on Apr 25, 2023

update default gen params

c7382b6

pszemraj commited on Apr 25, 2023

add sharded checkpoint

a2b265b

peter szemraj commited on Apr 24, 2023