max output tokens?
#11
by
sirus
- opened
4k? something else? I take it the context size is 131072 from the json files
It can feasibly go to 16k, but was only trained for 8k output tokens.
4k? something else? I take it the context size is 131072 from the json files
It can feasibly go to 16k, but was only trained for 8k output tokens.