Using Axolotl question
In the notebook*, the none "it" version of Gemma is used. Is it correct that that one does indeed not require a chat template BUT the it version does require a template ? If so, how is this configured in the yaml file
- Axolotl.ipynb
Hi @mrheinen ,
Yes, the non-"it" version of Gemma does not require a chat template, while the "it" version does require a template for structuring conversational inputs
I'm unable to open the file because it's not a valid hyperlink. The non-"it" version of the Gemma model doesn't require a chat template, while the "it" version does require a template to structure conversational inputs.
Please refer to the sample code below for configuring yaml file:
Define the Template in a YAML Configuration (gemma2b_it_config.yaml):
I used the "google/gemma-2-2b-it" model and configured it in a YAML file within the gist, accessible at: Axolotl.ipynb.
Thank you.