Using Axolotl question

#41
by mrheinen - opened

In the notebook*, the none "it" version of Gemma is used. Is it correct that that one does indeed not require a chat template BUT the it version does require a template ? If so, how is this configured in the yaml file

  • Axolotl.ipynb
Google org
edited Oct 1

Hi @mrheinen ,

Yes, the non-"it" version of Gemma does not require a chat template, while the "it" version does require a template for structuring conversational inputs

I'm unable to open the file because it's not a valid hyperlink. The non-"it" version of the Gemma model doesn't require a chat template, while the "it" version does require a template to structure conversational inputs.

Please refer to the sample code below for configuring yaml file:

Define the Template in a YAML Configuration (gemma2b_it_config.yaml):

image.png

I used the "google/gemma-2-2b-it" model and configured it in a YAML file within the gist, accessible at: Axolotl.ipynb.

Thank you.

Sign up or log in to comment