metadata
tags:
- text-generation-inference
- transformers
license: apache-2.0
language:
- en
Fine-tuning for function calling purpose
(16, 512, qkvo, mlp)
config = {
"rank": 16,
"alpha": 512,
"learning_rate": 2e-5,
"target_modules": ["attn", "mlps"]
}