| tags: | |
| - text-generation-inference | |
| - transformers | |
| license: apache-2.0 | |
| language: | |
| - en | |
| Fine-tuning for function calling purpose | |
| Base model: Qwen/Qwen2.5-1.5B-Instruct | |
| ``` | |
| config = { | |
| "rank": 16, | |
| "alpha": 512, | |
| "learning_rate": 2e-5, | |
| "target_modules": ["attn", "mlps"] | |
| } | |
| ``` |