| datasets: | |
| - breadlicker45/bread-midi-dataset | |
| tags: | |
| - music | |
| - midi | |
| - music generation | |
| - midi generation | |
| ## Training Details | |
| ### Training Data | |
| - [breadlicker45/bread-midi-dataset](https://huggingface.co/datasets/breadlicker45/bread-midi-dataset) | |
| #### Training Hyperparameters | |
| - model: phi3 | |
| - config: tv2o-medium | |
| - max-len: 2048 | |
| - lr: 1e-4 then 2e-5 | |
| - weight-decay: 0.01 | |
| - batch: 2x2x2 | |
| - bfloat16 precision | |
| #### Loss | |
| - val loss: 0.2159 | |
| ## Files | |
| - model.ckpt: latest model checkpoint |