GPT2 124M (over)Trained on https://huggingface.co/datasets/eastwind/tiny-sherlock-audio
Using https://github.com/nivibilla/build-nanogpt/tree/audio
