mtasic85's picture
pretrain model, lightning-thunder
50a4621
raw
history blame contribute delete
319 Bytes
# pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cpu
tqdm
datasets
jinja2
transformers
wandb
# litgpt[all]
litgpt[all] @ git+https://github.com/Lightning-AI/litgpt.git
litdata
grokadamw
# bitsandbytes
# pyzstd
# zstd
nvfuser-cu121-torch24
nvidia-cudnn-frontend
lightning-thunder