Commit History
Fix falcon support lora
b242b69
unverified
Merge pull request #170 from OpenAccess-AI-Collective/NanoCode012-lambdalabs-fix
320beb2
unverified
Feed cfg.inference
bd3b537
unverified
Angainor Development
commited on
WIP: Rely on cfg.inference
813cfa4
unverified
Angainor Development
commited on
Improve lambda labs instruction
2e13cef
unverified
Fix grad checkpoint and outputs param
2a801b0
Fix patching via import instead of hijacking
e44c9e0
Feat: Add landmark attention
55b8542
Merge pull request #168 from bratao/main
febe902
unverified
Disable Wandb
f4df266
Bruno Cabral
commited on
Merge pull request #167 from NanoCode012/fix/redundant-save-eval-steps
281dc3d
unverified
Refactor out unmodified save_steps and eval_steps
2ef4634
Merge pull request #166 from NanoCode012/fix/seed
7eae903
unverified
Merge pull request #132 from utensil/falcon-7b-qlora
c8242de
unverified
Set to use cfg.seed or 42 for backward compat
2cfe9e9
Trim trailing whitespace
79a8f52
unverified
Merge pull request #164 from NanoCode012/fix/falcon-fsdp-validate
afaa0d2
unverified
Fix failing test
bfd27ba
Validate falcon with fsdp
babf0fd
Merge pull request #163 from NanoCode012/feat/matmul-tf32
81911d1
unverified
Set matmul tf32
52765ac
Merge pull request #143 from NanoCode012/fix/deprecate-prepare-8bit-training
73e9ea4
unverified
Merge pull request #162 from NanoCode012/fix/custom-prompt-readme
f8d3798
unverified
Merge pull request #161 from NanoCode012/fix/peft-setup
04a1b77
unverified
Move custom prompts out of hidden
2097a09
Add peft install for quickstart
cfff94b
Update peft and gptq instruction
2b222de
Fix future deprecate prepare_model_for_int8_training
df9528f
Fix training over existing lora
193c73b
unverified
Angainor Development
commited on
Merge pull request #158 from OpenAccess-AI-Collective/prompter-fixes
6abfd87
unverified
fix camel ai, add guanaco/oasst mapping for sharegpt
59bb219
Merge pull request #155 from OpenAccess-AI-Collective/misc-fixes
9a02e7e
unverified
update docs
5b33e29
new prompters, misc fixes for output dir missing using fsdp, and changing max seq len
4ac9e25
Default micro_batch_size to 1 for a safer start
c9c0503
unverified
Add comments/alternatives for falcon-qlora configs
ca11ae9
unverified
Merge pull request #149 from OpenAccess-AI-Collective/docker-clone-axolotl
328c3bc
unverified
shallow clone
5cd2126
clone in docker
12620f3
Merge pull request #148 from OpenAccess-AI-Collective/fix-device-load
4ab0c8b
unverified
fix device map
74ebbf4
Merge pull request #147 from OpenAccess-AI-Collective/winglian-rocker-images
76a70fd
unverified
Update README.md for correct image tags
618816d
unverified
Merge pull request #146 from FarisHijazi/main
91992cb
unverified
added docker-compose file
84169d1
FarisHijazi
commited on