Hugging Face's logo

Spaces:
Dovakiins
/
qwerrwe
Build error

App Files Community
qwerrwe / src /axolotl /utils

Commit History

new validation for mpt w grad checkpoints
14668fa

winglian commited on

match up gradient checkpointing when using lora w config
fe0b768

winglian commited on

Merge pull request #182 from OpenAccess-AI-Collective/fix-llama-ref
0124825
unverified

winglian commited on

fix for local variable 'LlamaForCausalLM' referenced before assignment
14163c1

winglian commited on

add support to extend context with xpos rope
a03a7d7

winglian commited on

fix for max sequence len across different model types
7f09106

winglian commited on

Fix backward compat for peft
aefb2fc

Nanobit commited on

Fix patching via import instead of hijacking
e44c9e0

Nanobit commited on

Feat: Add landmark attention
55b8542

Nanobit commited on

Disable Wandb
f4df266

Bruno Cabral commited on

Refactor out unmodified save_steps and eval_steps
2ef4634

Nanobit commited on

Set to use cfg.seed or 42 for backward compat
2cfe9e9

Nanobit commited on

Fix failing test
bfd27ba

Nanobit commited on

Validate falcon with fsdp
babf0fd

Nanobit commited on

Fix future deprecate prepare_model_for_int8_training
df9528f

Nanobit commited on

new prompters, misc fixes for output dir missing using fsdp, and changing max seq len
4ac9e25

winglian commited on

Update doc for grad_accu and add validation tests for batch size
3c71c8d

Nanobit commited on

fix batch size calculation
5a631b3

winglian commited on

Merge pull request #124 from OpenAccess-AI-Collective/xformers-fix
2d0ba3b
unverified

winglian commited on

Merge pull request #120 from OpenAccess-AI-Collective/model-from-path
c7021e1
unverified

winglian commited on

remove unused import and update readme
e3c494c

winglian commited on

copy xformers attn from ooba since we removed dep on alpaca_lora_4bit
6cb2310

winglian commited on

add support for gradient accumulation steps
3aad5f3

winglian commited on

fix up tokenizer config, isort fix
39a208c

winglian commited on

split up llama model loading so config can be loaded from base config and models can be loaded from a path
2520ecd

winglian commited on

Fix incorrect rebase
594e72b

Nanobit commited on

fix relative path for fixtures
cfcc549

winglian commited on

Fix security issue or ignore false positives
a1f9850

Nanobit commited on

Apply isort then black
37293dc

Nanobit commited on

Fix mypy typing
e9650d3

Nanobit commited on

Black formatting
b832a0a

Nanobit commited on

Lint wandb
9c6750a

Nanobit commited on

Lint validation
c2dbf2c

Nanobit commited on

Lint tokenization
e6b57de

Nanobit commited on

Lint schedulers
fe1f4c4

Nanobit commited on

Lint dict
633ff21

Nanobit commited on

Lint trainer.py
ddb86ea

Nanobit commited on

Lint models.py
f4e5d86

Nanobit commited on

Lint callbacks.py
5062eca

Nanobit commited on

Refactor
4c0eddb

Nanobit commited on

Fix data.py lint
cb7cd34

Nanobit commited on

Lint and format
392dfd9

Nanobit commited on

fix relative path for fixtures
e65aeed

winglian commited on

new hf_use_auth_token setting so login to hf isn't required
1c33eb8

winglian commited on

Feat: Update validate_config and add tests
52dd92a

Nanobit commited on

Apply black formatter
7bf2069

Nanobit commited on

refactor: fix previous refactors
56f9ca5

Nanobit commited on

Refactor to use DictDefault instead
8bd7a49

Nanobit commited on

Add DictDefault
18d41ce

Nanobit commited on

Convert attrdict to addict
bdfe7c9

Nanobit commited on