support for custom messages field in sharegpt (#1651) bbfed31 unverified winglian commited on May 23, 2024
feat: Add LLaMA-3 instruct prompt strategies for fine-tuning (#1553) 50421c8 unverified Ram Ram winglian commited on May 11, 2024
Add Glaive conversation format support (#1365) b7d8a7d unverified Brian Fitzgerald winglian commited on Mar 11, 2024
allow the sharegpt handler to also better handle datasets destined for openai finetuning (#1361) 2598c9f unverified winglian commited on Mar 5, 2024
plain input/output prompt strategy w/o chat templates (#1346) 4d09b42 unverified winglian commited on Mar 4, 2024
Support user-defined prompt processing strategies for dpo (#1248) 1e3d530 unverified nopperl winglian commited on Feb 26, 2024
relora: magnitude pruning of the optimizer (#1245) 8c2e05a unverified winglian commited on Feb 6, 2024
precompute dpo logprobs setting and fixes (#1199) [skip ci] 33e1170 unverified winglian commited on Jan 25, 2024
Feat/chatml add system message (#1117) 98b4762 unverified mhenrichsen Mads Henrichsen winglian commited on Jan 25, 2024
Respect sequence_len in config for `type: llama2_chat` (#926) f1de29d unverified hamel commited on Dec 12, 2023
fixing prompt template of chatml by removal of linebreak (#922) 03c6318 unverified timlim123 Timothy Lim commited on Dec 9, 2023
Update to adapt to sharegpt datasets with "assistant" rather than "gp… (#774) 0800885 unverified MilesQLi winglian commited on Oct 28, 2023
fixes for alpaca w chatml, and don't include attention_mask w mistral for flash attention (#728) 3553172 unverified winglian commited on Oct 14, 2023
support custom field for completion from yml (#580) f7a2263 unverified winglian commited on Sep 15, 2023
feat: add Metharme prompt strategy (#446) f474650 unverified TearGosling Nanobit commited on Aug 22, 2023
support user defined prompters, pretokenized datasets in config, local parquet, local arrow files (#348) d2e7f27 unverified winglian commited on Aug 20, 2023
Attention mask and position id fixes for packing (#285) 2bb0b78 unverified winglian commited on Aug 12, 2023
Fix(message): Improve error message for bad format (#365) e37d935 unverified Nanobit commited on Aug 12, 2023
experimental llama 2 chat support (#296) 3392270 unverified Jan Philipp Harries Jan Philipp Harries commited on Aug 6, 2023
Added Orca Mini prompt strategy (#263) c93655c unverified Jan Philipp Harries Jan Philipp Harries commited on Aug 5, 2023
update prompts for open orca to match the paper (#317) 3d4984b unverified winglian commited on Jul 22, 2023
Fixed pre-commit problems, fixed small bug in logging_config to handle LOG_LEVEL env var b1f4f7a theobjectivedad commited on Jul 15, 2023
Merge pull request #255 from OpenAccess-AI-Collective/open-orca-prompts 1e5014a unverified winglian commited on Jul 1, 2023
Merge pull request #224 from OpenAccess-AI-Collective/system-prompt-data f150c02 unverified winglian commited on Jun 27, 2023