mosaicml
/

mosaic-bert-base-seqlen-256

Model card Files Files and versions Community

mosaic-bert-base-seqlen-256 / config.json

Commit History

Change attention_probs_dropout_prob to 0.1 so that triton FlashAttention dependencies are avoided

48ab7cc

jacobfulano commited on Jan 3, 2024

Upload BertForMaskedLM

51f2ae5

jacobfulano commited on May 2, 2023