Instruction Pre-Training: Language Models are Supervised Multitask Learners
Paper
•
2406.14491
•
Published
•
90
•
25
instruction-pretrain
instruction-pretrain
AI & ML interests
Synthetic Instructions for Pre-Training
Recent Activity
updated
a dataset
3 days ago
instruction-pretrain/ft-instruction-synthesizer-collection
updated
a dataset
3 days ago
instruction-pretrain/medicine-instruction-augmented-corpora
updated
a dataset
3 days ago
instruction-pretrain/general-instruction-augmented-corpora
Organizations
None yet
instruction-pretrain's activity
Delete images
#3 opened 5 days ago
by
instruction-pretrain
Query about the size of dataset
1
#4 opened 5 months ago
by
Applauz
Continued pre-training with replay?
1
#4 opened 26 days ago
by
ostapeno
Adding `safetensors` variant of this model
#1 opened 3 months ago
by
SFconvertbot
How large is the corpus size used for pretraining the finance LLaMA?
1
#2 opened 5 months ago
by
dhkong
commented
2
papers
6 months ago
Update README.md
#2 opened 6 months ago
by
instruction-pretrain
Update README.md
#2 opened 6 months ago
by
instruction-pretrain
Update README.md
#2 opened 6 months ago
by
instruction-pretrain
Update README.md
#1 opened 6 months ago
by
AdaptLLM
Can you share the training code for the instruction synthesizer？
5
#2 opened 8 months ago
by
chenff35
commented
2
papers
7 months ago
Update README.md
#3 opened 7 months ago
by
AdaptLLM
Update README.md
#2 opened 7 months ago
by
instruction-pretrain
Update README.md
#4 opened 7 months ago
by
instruction-pretrain
Update README.md
#5 opened 7 months ago
by
instruction-pretrain
