README.md

metadata

title: README
emoji: 🐦
colorFrom: pink
colorTo: indigo
sdk: static
pinned: false

Hi, I am a magpie 🐦!

🕸️ Project Website: https://magpie-align.github.io/

📄 Technical Report: https://arxiv.org/abs/2406.08464

🤗 HF Paper Page: https://huggingface.co/papers/2406.08464

😬 Codes: https://github.com/magpie-align/magpie

You can try the Magpie demo 🤗 here to generate instruction-response pairs. Thanks a lot for the quick implementation from @davanstrien!

Dataset Navigation 🧭

Meta Llama 3

Model Name	Dataset	Type	Description
Llama 3 70B Instruct	Magpie-Pro-1M	SFT	1M Raw conversations built with Meta Llama 3 70B.
Llama 3 70B Instruct	Magpie-Pro-300K-Filtered	SFT	Apply a filter and select 300K high quality conversations.
Llama 3 70B Instruct	Magpie-Pro-MT-300K	SFT	Select 300K difficult questions and extend to multi-turn conversations.
Llama 3 8B Instruct	Magpie-Air-3M	SFT	3M Raw conversations built with Meta Llama 3 8B.
Llama 3 8B Instruct	Magpie-Air-300K-Filtered	SFT	Apply a filter and select 300K high quality data.
Llama 3 8B Instruct	Magpie-Air-MT-300K	SFT	Select 300K difficult questions and extend to multi-turn conversations.

Qwen2

Model Name	Dataset	Type	Description
Qwen2 72B Instruct	Magpie-Qwen2-Pro-1M	SFT	1M Raw conversations built with Qwen2 72B Instruct.
Qwen2 72B Instruct	Magpie-Qwen2-Pro-300K-Filtered	SFT	Apply a filter and select 300K high quality conversations.
Qwen2 72B Instruct	Magpie-Qwen2-Pro-200K-Chinese	SFT	Apply a filter and select 200K high quality Chinese conversations.
Qwen2 7B Instruct	Magpie-Qwen2-Air-3M	SFT	3M Raw conversations built with Qwen2 7B Instruct.
Qwen2 7B Instruct	Magpie-Qwen2-Air-300K-Filtered	SFT	Apply a filter and select 300K high quality conversations.

Phi-3

Model Name	Dataset	Type	Description
Phi-3 Medium Instruct	Magpie-Phi3-Pro-1M	SFT	1M Raw conversations built with Phi-3 Medium Instruct.
Phi-3 Medium Instruct	Magpie-Phi3-Pro-300K-Filtered	SFT	Apply a filter and select 300K high quality conversations.