README.md

---
title: README
emoji: 🌖
colorFrom: yellow
colorTo: purple
sdk: static
pinned: false
---
<p align="center">
  <img src="https://cdn.discordapp.com/attachments/1148275552885686382/1156646625020739634/skunkworks_rocket.png?ex=65959c1c&is=6583271c&hm=55a3f63475922674061849242056989abfece1ff2a92628911e2ce5f93740cc0&" style="width: 10%; display: block; margin: auto;">
</p>

<div style="text-align: center; font-size: 1.5em; font-family: Arial, sans-serif; margin-top: 20px; margin-bottom: 20px;">
  <div style="font-weight: bold; margin-bottom: 5px;">Hydra-MoE: A new class of Open-Source Mixture of Experts</div>
  <div style="font-size: 0.6em;">a SkunkWorks Project</div>
</div>

<div style="text-align: center">
Skunkworks OSS introduces Hydra-MoE, an innovative Mixture of Experts (MoE) architecture that leverages LoRA/QLoRA experts to scale and augment the performance of base language models. The central aim of this research is to transmute any base language model into an advanced, lightweight, and efficient MoE framework, employing swappable QLoRA Expert Adapters, with the objective of achieving performance levels that rival state-of-the-art models and can run on commodity/consumer hardware. 
</div>
<br><br>
<div style="text-align: center">
   <h1> Core Team  </h1>
</div>

<div style="display: flex; flex-wrap: wrap; justify-content: space-around; padding: 20px;">
    <div style="margin: 10px; padding: 20px; border: 1px solid #ddd; border-radius: 10px; text-align: center; width: 200px;">
        <img src="https://pbs.twimg.com/profile_images/1636939726199324672/Y0HBuH0x_400x400.jpg" alt="Far El" style="max-width: 100%; height: auto; border-radius: 50%;">
        <h3>Far El</h3>
        <a href="https://twitter.com/far__el" target="_blank" style="display: block; margin-top: 10px; background-color: white; color: black; padding: 10px; text-decoration: none; border-radius: 5px;">Follow @Far__El</a>
    </div>
    <div style="margin: 10px; padding: 20px; border: 1px solid #ddd; border-radius: 10px; text-align: center; width: 200px;">
        <img src="https://pbs.twimg.com/profile_images/1360080449113120768/AbrwPrdC_400x400.jpg" alt="Prateek Yadav" style="max-width: 100%; height: auto; border-radius: 50%;">
        <h3>Prateek Yadav</h3>
        <a href="https://twitter.com/prateeky2806" target="_blank" style="display: block; margin-top: 10px; background-color: white; color: black; padding: 10px; text-decoration: none; border-radius: 5px;">Follow @Prateeky2806</a>
    </div>
    <div style="margin: 10px; padding: 20px; border: 1px solid #ddd; border-radius: 10px; text-align: center; width: 200px;">
        <img src="https://pbs.twimg.com/profile_images/1780511167602978816/fp_-o3W2_400x400.jpg" alt="Alpay Ariyak" style="max-width: 100%; height: auto; border-radius: 50%;">
        <h3>Alpay Ariyak</h3>
        <a href="https://twitter.com/alpayariyak" target="_blank" style="display: block; margin-top: 10px; background-color: white; color: black; padding: 10px; text-decoration: none; border-radius: 5px;">Follow @AlpayAriyak</a>
    </div>
    <div style="margin: 10px; padding: 20px; border: 1px solid #ddd; border-radius: 10px; text-align: center; width: 200px;">
        <img src="https://pbs.twimg.com/profile_images/1744856010601218048/eF8hlJWR_400x400.jpg" alt="Artem Yatsenko" style="max-width: 100%; height: auto; border-radius: 50%;">
        <h3>Artem Yatsenko</h3>
        <a href="https://twitter.com/sumo43_" target="_blank" style="display: block; margin-top: 10px; background-color: white; color: black; padding: 10px; text-decoration: none; border-radius: 5px;">Follow @Sumo43_</a>
    </div>
    <div style="margin: 10px; padding: 20px; border: 1px solid #ddd; border-radius: 10px; text-align: center; width: 200px;">
        <img src="https://pbs.twimg.com/profile_images/1027673085162528768/VbktJ2Jz_400x400.jpg" alt="Harrison Kinsley" style="max-width: 100%; height: auto; border-radius: 50%;">
        <h3>Harrison Kinsley</h3>
        <a href="https://twitter.com/Sentdex" target="_blank" style="display: block; margin-top: 10px; background-color: white; color: black; padding: 10px; text-decoration: none; border-radius: 5px;">Follow @Sentdex</a>
    </div>
   <div style="margin: 10px; padding: 20px; border: 1px solid #ddd; border-radius: 10px; text-align: center; width: 200px;">
        <img src="https://pbs.twimg.com/profile_images/1661945893782802432/e7yLoESw_400x400.jpg" alt="Yaroslav Shipilov" style="max-width: 100%; height: auto; border-radius: 50%;">
        <h3>Nisten</h3>
        <a href="https://twitter.com/nisten" target="_blank" style="display: block; margin-top: 10px; background-color: white; color: black; padding: 10px; text-decoration: none; border-radius: 5px;">Follow @Nisten</a>
    </div>
    <div style="margin: 10px; padding: 20px; border: 1px solid #ddd; border-radius: 10px; text-align: center; width: 200px;">
        <img src="https://pbs.twimg.com/profile_images/1730858077707243520/GVixelm0_400x400.jpg" alt="Yaroslav Shipilov" style="max-width: 100%; height: auto; border-radius: 50%;">
        <h3>Yaroslav Shipilov</h3>
        <a href="https://twitter.com/TheSlavant" target="_blank" style="display: block; margin-top: 10px; background-color: white; color: black; padding: 10px; text-decoration: none; border-radius: 5px;">Follow @TheSlavant</a>
    </div>
     <div style="margin: 10px; padding: 20px; border: 1px solid #ddd; border-radius: 10px; text-align: center; width: 200px;">
        <img src="https://pbs.twimg.com/profile_images/1642401912648777728/2KFikPsE_400x400.jpg" alt="Yaroslav Shipilov" style="max-width: 100%; height: auto; border-radius: 50%;">
        <h3>Teknium</h3>
        <a href="https://twitter.com/teknium1" target="_blank" style="display: block; margin-top: 10px; background-color: white; color: black; padding: 10px; text-decoration: none; border-radius: 5px;">Follow @Teknium1</a>
    </div>
</div>
<div style="text-align: center">
And many more contributors!
</div>