File size: 326 Bytes

0d866d7
 
94be0a6
 
 
 
0d866d7
35fd71c
 
 
6f32969

---
license: apache-2.0
tags:
- merge
language:
- en
---
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6589d7e6586088fd2784a12c/IPxdU9JFGcrEmqzOdV46Z.png)
# It will run...but on what hardware?

## 512 experts in one MoE

[A giant merge of all the same model](https://huggingface.co/ahxt/LiteLlama-460M-1T)