OPT-175B-NumPy / README.md
Neko-Institute-of-Science's picture
FlexGen info
26deb19
metadata
license: other
pipeline_tag: text-generation

Converting OPT-175B to NumPy weights sure took a lot as I did it all on my hardware. 600ish GB of used swap on spinning rust. For the License please read LICENSE.md

Use https://github.com/FMInference/FlexGen to run this model.