needs work. it appears that the 1bit models are far less efficient when scare in terms of memory usage

Downloads last month
6
Safetensors
Model size
8.84B params
Tensor type
F32
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Dataset used to train limin-arc/llama3-8b-1.58bit-pretrained