| Tasks | Metric | Value | Stderr | |
|---|---|---|---|---|
| hellaswag_it | acc | 0.4439 | ± | 0.0052 |
| acc_norm | 0.5962 | ± | 0.0051 | |
| arc_it | acc | 0.1257 | ± | 0.0097 |
| acc_norm | 0.4414 | ± | 0.0145 |
- Downloads last month
- 5
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
the model is not deployed on the HF Inference API.