MiniCorpus
Collection
github.com/MK2112/minicorpus
•
19 items
•
Updated
| Benchmark | Measure | 160M MiniPile | 160M k440 Inter High | |
|---|---|---|---|---|
| ARC-Challenge | acc | ↑ | 0.2125 ± 0.0120 | 0.1911 ± 00115 |
| MMLU | acc | ↑ | 0.2699 ± 0.0037 | 0.2295 ± 0.0035 |
| HellaSwag | acc | ↑ | 0.2560 ± 0.0044 | 0.2610 ± 0.0044 |
| WinoGrande | acc | ↑ | 0.4720 ± 0.0140 | 0.5185 ± 0.0140 |
| Lambada (OpenAI) | acc | ↑ | 0.0000 ± 0.0000 | 0.0000 ± 0.0000 |
| Lambada (OpenAI) | perplexity | ↓ | 3033175.2693 ± 288926.5827 | 1976271.1659 ± 158805.4234 |
| Lambada (Std) | acc | ↑ | 0.0000 ± 0.0000 | 0.0000 ± 0.0000 |
| Lambada (Std) | perplexity | ↓ | 27067951.3460 ± 2710040.191 | 12395759.9269 ± 1104763.2927 |
| BLiMP | acc | ↑ | 0.5194 ± 0.0018 | 0.5440 ± 0.0017 |
- Downloads last month
- 6
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.
Model tree for Marcus2112/pythia-160m-minipile_k440_high-inter_density-proportioned
Base model
EleutherAI/pythia-160m-deduped