Achal Dave commited on
Commit
23b1485
·
1 Parent(s): e99130c

Update README

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -61,7 +61,7 @@ As described in the paper, Core accuracy is the average of centered accuracy on
61
  over 53 tasks. We evaluate the models using llm-foundry.
62
 
63
 
64
- | Model | Params | Tokens | Open dataset? | \lowvar | MMLU | \aggscore |
65
  |-----------------------------------|--------|--------|---------------|----------|----------|-----------|
66
  | **Open weights, closed datasets** | | | | | | |
67
  | Qwen2-1.5B | 1.5B | ? | ❌ | 42.1 | **56.4** | **32.4** |
 
61
  over 53 tasks. We evaluate the models using llm-foundry.
62
 
63
 
64
+ | Model | Params | Tokens | Open dataset? | Core | MMLU | Extended |
65
  |-----------------------------------|--------|--------|---------------|----------|----------|-----------|
66
  | **Open weights, closed datasets** | | | | | | |
67
  | Qwen2-1.5B | 1.5B | ? | ❌ | 42.1 | **56.4** | **32.4** |