Compare
Palmyra-X-004 vs Palmyra X V3 (72B)
MMLU (HELM). The best value in each row is marked.
| Measure | Palmyra-X-004HELM v1.13.0SubmittedMirrored | Palmyra X V3 (72B)HELM v1.13.0SubmittedMirrored |
|---|---|---|
| Score | 73.9 | 70.2 |
| Cost | $0 | $0 |
| Time | 0 ms | 0 ms |
| Tokens | 0 | 0 |
| mmlu | 73.9 | 70.2 |