411 REFERENCE · Wiktionary
MMLU
Reference material by Wiktionary contributors. This retains its source identity and is not 411 news reporting.
English
Proper noun
en computing AI en Massive Multitask Language Understanding.
en 2024-05-01 Yifan Mai and Percy Liang Massive Multitask Language Understanding (MMLU) on HELM 'Despite the prominence of the Massive Multitask Language Understanding (MMLU) benchmark, MMLU scores reported by model creators are frequently produced in inconsistent or problematic ways' https://crfm.stanford.edu/2024/05/01/helm-mmlu.html https://web.archive.org/web/20240718205659/https://crfm.stanford.edu/2024/05/01/helm-mmlu.html