Login
From:
EleutherAI Blog
(Uncensored)
subscribe
Multiple Choice Normalization in LM Evaluation | EleutherAI Blog
https://blog.eleuther.ai/multiple-choice-normalization/
links
backlinks
There are multiple ways of evaluating multiple choice tasks on autoregressive LMs like GPT-3/Neo/J. This post lays out the current prevalent normalization methods.
Roast topics
Find topics
Find it!
