Assessing The Size Of Halo Effects In Performance Based Tests And A Practical Solution To Avoid Halo Effects

So-called productive abilities (e.g., speaking, writing) that require active behavior of examinees are usually measured via human judgement. That is, examinees demonstrate their ability on a number of assignments and experts are used to assess the quality of their performance. This simple fact gives rise to a myriad of complications. The most conspicuous one being that judges will usually disagree. In this note, we focus on the halo-effect which occurs when ratings are influenced by former ratings.