Ask a Question

Prefer a chat interface with context about you and your work?

Assessing quality of selection procedures: Lower bound of false positive rate as a function of inter‐rater reliability

Assessing quality of selection procedures: Lower bound of false positive rate as a function of inter‐rater reliability

Abstract Inter‐rater reliability (IRR) is one of the commonly used tools for assessing the quality of ratings from multiple raters. However, applicant selection procedures based on ratings from multiple raters usually result in a binary outcome; the applicant is either selected or not. This final outcome is not considered in …