Detecting Rater Biases in Sparse Rater-Mediated Assessment Networks
Sign Up to like & getrecommendations! Published in 2021 at "Educational and Psychological Measurement"
DOI: 10.1177/0013164420988108
Abstract: Practical constraints in rater-mediated assessments limit the availability of complete data. Instead, most scoring procedures include one or two ratings for each performance, with overlapping performances across raters or linking sets of multiple-choice items to… read more here.
Keywords: biases sparse; rater biases; detecting rater; rater mediated ... See more keywords
Modeling Rating Order Effects Under Item Response Theory Models for Rater-Mediated Assessments
Sign Up to like & getrecommendations! Published in 2023 at "Applied Psychological Measurement"
DOI: 10.1177/01466216231174566
Abstract: Rater effects are commonly observed in rater-mediated assessments. By using item response theory (IRT) modeling, raters can be treated as independent factors that function as instruments for measuring ratees. Most rater effects are static and… read more here.
Keywords: rater mediated; rating; order; rater effects ... See more keywords