LAUSR.org creates dashboard-style pages of related content for over 1.5 million academic articles. Sign Up to like articles & get recommendations!

Pay no attention to the man behind the curtain: The overlooked issue of rater selection in psychotherapy observer ratings

Photo from wikipedia

Abstract Objective: Psychotherapy process research relies heavily upon trained raters to identify and code therapist and client behaviors. Raters are often selected out of convenience or availability with little research… Click to show full abstract

Abstract Objective: Psychotherapy process research relies heavily upon trained raters to identify and code therapist and client behaviors. Raters are often selected out of convenience or availability with little research to inform what qualities are desirable for this role. In this study, we evaluated several rater characteristics as potential predictors of raters’ performance. Method: We provided training to 39 undergraduate students to serve as raters in a psychotherapy process study. We assessed baseline characteristics, personality characteristics, executive functioning, and interviewers’ assessment of students’ rating potential as predictors of rater agreement with gold standard ratings (i.e., consensus judgements from a panel of CBT-trained clinicians). We also assessed these variables as predictors of the risk of raters dropping out prior to completing assigned ratings. Results: Higher conscientiousness, higher neuroticism, and a lower year in college predicted greater agreement with the gold standard ratings. Lower year in college also predicted lower risk of dropout. Conclusion: These findings provide empirical support for key characteristics as predictors of rater performance. Such evidence raises the possibility of using these characteristics to select raters and thereby enhance the psychometric properties of psychotherapy ratings.

Keywords: pay attention; man behind; behind curtain; attention man; rater; psychotherapy

Journal Title: Psychotherapy Research
Year Published: 2020

Link to full text (if available)


Share on Social Media:                               Sign Up to like & get
recommendations!

Related content

More Information              News              Social Media              Video              Recommended



                Click one of the above tabs to view related content.