LAUSR.org creates dashboard-style pages of related content for over 1.5 million academic articles. Sign Up to like articles & get recommendations!

Enhancing the defensibility of examiners’ marks in high stake OSCEs

Photo by campaign_creators from unsplash

BackgroundMost assessments in health professions education consist of knowledge-based examinations as well as practical and clinical examinations. Among the most challenging aspects of clinical assessments is decision making related to… Click to show full abstract

BackgroundMost assessments in health professions education consist of knowledge-based examinations as well as practical and clinical examinations. Among the most challenging aspects of clinical assessments is decision making related to borderline grades assigned by examiners. Borderline grades are commonly used by examiners when they do not have sufficient information to make clear pass/fail decisions. The interpretation of these borderline grades is rarely discussed in the literature. This study reports the application of the Objective Borderline Method (version 2, henceforth: OBM2) to a high stakes Objective Structured Clinical Examination undertaken at the end of the final year of a Medicine program in Australia.MethodsThe OBM2 uses all examination data to reclassify borderline grades as either pass or fail. Factor analysis was used to estimate the suitability of data for application of OBM2. Student’s t-tests, utilising bootstrapping, were used to compare the OBM2 with ‘traditional’ results. Interclass correlations were used to estimate the association between the grade reclassification and all other grades in this examination.ResultsThe correlations between scores for each station and pass/fail outcomes increased significantly after the mark reclassification, yet the reclassification did not significantly impact on students’ total scores. Examiners, students and program leaders expressed high levels of satisfaction and the Faculty’s Curriculum Development Committee has decided that the OBM2 will be used for all future clinical examinations. Implications of the OBM2 are discussed.ConclusionsThe OBM2 provides a feasible, defensible and acceptable solution for classification of borderline grades as either pass or fail.

Keywords: defensibility examiners; borderline grades; enhancing defensibility; pass fail

Journal Title: BMC Medical Education
Year Published: 2018

Link to full text (if available)


Share on Social Media:                               Sign Up to like & get
recommendations!

Related content

More Information              News              Social Media              Video              Recommended



                Click one of the above tabs to view related content.