标题：Examiner seniority and experience are associated with bias when scoring communication,but not examination,skills in objective structured clinical examinations in Australia
期刊名称：Journal of Educational Evaluation for Health Professions
电子版ISSN：1975-5937
出版年度：2018
卷号：15
期号：1
页码：1-5
DOI：10.3352/jeehp.2018.15.17
语种：English
出版社：Korea Health Insurance Licensing Examination Institute
摘要：Purpose:The biases that may influence objective structured clinical examination (OSCE) scoring are well understood,and recent re_x0002_search has attempted to establish the magnitude of their impact.However,the influence of examiner experience,clinical seniority,and occupation on communication and physical examination scores in OSCEs has not yet been clearly established.Methods:We com?pared the mean scores awarded for generic and clinical communication and physical examination skills in 2 undergraduate medicine OSCEs in relation to examiner characteristics (gender,examining experience,occupation,seniority,and speciality).The statistical sig?nificance of the differences was calculated using the 2-tailed independent t-test and analysis of variance.Results:Five hundred and seventeen students were examined by 237 examiners at the University of New South Wales in 2014 and 2016.Examiner gender,occupation (academic,clinician,or clinical tutor),and job type (specialist or generalist) did not significantly impact scores.Junior doc?tors gave consistently higher scores than senior doctors in all domains,and this difference was statistically significant for generic and clinical communication scores.Examiner experience was significantly inversely correlated with generic communication scores.Con?clusion:We suggest that the assessment of examination skills may be less susceptible to bias because this process is fairly prescriptive,affording greater scoring objectivity.We recommend training to define the marking criteria,teaching curriculum,and expected level of performance in communication skills to reduce bias in OSCE assessment.
关键词：Purpose:The biases that may influence objective structured clinical examination (OSCE) scoring are well understood,and recent re_x0002_search has attempted to establish the magnitude of their impact.However,the influence of examiner experience,clinical seniority,and occupation on communication and physical examination scores in OSCEs has not yet been clearly established.Methods:We com?pared the mean scores awarded for generic and clinical communication and physical examination skills in 2 undergraduate medicine OSCEs in relation to examiner characteristics (gender,examining experience,occupation,seniority,and speciality).The statistical sig?nificance of the differences was calculated using the 2-tailed independent t-test and analysis of variance.Results:Five hundred and seventeen students were examined by 237 examiners at the University of New South Wales in 2014 and 2016.Examiner gender,occupation (academic,clinician,or clinical tutor),and job type (specialist or generalist) did not significantly impact scores.Junior doc?tors gave consistently higher scores than senior doctors in all domains,and this difference was statistically significant for generic and clinical communication scores.Examiner experience was significantly inversely correlated with generic communication scores.Con?clusion:We suggest that the assessment of examination skills may be less susceptible to bias because this process is fairly prescriptive,affording greater scoring objectivity.We recommend training to define the marking criteria,teaching curriculum,and expected level of performance in communication skills to reduce bias in OSCE assessment.
