摘要：Purpose:The purpose of this study is to test the reliability of the clinical performance examination (CPX) using Generalizability theory (G-theory). Through G-theory,the effects of not only students and tasks but also the school will be analyzed as primary sources of error,which can affect the interpretation of the reliability of the CPX. Methods:One thousand three hundred nineteen students from 16 medical schools that participated in the Seoul-Gyeonggi CPX Consortium 2008 were enrolled. In our research design,we suppose that student is nested within school and crossed with task. Data analysis was conducted with urGenova. Results:According to our analysis,the percentage of error variance was 6.2% for school,14.9% for student nested within school, 14.4% for task,and 3% for interaction between school and task. An effect of school on students was observed,but the interaction between task and school was insignificant. When student is nested within school,the universe score decreased and the g-coefficient was less than the g-coefficient of the p ×t (p:studentm,t:task) design. Conclusion:The results show that generalizability theory is useful in detecting various error components in the CPX. Using the generalizability theory to improve the technical quality of performance assessments provides us with greater information compared with traditional test theories.
其他摘要：의사 국가시험에 실기시험 도입이 본격화되면서 의과대학교육과정에서 임상수행능력평가(clinical performance examination,CPX)가 활성화되고 있다. CPX는 의과대학 학생 평가에 수행평가방법을 적용한 것인데,수행평가란 학습자가 습득한 지식,기능이나 기술을 실제 생활이나 인위적 평가 상황에서 얼마나 잘 수행하는지 혹은 어떻게 수행할 것인지를 서술,관찰,면접 등의 다양한 방법을 통해 종합적이며 전문적 으로 판단하는 평가 방법이다[1].
