期刊名称：Journal of Educational Evaluation for Health Professions
电子版ISSN：1975-5937
出版年度：2017
卷号：14
期号：1
页码：1-9
DOI：10.3352/jeehp.2017.14.17
语种：English
出版社：Korea Health Insurance Licensing Examination Institute
摘要：Computerized adaptive testing (CAT) has been implemented in high-stakes examinations such as the National Council Licensure Ex_x0002_amination-Registered Nurses in the United States since 1994.Subsequently,the National Registry of Emergency Medical Technicians in the United States adopted CAT for certifying emergency medical technicians in 2007.This was done with the goal of introducing the implementation of CAT for medical health licensing examinations.Most implementations of CAT are based on item response theory,which hypothesizes that both the examinee and items have their own characteristics that do not change.There are 5 steps for implementing CAT:first,determining whether the CAT approach is feasible for a given testing program;second,establishing an item bank;third,pretesting,calibrating,and linking item parameters via statistical analysis;fourth,determining the specification for the fi?nal CAT related to the 5 components of the CAT algorithm;and finally,deploying the final CAT after specifying all the necessary components.The 5 components of the CAT algorithm are as follows:item bank,starting item,item selection rule,scoring procedure,and termination criterion.CAT management includes content balancing,item analysis,item scoring,standard setting,practice analy?sis,and item bank updates.Remaining issues include the cost of constructing CAT platforms and deploying the computer technology required to build an item bank.In conclusion,in order to ensure more accurate estimations of examinees’ ability,CAT may be a good option for national licensing examinations.Measurement theory can support its implementation for high-stakes examinations.
关键词：Computerized adaptive testing (CAT) has been implemented in high-stakes examinations such as the National Council Licensure Ex_x0002_amination-Registered Nurses in the United States since 1994.Subsequently,the National Registry of Emergency Medical Technicians in the United States adopted CAT for certifying emergency medical technicians in 2007.This was done with the goal of introducing the implementation of CAT for medical health licensing examinations.Most implementations of CAT are based on item response theory,which hypothesizes that both the examinee and items have their own characteristics that do not change.There are 5 steps for implementing CAT:first,determining whether the CAT approach is feasible for a given testing program;second,establishing an item bank;third,pretesting,calibrating,and linking item parameters via statistical analysis;fourth,determining the specification for the fi?nal CAT related to the 5 components of the CAT algorithm;and finally,deploying the final CAT after specifying all the necessary components.The 5 components of the CAT algorithm are as follows:item bank,starting item,item selection rule,scoring procedure,and termination criterion.CAT management includes content balancing,item analysis,item scoring,standard setting,practice analy?sis,and item bank updates.Remaining issues include the cost of constructing CAT platforms and deploying the computer technology required to build an item bank.In conclusion,in order to ensure more accurate estimations of examinees’ ability,CAT may be a good option for national licensing examinations.Measurement theory can support its implementation for high-stakes examinations.
