期刊名称：International Journal of Academic Research in Business and Social Sciences
电子版ISSN：2222-6990
出版年度：2020
卷号：10
期号：1
页码：264-292
DOI：10.6007/IJARBSS/v10-i1/6850
语种：English
出版社：Human Resource Management Academic Research Society
摘要：This paper reports series of steps applied in the instrument building process to ensure the validity and reliability of evaluation scales developed in the study. The scales are later used in the main study to measure the implementation of evaluation on policies and programs and simultaneously measure its antecedents (evaluation capacity building (ECB) factors) and consequences (evaluation use) in the Malaysian public sector. There are eight constructs used to measure the proposed framework. Five constructs are used to measure the ECB factors, which are evaluation office (EO), internal evaluators (IE), evaluation information system (EIS), financial resources (FR), and evaluation regulatory framework (ERF). One construct is used to measure the implementation of evaluation and two constructs namely accountability and organisational learning are used to measure evaluation use. In efforts to ensure the content validity of the scales, a pre-test session with six practitioners and a content review session with three experts from the industry and academics were done prior to the pilot study commences. The pre-test session with practitioners helped to validate important constructs of the study. While the content validity session with the experts confirmed the aspects of relevance, clarity, and technical of the instrument are met. Later, a total of 50 respondents who directly involve in evaluation-related activities at selected divisions in various ministries or had previous posting experience in related divisions were chosen as pilot study samples. The reliability tests using the Statistical Package for Social Sciences Program (SPSS) version 22, revealed that the Cronbach’s Alpha scores between 0.732 to 0.923 are well above the minimum set value of 0.70. Therefore, based on the feedbacks from the pre-test respondents and the content review by experts, coupled with the reliability results of the pilot test, the scales can be accepted to be valid and reliable.
