Evaluating & Approving CMT Test Questions
Getting an ISO/IEC 17024 testing accreditation for a Certified Metrology Technician is no trivial matter. Much like a 17025 accreditation, which we are all familiar with, 17024 has a long list of requirements and procedures in place to get accredited. Not only do you need to create testing criteria, but the results also have to be statistically evaluated for reliability and validity. Creating a test that is both valid and reliable is an extensive and robust process. A valid and reliable test will certify that the education and training have properly prepared the technician to take the test and the test accurately measures the competencies and standards set forth by the accreditation body. More importantly passing the test will show that a certified technician has the required knowledge and capacity to enter the metrology field. Ensuring the process is robust has several significant components and procedures that must be followed. Psychometricians are trained professionals that ensure the efficacy and integrity of certified tests are met and maintained. Psychometricians use quantitative data and analysis procedures to determine the reliability, validity, and fairness of an assessment measure. This paper will cover the 17024 requirements and how psychometricians evaluate tests for reliability and validity. Additionally, this paper will discuss the process to follow for creating test questions, assessing their quality, and developing rigorous assessment methods that align with accreditation standards and education content.