All testing companies focus on ensuring that the test scores are valid, reliable, and fair. Significant resources are allocated to meet the guidelines of well-known organizations, such as AERA/NCME and/or The international Test Commission Guidelines (Allalouf, 2007; ITC, 2011).
This session’s workshop will discuss traditional QC methods, the operational testing process, and new QC tools for monitoring the stability of scores over time.
The session will provide participants a practical understanding of: (1) why quality control is important, (2) what the standard practice in testing industry is, (3) the importance of flow charts and documentation of procedures, (4) the use of software tools to monitor tasks, (5) how to minimize the number of hand-offs, (6) how to automate activities, (7) the importance of trend analysis to detect anomalies, (8) the importance of applying detective and preventive controls, and (9) the importance of having a contingency plan.
This session’s presenters will also show how to apply QC techniques from manufacturing to monitor scores. They will discuss traditional QC charts (Shewhart and CUSUM charts), time series models, and change point models to the means of scale scores to detect abrupt changes (Lee & von Davier, 2013). Lastly, they will discuss the QC methods for the process of automated & human scoring of essays (Wang & von Davier, 2014).