Journal Article

Closed formula of test length required for adaptive testing with medium probability of solution

Széll, Krisztián, Takács, Szabolcs, T. Kárász, Judit

2023

Overview

Purpose Based on the general formula, which depends on the length and difficulty of the test, the number of respondents and the number of ability levels, this study aims to provide a closed formula for the adaptive tests with medium difficulty (probability of solution is p = 1/2) to determine the accuracy of the parameters for each item and in the case of calibrated items, determine the required test length given number of respondents. Design/methodology/approach Empirical results have been obtained on computerized or multistage adaptive implementation. Simulation studies and classroom/experimental results show that adaptive tests can measure test subjects’ ability to the same quality over half the test length compared to linear versions. Due to the complexity of the problem, the authors discuss a closed mathematical formula: the relationship between the length of the tests, the difficulty of solving the items, the number of respondents and the levels of ability. Findings The authors present a closed formula that provides a lower bound for the minimum test length in the case of adaptive tests. The authors also present example calculations using the formula, based on the assessment framework of some student assessments to show the similarity between the theoretical calculations and the empirical results. Originality/value With this formula, we can form a connection between theoretical and simulation results.

• Publisher: Emerald Publishing Limited,Emerald Group Publishing Limited
• Subject: Academic Achievement / Accuracy / Adaptive Testing / Comparative Analysis / Computer Assisted Testing / Computers / Correlation / Diagnostic Tests / Difficulty Level / Guidelines / Item Analysis / Item Response Theory / Knowledge Level / Literature Reviews / Mathematical Formulas / Measurement Techniques / Prerequisites / Probability / Questionnaires / Rasch model / Resistance (Psychology) / Sample Size / Simulation / Student Evaluation / Test Format / Test Items / Test Length / Test Reliability / Test Results