Computerized Adaptive Testing Design for Students with Visual Impairment

Abstract

Computerized Adaptive Testing (CAT), a product of scientific advancements and new technologies in the field of measurement and evaluation in education, may be considered beneficial in reaching more valid and reliable test results for students with visual impairment. CAT renders more reliable test results in less time with fewer items that are well-matched to the ability levels of students. When these basic properties of CAT are considered, we can state that the use of CAT in assessing the ability levels of students with visual impairment may provide a significant step in attaining fair and comparative test results. The aim of this research is to develop audio-based CAT software for visually impaired students and to guide future studies by providing assessment, development, and design procedures. We created an item pool comprised of 166 audible items to assess the listening comprehension levels of students with visual impairment at secondary school. We have reported all data that indicate the validity and reliability scores through test development process, such as the acquisition analyses, expert opinions, pre-trial application (n=196), trial application (n=608), assumptions for the Item Response Theory. We have depicted of all the steps of software development on the basis of multimedia design principles in detail. Parameter estimates and software development studies were made according to 3 parameter logistic model. During item development and software testing, opinions of 7 students with visual impairment were considered. As a result, a valid and reliable CAT, named SesliTest, has been developed for students with visual impairment at secondary school. The research carries great importance since it proves CAT is applicable for students with visual impairment.