SNUCALTS(Seoul National University Computer-Administered Language Testing Service)의 타당성 검증

Abstract

In order to maximize efficiency of the process of test development and measurement, SNULRI (Seoul National University Language Research'Institute) has developed a computerized item bank system on the basis of the 3rd-year SNUCREPT (SNU Criterion-Referenced English Proficiency Test) validation research conducted in 1994. The present study is aimed at validating the total process of the computerized item bank system in operation, which is tentatively entitled SNUCALTS (SNU Computer Administered Language Testing Service). The present research conducted the construct validation by analyzing the data collected from the 408 SNU students who took a 100-item set test (made up of 50 listening test items and 50 written test items) which was produced in a manner of random sampling by the current system. The overall results show that the computerized algorithm successfully retrieves appropriate test items from the database considering such variables as content domain, task type, topic, and difficulty. The algorithm also functions properly in scoring within IRT framework and produces robust quantitative indices including test-takers' ability and item statistics. Meanwhile, more valid items will continue to be stored onto SNUCALTS until a 200-item test set is successfully retrived from the database. A largescale study on a 200-item test set will be conducted in the fourth quarter of 1996 for the purpose of validating the entire testing process required for valid test development and precise measurement and efficient administrative tasks, e.g. storing and retriving test-takers' data and reporting group and/or individual score data.