영어경시대회 측정도구의 과업별 적절성 검증 및 개선 방안

Abstract

This study analyzes the validity of the tasks in Test of Oral Proficiency (TOP) and Test of Writing Proficiency (TWP) as means of evaluating advanced-level high school students English proficiency in a nation-wide English contest. For this purpose, both quantitative and qualitative analyses were conducted. The results show that all the tasks are statistically valid except for Task I (Answering simple questions) for Group II (who have stayed overseas longer than one year). The examination of students' recorded responses for TOP reveals how differently Groups I and II responded to the tasks and what can be done to improve task questions. Based on the findings, we suggest that for TOP, the current format be maintained for Group I (who have stayed overseas shorter than one year). For Group II, however, a modified use of TOP or its replacement with interviews is recommended. For TWP, since Task I (Summary) and IV (Free writing) among the four tasks are very effective to measure students' writing proficiency, we recommend to use these two tasks alone instead of using all four of the tasks. We also suggest that a thorough training and detailed guidelines be provided for raters.