S-Space Language Education Institute (언어교육원) Language Research (어학연구) Language Research (어학연구) Volume 48 Number 1/3 (2012)
A Comparative Study on Criteria and Tasks in Korean English Speaking Assessment by Native and Non-native Raters
- Kang, Seokhan; Ahn, Hyunkee
- Issue Date
- 서울대학교 언어교육원
- 어학연구, Vol.48 No.2, pp. 241-262
- English speaking assessment; non-native speaking; non-native raters; fluency; tasks; criteria; consistency; strictness; FACET
- Evaluating Korean English speaking proficiency could be a major problem for Korean English educators mainly due to its subjectivity in assessment. More focus on eligible assessment has also raised a natural concern about valid and/or reliable evaluation on Korean English learners' speaking performance by Korean raters. In this respect, it is meaningful to search for an objective way in evaluating non-native speaking performance by the non-native raters. With this particular aim, this paper is trying to analyze the current Korean raters' rating patterns and suggest a better way of objective assessment. The results of the experiments show that most of experienced raters maintained acceptable level of internal consistency, regardless of their L1 background. The non-native raters also show similar severity patterns across various tasks and criteria, along with native English raters. However, Korean raters exhibit some particular characteristics different from native English counterparts. The educational suggestion is based on the results of rating experiments, comparing native English raters with Korean raters, which would be specified in detail from the main section in this paper.