Browse

Construct Validity in Human Scoring and Criterion: What Criterion would(not) measure

DC Field Value Language
dc.contributor.authorKoo Jungyeon-
dc.date.accessioned2020-09-24T05:30:34Z-
dc.date.available2020-09-24T05:30:34Z-
dc.date.issued2020-09-01-
dc.identifier.citation영학논집, Vol.40, pp. 133-166ko_KR
dc.identifier.urihttps://hdl.handle.net/10371/168960-
dc.description.abstractThis is a pilot study which aims to examine the reliability of automated essay scoring (AES) and to investigate validity of construct that Criterion would/would not measure. Criterion assessed iBT TOEFL independent writing tasks by comparing human raters evaluation. In particular, the current study explored which essay features were most closely related to each of the six different analytic dimensions for e-rater (Criterion). Five types of prompts were employed to assign a writing test to fifty college students in Seoul. The result showed that the agreement between human-rater and Criterion is moderate. In addition, three essay features
(development, organization, and grammar) were crucial factors to predict the holistic score in human rating. Grammar, however, was a powerful predictor to tell the whole score in AES, which reflects that development and organization were not evaluated appropriately in Criterion. This result suggests that the feature dimensions in e-rater need to be refined/revised in the development and organization construct dimensions. The findings have some implications in teaching students process writing
and using AES.
ko_KR
dc.language.isoenko_KR
dc.publisher서울대학교 인문대학 영어영문학과ko_KR
dc.subjectAES-
dc.subjecthuman-scoring-
dc.subjectconstruct dimension-
dc.subjectvalidity-
dc.subjectindependent writing-
dc.titleConstruct Validity in Human Scoring and Criterion: What Criterion would(not) measureko_KR
dc.typeSNU Journalko_KR
dc.contributor.AlternativeAuthor구정연-
dc.citation.journaltitle영학논집(English Studies)ko_KR
dc.citation.volume40ko_KR
Appears in Collections:
College of Humanities (인문대학)English Language and Literature (영어영문학과)영학논집(English Studies)영학논집(English Studies) No.40 (2020)
Files in This Item:
  • mendeley

Items in S-Space are protected by copyright, with all rights reserved, unless otherwise indicated.

Browse