This study examines how native English speaking (NES) and Korean non-native English speaking (KNES) teachers assess L2 writing performance. More specifically, this study aims to investigate whether these two groups of raters evaluate writing samples differently when using different rating scales (holistic vs. analytic) and different task types (narrative vs. argumentative). Four NES and four KNES raters evaluated 78 narrative and 78 argumentative essays written by Korean EFL university students using both holistic and analytic rating rubrics. The comparison between the two rater groups indicated that the scores given by the two groups were statistically significantly different for both holistic and analytic ratings regardless of the two task types investigated. Overall, KNES teachers rated the essays more harshly than their NES counterparts, irrespective of task type and rating scale. Multiple regression analysis of five analytic sub-criteria revealed that the two rater groups demonstrated similar patterns in assessing argumentative essays, while for narrative essays, the relative influence of each analytic sub-criterion on overall writing quality differed for the two rater groups. Implications for L2 writing assessment are included.
This study investigated whether two different writing tasks (narrative and argumentative), elicit different lexical features. This study also attempted to identify the relationship between lexical features and the level of writing proficiency. Seventyeight university students wrote one narrative and one argumentative essay, with a 30-minute time limit for each task. A total of 156 essays were rated by eight raters using holistic rubrics, and then were divided into three levels of writing proficiency. The written products were analyzed for nine lexical variables: mean word length,Type/Token Ratio, Root TTR (RTTR), Corrected TTR (CTTR), lexical density, the most frequent 1000-word families, the second most frequent 1000-word families,academic word list, and lexical frequency. The main findings are twofold. First,paired t-test analysis revealed significant differences between the two discourse modes in eight lexical variables. Second, the results of one-way ANOVA, Welch ANOVA, and Pearson’s correlation analysis indicated that RTTR and CTTR best discriminated between the different writing proficiency groups.