This study examines how native English speaking (NES) and Korean non-native English speaking (KNES) teachers assess L2 writing performance. More specifically, this study aims to investigate whether these two groups of raters evaluate writing samples differently when using different rating scales (holistic vs. analytic) and different task types (narrative vs. argumentative). Four NES and four KNES raters evaluated 78 narrative and 78 argumentative essays written by Korean EFL university students using both holistic and analytic rating rubrics. The comparison between the two rater groups indicated that the scores given by the two groups were statistically significantly different for both holistic and analytic ratings regardless of the two task types investigated. Overall, KNES teachers rated the essays more harshly than their NES counterparts, irrespective of task type and rating scale. Multiple regression analysis of five analytic sub-criteria revealed that the two rater groups demonstrated similar patterns in assessing argumentative essays, while for narrative essays, the relative influence of each analytic sub-criterion on overall writing quality differed for the two rater groups. Implications for L2 writing assessment are included.

1. INTRODUCTION
 2. LITERATURE REVIEW
  2.1. Rater Variability
  2.2. Rating Scale: Holistic vs. Analytic
  2.3. Task Type
 3. METHOD
  3.1. Writing Samples
  3.2. Raters
  3.3. Research Procedure
 4. RESULTS
  4.1. Interrater Reliability
  4.2. Task and Rater Effects on Holistic Scores
  4.3. Task and Rater Effects on Analytic Scores
  4.4. Holistic vs. Analytic Scores
 5. DISCUSSION AND CONCLUSION
 REFERENCES

• Soo-Kyung Park(Korea University)