ASSESSING HIGH-STAKES WRITING PERFORMANCES - AN AUSTRIAN-SLOVENIAN STUDY

The main aim of the study is to investigate the (quantitative and qualitative) extent to which negative features (errors) contribute to ratings (as opposed to, or in combination with, positive ones). This translated into one major (research) question which needed to be answered in order to achieve this aim: whether in rating writing performances one can observe the apparently opposing foci on positive and negative features as complementary – in essence that either focus (or a combination of both) would produce similar ratings (following the intuitive idea that if something is not negative then it is positive). An additional aim was to investigate to what extent the raters’ judgements are affected by their individual interpretation of given descriptors, which should be context-independent, but are often affected by socio-cultural backgrounds (e.g., experience, cultural/educational background).

project lead: Nikola Dobric

period: 2018-2019