COMPARING STUDENT EVALUATION FORMATS IN TERMS OF HALO EFFECT, LENIENCY EFFECT AND USER REACTIONS

OK A. B., Sumer H. C., BİLGİÇ R.

HACETTEPE UNIVERSITESI EGITIM FAKULTESI DERGISI-HACETTEPE UNIVERSITY JOURNAL OF EDUCATION, sa.44, ss.237-248, 2013 (SSCI) identifier

  • Yayın Türü: Makale / Tam Makale
  • Basım Tarihi: 2013
  • Dergi Adı: HACETTEPE UNIVERSITESI EGITIM FAKULTESI DERGISI-HACETTEPE UNIVERSITY JOURNAL OF EDUCATION
  • Derginin Tarandığı İndeksler: Social Sciences Citation Index (SSCI), Scopus, TR DİZİN (ULAKBİM)
  • Sayfa Sayıları: ss.237-248
  • Anahtar Kelimeler: rating formats, student evaluations, user reactions, halo, leniency, ANCHORED RATING-SCALES, PERFORMANCE-APPRAISAL, FIELD EXPERIMENT, SATISFACTION, BEHAVIOR, ISSUES, BARS
  • Ankara Üniversitesi Adresli: Hayır

Özet

The purpose of this study was to compare two different rating scales to be used in student evaluation of instructors in terms of psychometric properties, mainly halo and leniency effects, and user reactions. A behaviourally anchored rating scale (BARS) and a graphic rating scale (GRS) were developed and administered to a total sample of 270 college students (N-BARS = 126; N-GRS = 144) rating their real-life instructors. Although neither format had a clear psychometric advantage over the other, the GRS format was found to be slightly better than the BARS format in terms of resistance to halo. Furthermore, the BARS format received less favourable user reactions than did the GRS format. Considering the differential resources required for the development of a behaviour-based rating scale, the present results indicated the GRS format as being preferable to the BARS format. The implications of the findings are discussed along with suggestions for future research.