期刊文献+

主观评分保守现象的形成机制与控制研究 被引量:6

The Mechanism of Conservativeness in Subjective Performance Rating
下载PDF
导出
摘要 研究对某次大型人事考试的主观评分结果进行分析。结果表明,各题上考生得分的离散程度偏小,评分者所评分数的分布比较集中且处于低分段,体现出评分者打分时相当保守,同时分数全距缩小也降低了主观性试题的效用。各题均值和标准差都随评分时间的增长而有所减小,体现了评分保守是一个"习得"的过程。为控制这种现象的发生,在不降低评分一致性的前提下,进一步提升评分的准确性,可通过优化误差监控的指标,插入标准卷,以及采用分步增值评分模式进行流程控制。 This study analyzed one large - scale personnel selection writing test. The results showed that the SD of scores on each item was small,which meant that the examinees' abilities could not be well - distinguished. The raters tended to give lower and concentrate scores due to their conservative strategy. Meanwhile, the shortened range of scores lowered the efficacy and effectiveness of those subjec- tive items. It is also found that the means and Sl)s decreased along with the rating progress ,which might imply that the conservative sco- ring was an acquisition process. In order to regulate this conservative scoring, to guarantee the consistency of scoring, and to improve the accuracy of scoring,the benchmark scoring paper can be inserted to monitor the rating processes and errors, or a multistage rating aug- mentation pattern can be used to control the process.
出处 《心理学探新》 CSSCI 2012年第5期429-438,共10页 Psychological Exploration
关键词 主观评分 评分保守 误差控制 subjective performance rating conservative scoring error control
  • 相关文献

参考文献11

  • 1丁文,裴赟.评分趋中性现象的初步分析[J].中国考试,2008(8):14-18. 被引量:2
  • 2丁琳..基于互联网的网上阅卷系统的设计和实现[D].华东师范大学,2003:
  • 3雷新勇,周群.基于局域网评分中阈值设置和评分一致性研究[J].考试研究,2006,2(4):64-75. 被引量:2
  • 4张昌应.高考网上评卷误差控制的方法与实施[J].高教探索,2003(3):77-79. 被引量:16
  • 5Gilfert, S.,& Harada, K. ( 1992). Two composition scoringmethods : The analytic vs. holistic method. Bulletin of Facultyof Foreign Languages ,1,17 -22. 被引量:1
  • 6Hidi,J. C. ,& Mclaren,L. ( 1990) . Topics and writing. Studies inEducational Evaluation,16,515- 518. 被引量:1
  • 7Lane,S. ,& Stone,C. A. (2006). Performance assessment. In R.L. Brennan ( Eds. ) , Educational measurement ( pp. 387 —431 ) . Washington, DC : American Council on Education. 被引量:1
  • 8Lumley,T. ( 2002 ) . Assessment criteria in a large - scale writingtest :what do they really mean to the raters. Language Tes-ting ,19 ,246 -276. 被引量:1
  • 9McNamara, T. F. , & Adams, R. J. (1991), Exploring rater be-havior with rasch techniques. Paper presented at the annualLanguage Testing Research Colloquium. March, Princeton. 被引量:1
  • 10McQueen,J.,& Congdon’P. J. ( 1997). Rater severity in large -scale assessment : Is it invariant. Paper presented at the annu-al meeting of the American Educational Research Associa-tion. March,Chicago. 被引量:1

二级参考文献3

共引文献17

同被引文献36

  • 1易昆南.残缺数据的论文名次及评委水平的评判与逆判[J].湘潭大学自然科学学报,2005,27(2):39-43. 被引量:12
  • 2尹向飞.基于混合正态分布的大学生考试成绩分布的拟合[J].统计与决策,2007,23(8):133-135. 被引量:16
  • 3Dean E. RCN members call for practical exam to test student compe- tence[J]. Nursing Standard, 2010,24(36) : 8. 被引量:1
  • 4Baird JJBE, Black P. Test theories, educational priorities and reliability of public examinations in England [J]. Academic Search Premier, 2013,28(1):17. 被引量:1
  • 5Brennan RL. Educational measurement [ M ].4th ed. Westport, CT: Praeger Publisher, 2006: 231. 被引量:1
  • 6Gilfert, S. , & Harada, K. ( 1992 ). Two composition swcoring methods:The analytic vs. holistic method. Bulletin of Faculty of Foreign Languages,1,17 -22. 被引量:1
  • 7Johnson, R. L. , Penny, J. , & Gordon, B. ( 2000 ). The relation between score resolution methods and interrater reliability:An empirical study of an analytic scoring rubric. Applied Measure- ment in Education,13,121 - 138. 被引量:1
  • 8Morgan, G. B. , Zhu, M. , Johnson, R. L. , & Hodge, K. J. (2014). Interrater reliability estimators commonly used in scoring language assessments:A monte carlo investigation of estimator accuracy. Language Assessment Quarterly ,11, 304 - 324. 被引量:1
  • 9Penny,J. A. , & Johnson, R. L. (2011). The accuracy of per- formance task scores after resolution of rater disagreement:A Monte Carlo study. Assessing Writing, 16,221 - 236. 被引量:1
  • 10Lane,S.,&Stone,C.A.Performance assessment[M]//R.L.Brennan.Educational measurement.Washington,DC:American Council on Education,2006:387-431. 被引量:1

引证文献6

二级引证文献9

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部