摘要
本文基于Toulmin的实用推理模式和Bachman&Palmer的语言测试使用论证(AUA)框架,提出量规使用论证(RUA)的概念,尝试构建基于论证的语言测试评分量规设计和使用效度验证模式。该模式遵循从评分后果、评分反馈、能力解释到评分要素(评分量规)各环节的推理逻辑,每一环节都以特定的主张描述作为支撑,而各主张均对应一系列理由,论证这些理由须有详实的证据加以解释。论证所需证据来源主要有文献分析、理论阐释、标准分析、考生作答分析、考试成绩解释、评分过程描述、评分结果使用等。本文构建基于论证的评分量规效验模式,以期为评分标准、评分量表等评分工具的设计及使用论证研究提供方法借鉴。
This paper draws on Toulmin’s approach to Practical Reasoning and Bachman & Palmer’s framework of Assessment Use Argument(AUA)as a basis for articulating an Rubric Use Argument(RUA)model,which provides the rationale that is in need to justify and validate scoring rubric development and use. RUA model illustrates the inferential links between scoring consequences, scoring feedback, the interpretations about the test taker’s language ability, and indicators and its descriptors in scoring rubric. Each inferential link asserts a specific claim that requires explicit warrants to provide specific justification for the qualities of scoring consequences, scoring feedback, scoring interpretations and indicators of rubric. Evidence or baking are needed to be collected as part of the justification and validation process, which generally comes from a variety of sources, including prior research and documents, assessment theory, scoring criteria,the test taker’s responses, test score, scoring process, test use, and etc. The discussion and findings in this paper can inform decisions about how best to account for and validate the development and use of scoring criteria and rating scale in the future study.
出处
《外语教学》
CSSCI
北大核心
2022年第3期81-86,共6页
Foreign Language Education
基金
2018年度教育部人文社会科学研究青年基金项目“新课标下高考英语口试诊断反馈式机助评分量规的研制及效度论证研究”(项目编号:18YJC740061)
2021年度陕西省社会科学基金项目“基于眼动行为的英语作文评分决策加工过程研究”(项目编号:2020K007)的阶段性研究成果
西安外国语大学“青年优秀人才支持”学者计划、西安外国语大学“语言测评科研创新团队”和“外国语言学及应用语言学二级学科团队”建设项目的资助。
