摘要
自21世纪技能评估与教学项目(ATC21S)和国际学生评估项目(PISA)采用计算机仿真任务对协作式问题解决能力进行测评以来,在证据中心设计的指导下,协作式问题解决能力的测评方法取得了长足的发展,也出现了许多新的问题。就发展来说,要素观与整合观两种取向的测评框架开始融合,被试的解题过程和感官体验日趋真实,且出现了描述多维结构与多模态数据的复杂模型。就问题来说,实证研究对测评框架的结构效度意见相悖,且缺乏不同框架之间的比较研究;评分过程重计量而轻定性,以行为频次计分妨碍了模型的解释力;任务创设与测评框架脱节,仅能作为诱发协作行为的平台,却未能在框架水平上分析任务设计与被试表现的关系。面向未来,协作式问题解决能力测评应加深能力、任务与证据模型的结合,降低测评工具的开发成本,通过诊断和预测助力学生能力的培养。
Since ATC21S and PISA2015 proposed the computer-based simulation tasks for assessing Collaborative Problem-Solving(CPS) skills under the framework of evidence center design,the testing industry has witnessed successful development and implementation of the assessment of CPS skills.Recently,researchers attempt to propose a novel CPS framework by merging two theoretical frameworks of the element view and the integration view,design more realistic assessment tasks based on the process of problem solving and sensory experience,and build complex models to describe the multi-dimensional structure and multi-modal data of the CPS assessment.Despite its progress,the following issues challenge its reliability and validity:(1) Empirical studies have conflicting opinions on the structural validity of assessment frameworks,and there is a lack of comparative studies among different frameworks.(2) The scoring algorithm emphasizes quantitative rather than qualitative methods,and the frequency-based behavior scoring hinders the explanatory power of the statistic model.(3) The assessment task can only be used as a platform to induce collaborative behavior,but it fails to build the relationship between task design and subjects' performance at the framework level.In the future,the CPS skills assessment should deepen the combination of competence,task,and evidence model,reduce the development cost of assessment tools,and aim to cultivate students' competence through diagnosis and prediction.
作者
郭少阳
杨向东
GUO Shaoyang;YANG Xiangdong(Shanghai Institute of AI Education,East China Normal University,Shanghai,200062,China;Department of Educational Psychology,East China Normal University,Shanghai,200062,China)
出处
《全球教育展望》
北大核心
2023年第6期49-61,共13页
Global Education
基金
全国教育科学“十三五”规划2020年度国家一般项目“素养导向的嵌入式测评系统研究”(项目编号:BHA200132)
华东师范大学人文社会科学学科交叉融合项目“中文写作智能化评估与辅导系统”(项目编号:2021JQRH013)的研究成果。
关键词
协作式问题解决能力
素养测评
证据中心设计
真实性评价
collaborative problem-solving skills
competency assessment
evidence-centered design
authentic assessment
