摘要
本研究对多个测验Q矩阵的相对合理性的比较与选用开展研究,采用Monte Carlo模拟与实证研究相结合的范式,探讨R_square、HCI、-2LL、AIC、BIC、residual、ABS_residual及本研究新开发的BIC2等八项指标在测验Q矩阵合理性侦查效果及其比较。研究发现:八项指标中,除BIC和BIC2两项指标的对测验Q矩阵相对合理性的平均正确识别率在95%以上,其余指标的平均正确识别率不足90%,整体而言,考虑样本容量及参数个数双重加权的BIC和BIC2两项指标的表现总体上优于其它几项指标;各项指标在不同Q矩阵错误类型下其正确识别率也不尽相同。
The purpose of cognitive diagnosis （CD） is to detect the internal psychological rules and the human processing mechanism. Since a cognitive diagnosis assessment would report the features about individuals, such as his/her current cognitive status, the cognitive procedure, and the processing skills and knowledge structures etc., it would help teachers and students learn a lot about an individual, and choose a more effective way to teach or learn. In short, CD would play an important role on an individual＇s development. More and more attention should be paid to the cognitive diagnosis assessment. With more and more applications of CD in practice, researchers and practitioners found out that the task to identify a test Q matrix was very hard. Even if a test Q matrix was established, it would also be difficult to evaluate its correctness. Virtually, there might be several possible test Q matrices provided by the experts at the same time. Practitioners are always confused about which might be the right. Corresponding to this phenomenon, they need to find a method to determine which one is the most appropriate one. This study attempted to propose some indexes which might be used for the selection of a test Q matrix. In order to verify the effectiveness of the indexes, a comparison study was done. It aimed to find out the advantages and disadvantages of each index, and to get an idea of which indexes might be used to choose Q matrices. All these kinds of information could be very useful for the applicants. In this study, some test Q matrices with different degrees of correctness were provided, and the DINA model was applied. Both the Monte Carlo simulation method and the real data analysis were used; all the results were indicated as follows： Firstly, according to these eight indexes, the average correct identification rate （ACIR） of the BIC and BIC2 was greater than 95 percent. The ACIRs of the other indexes were less than 90 percent; some indexes were even less than 50 percent. Secondly, the ACIRs var
出处
《心理科学》
CSSCI
CSCD
北大核心
2015年第5期1239-1247,共9页
Journal of Psychological Science
基金
国家自然科学基金(31100756
31300876
31160203
31360237)
教育部人文社科项目(11YJC190002)
高等院校博士点基金项目(20103604120001
20123604120001)
江西省社会科学规划项目重点项目(13JY01)
江西省教育科学规划项目(12YB088
13YB029)
江西师范大学青年英才培育资助计划等课题的资助
关键词
认知诊断
测验Q矩阵
正确识别率
DINA模型
cognitive diagnosis
test Q matrix
correct identification rate
D1NA model
