This paper studies the technics of reducing item exposure by utilizing automatic item generation methods. Known test item calibration method uses item parameter estimation with the statistical data, collected during e...This paper studies the technics of reducing item exposure by utilizing automatic item generation methods. Known test item calibration method uses item parameter estimation with the statistical data, collected during examinees prior testing. Disadvantage of the mentioned item calibration method is the item exposure; when test items become familiar to the examinees. To reduce the item exposure, automatic item generation method is used, where item models are being constructed based on already calibrated test items without losing already estimated item parameters. A technic of item model extraction method from the already calibrated and therefore exposed test items described, which can be used by the test item development specialists to integrate automatic item generation principles with the existing testing applications.展开更多
若研究或使用CAT时将项目参数的估计值认为是真实值,则会产生所谓的机会红利(capitalization on chance),国内尚未报道该方面的研究.在定长和不定长CAT测验中考察引入曝光因子的多种分层化选题策略和随机选题策略,综合比较它们在测验精...若研究或使用CAT时将项目参数的估计值认为是真实值,则会产生所谓的机会红利(capitalization on chance),国内尚未报道该方面的研究.在定长和不定长CAT测验中考察引入曝光因子的多种分层化选题策略和随机选题策略,综合比较它们在测验精度、题库利用率和机会红利等评价指标中的表现,发现引入曝光因子的2种动态分层方法有更好的表现.展开更多
文摘This paper studies the technics of reducing item exposure by utilizing automatic item generation methods. Known test item calibration method uses item parameter estimation with the statistical data, collected during examinees prior testing. Disadvantage of the mentioned item calibration method is the item exposure; when test items become familiar to the examinees. To reduce the item exposure, automatic item generation method is used, where item models are being constructed based on already calibrated test items without losing already estimated item parameters. A technic of item model extraction method from the already calibrated and therefore exposed test items described, which can be used by the test item development specialists to integrate automatic item generation principles with the existing testing applications.
文摘若研究或使用CAT时将项目参数的估计值认为是真实值,则会产生所谓的机会红利(capitalization on chance),国内尚未报道该方面的研究.在定长和不定长CAT测验中考察引入曝光因子的多种分层化选题策略和随机选题策略,综合比较它们在测验精度、题库利用率和机会红利等评价指标中的表现,发现引入曝光因子的2种动态分层方法有更好的表现.
