摘要
安全与隐私是《2021地平线报告》头等关注议题,针对人工智能技术的核心基础--机器学习算法存在的功能安全漏洞问题,文章首先从原理上介绍了机器学习算法面临的投毒攻击和对抗样本攻击功能风险;随后对服务于教师、学生与教育管理三方面对象和不同教学与管理环节的六类典型人工智能教育应用:智能教学平台、智能课堂教学行为分析、智能评测、智能搜题、智能学习助手、智能考务应用中,机器学习算法融合过程中的功能风险进行了深度剖析,结果表明,算法功能攻击动摇了所有上述应用正常运行的根基;最后,在当前并无良好的技术解决方案的现实下,研究初步探讨从运行与管理层面,对人工智能教育应用面临的算法功能攻击予以防御的建议。
Security and privacy are the top issues in the 2021 Horizon Report.Aiming at the problem of functional security holes existing in machine learning algorithms,the core foundation of artificial intelligence technology,this paper firstly introduces the risk of poisoning attack and anti-sample functional attack faced by machine learning algorithms in principle;Then six kinds of typical artificial intelligence education application are deeply analyzed,including intelligent teaching platform,intelligent behavior analysis,intelligent evaluation of classroom teaching,intelligent teaching assistant teaching and learning,intelligence,intelligent examination applications,functions of risk in the process of machine learning algorithms fusion depth profiling.The results show that the algorithm function attack shook the foundations of normal operation of all of the above applications.Finally,in the context that there is no good technical solution at present,the research puts forward some preliminary suggestions on how to defend against the algorithm function attack that the educational application of artificial intelligence is facing from the aspects of law,system,organization and management.
作者
刘梦君
蒋新宇
石斯瑾
江南
吴笛
LIU Meng-jun;JIANG Xin-yu;SHI Si-jin;YU Gang;JIANG Nan;WU Di(Hubei University,School of Education,Hubei,Wuhan 430062)
出处
《江南大学学报（人文社会科学版）》
2022年第5期89-101,共13页
Journal of Jiangnan University：Humanities & Social Sciences Edition
基金
国家自然科学基金“新高考综合素质评价数据安全管理机制研究:区块链技术赋能视角”(项目编号:72204077)
湖北省自然科学基金“基于区块链的新高考综合素质评价数据安全管理机制研究”(项目编号:2021CFB470)
教育部人文社会科学青年项目“基于认知诊断的网络学习能力评测与个性化推荐机制研究”(项目编号:19YJC880093)阶段性研究成果。
关键词
人工智能教育
机器学习
安全风险
算法缺陷
功能安全
artificial intelligence education
machine learning
security risk
algorithm defect
function safety
