摘要
数据集高可用性是大数据环境下重要研究内容之一。目前,大数据服务平台数据集高可用性程度不高是影响系统运行效率的重要因素,主要原因是数据集事务调度效率低、事务一致性差、事务响应速度慢等。文章通过Zookeeper框架数据事务调度优化资源管理器响应机制,解决了负载均衡和事务响应超时等问题。通过微服务架构对事务资源进行管理,对数据结构进行优化,形成规范化接口,让中断机制能够发出正确的信息,满足不同环境下大数据平台资源调度要求,提高了大数据平台数字化、安全性、高可用性水平。
High availability of datasets is one of the important research topics in the big data environment.At present,the low availability of datasets on big data service platforms is an important factor affecting system operational efficiency,mainly due to low transaction scheduling efficiency,poor transaction consistency,and slow transaction response speed of datasets.The article optimizes the resource manager response mechanism through the Zookeeper framework for data transaction scheduling,solving issues such as load balancing and transaction response timeout.Through microservice architecture,transaction resources are managed,data structures are optimized,and standardized interfaces are formed to enable interrupt mechanisms to send correct information,meeting the resource scheduling requirements of big data platforms in different environments,and improving the digitalization,security,and high availability levels of big data platforms.
作者
卞显福
Bian Xianfu(School of Software Engineering,University of Science and Technology of China,Hefei 230051,China)
出处
《无线互联科技》
2024年第5期96-99,共4页
Wireless Internet Technology
