期刊文献+

云计算系统中基于噪声模板跳表的日志过滤方法

Noisy template skip list based log filtering in cloud systems
下载PDF
导出
摘要 提出了一种基于时间序列相似度的日志特征提取方法,通过将噪声采样信息按照特定类型标识建模为时间序列,使用Haar小波变换提取序列特征,基于跳表构造噪声模板库。目标日志时间序列通过与噪声模板进行相似度比较来确定其是否为噪声日志。基于真实云计算平台的实验表明,提出的方法能够有效提高故障特征的有效性。 First model noisy event logs into time series,use Haar wavelet transform to get the approximation time series and construct the noisy template library with skip list.Then,the similarity between target log time series and noisy tem-plate to filter the noisy logs was compared.Experiment results on a real cloud service shows that successfully filter out the noisy log and increase the validity of fault feature.
出处 《通信学报》 EI CSCD 北大核心 2011年第7期103-113,共11页 Journal on Communications
基金 国家重点基础研究发展计划("973"计划)基金资助项目(2011CB302605)~~
关键词 事件日志 时间序列相似度 噪声过滤 跳表 云计算系统 event log time series similarity noisy log filtering skip list cloud computing system
  • 相关文献

参考文献19

  • 1CHEN M,ZHENG A X,LLOYD J,et al.Failure diagnosis usingdecision trees. Proceedings of the First International Conferenceon Autonomic Computing . 2004 被引量:1
  • 2Duraes J,Madeira H.Emulation of Software Faults:A Field Data Study and a Practical Approach. IEEE Transactions on Software Engineering . 2006 被引量:1
  • 3LIANG Y,ZHANG Y,SIVASUBRAMANIAM A,et al.BlueGene/Lfailure analysis and prediction models. Proceedings of the 2006International Conference on Dependable Systems and Networks . 2006 被引量:1
  • 4BARROS,HOLZLE U.The datacenter as a computer:an introductionto the design of warehouse-scale machines. Synthesis Lectures onComputer Architecture . 2009 被引量:1
  • 5TANG L,CUI B,LI H,et al.Effective variation management forpseudo periodical streams. Proceedings of the 2007 ACM SIG-MOD international conference on Management of data . 2007 被引量:1
  • 6OLINER A,STEARLEY J.What supercomputers say:A study of five system logs. Proceedings of the 37thAnnual IEEE/IFIP International Conference on Depend-able Systems and Networks . 2007 被引量:1
  • 7Yacoub,S. M,Amma,H. H.A methodology for architecture-level reliability risk analysis. IEEE Transactions on Software Engineering . 2002 被引量:1
  • 8LIANG Y L,SIVASUBRAMANIAM A,MOREIRA J.Filtering failure logs for a BlueGene/L prototype. Proceedings of the 2005 International Conference on De-pendable Systems and Networks . 2005 被引量:1
  • 9Ford D,Labelle F,Popovici F I,et al.Availability in globally distributed storage systems. Proceedings of the9th USENIX Symposium on Operating Systems Design and Implementation . 2010 被引量:1
  • 10程文聪,邹鹏,贾焰,杨尹.基于DTW距离的伪周期数据流异常检测[J].计算机研究与发展,2010,47(5):893-902. 被引量:4

二级参考文献10

  • 1肖辉,胡运发.基于分段时间弯曲距离的时间序列挖掘[J].计算机研究与发展,2005,42(1):72-78. 被引量:59
  • 2Tang L,Cui B,Li H,et al.Effective variation management for pseudo periodical streams[C] //Proc of the ACM SIGMOD Conf on Management of Data.New York:ACM,2007:257-268. 被引量:1
  • 3Joseph V,Pe M.Clinical information systems and the electronic medical record in the intensive care unit[J].Current Option in Critical Care,2002,8(6):616-624. 被引量:1
  • 4Ishiguro M,Suzuki H,Murase I,et al.Internet threat detection system using Bayesian estimation[C/OL] //Proc of the 16th Annual FIRST Conf on Computer Security Incident Handling.2004[2009-01-06].Http://www.mri.co.jp/PUBLICITY/PAPER/2004/20040620_si302.pdf. 被引量:1
  • 5Berndt D J,Clifford J.Using dynamic time warping to find patterns in time series[C] //Proc of the AAAI Workshop on Knowledge Discovery in Databases.Menlo Park,CA:AAAI,1994:359-370. 被引量:1
  • 6Athitsos V,Papapetrou P,Potamias M,et al.Approximate embedding-based subsequence matching of time series[C] //Proc of the ACM SIGMOD Int Conf on Management of Data.New York:ACM,2008:365-378. 被引量:1
  • 7Vlachos M,Yu P S,Castelli V.On periodicity detection and structural periodic similarity[C] //Proc of the SIAM Int Conf on Data Mining (SDM).Philadelphia,PA:SIAM,2005:449-460. 被引量:1
  • 8Vlachos M,Meek C,Vagena Z,et al.Identifying similarities,periodicities and bursts for online search queries[C] //Proc of the ACM SIGMOD Int Conf on Management of Data.New York:ACM,2004:131-142. 被引量:1
  • 9Moody G B,MIT-BIH Arrhythmia.Database Directory[OL].1997[2009-04-01].http://www.physionet.org/physiobank/database/html/mitdbdir/mitdbdir.htm. 被引量:1
  • 10邹柏贤,刘强.基于ARMA模型的网络流量预测[J].计算机研究与发展,2002,39(12):1645-1652. 被引量:107

共引文献3

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部