A log is a text message that is generated in various services,frameworks,and programs.The majority of log data mining tasks rely on log parsing as the first step,which transforms raw logs into formatted log templates....A log is a text message that is generated in various services,frameworks,and programs.The majority of log data mining tasks rely on log parsing as the first step,which transforms raw logs into formatted log templates.Existing log parsing approaches often fail to effectively handle the trade-off between parsing quality and performance.In view of this,in this paper,we present Multi-Layer Parser(ML-Parser),an online log parser that runs in a streaming manner.Specifically,we present a multi-layer structure in log parsing to strike a balance between efficiency and effectiveness.Coarse-grained tokenization and a fast similarity measure are applied for efficiency while fine-grained tokenization and an accurate similarity measure are used for effectiveness.In experiments,we compare ML-Parser with two existing online log parsing approaches,Drain and Spell,on ten real-world datasets,five labeled and five unlabeled.On the five labeled datasets,we use the proportion of correctly parsed logs to measure the accuracy,and ML-Parser achieves the highest accuracy on four datasets.On the whole ten datasets,we use Loss metric to measure the parsing quality.ML-Parse achieves the highest quality on seven out of the ten datasets while maintaining relatively high efficiency.展开更多
数字技术为全球服务带来了可能性,可以在社区和博物馆之间建立联系,鼓励人们参与数字遗产的创建,提升博物馆的观众量(Cassidy et al.,2017)。通过博物馆和社区:欧洲、拉丁美洲和加勒比的概念、经验和可持续性(EU-LAC博物馆,一个由8个机...数字技术为全球服务带来了可能性,可以在社区和博物馆之间建立联系,鼓励人们参与数字遗产的创建,提升博物馆的观众量(Cassidy et al.,2017)。通过博物馆和社区:欧洲、拉丁美洲和加勒比的概念、经验和可持续性(EU-LAC博物馆,一个由8个机构组成的联盟,通过社区博物馆学研究欧洲、拉丁美洲和加勒比之间的社会、技术和文化关系)在欧盟地平线2020计划资助下举办了一系列的社区研讨会,横跨三大洲的20多家博物馆评估了社区和社区博物馆的产出、经验和学术成果。300多名参与者对3D文物进行了数字化,打造了虚拟天体之旅,为了配合数字资源,他们还起草了维基百科上的内容。虚拟博物馆基础设施可作为数字资源库,以地理学的方式来展示藏品以及参与社区和博物馆之间的不同联系。展开更多
基金the National Natural Science Foundation of China under Grant No.61672163.
文摘A log is a text message that is generated in various services,frameworks,and programs.The majority of log data mining tasks rely on log parsing as the first step,which transforms raw logs into formatted log templates.Existing log parsing approaches often fail to effectively handle the trade-off between parsing quality and performance.In view of this,in this paper,we present Multi-Layer Parser(ML-Parser),an online log parser that runs in a streaming manner.Specifically,we present a multi-layer structure in log parsing to strike a balance between efficiency and effectiveness.Coarse-grained tokenization and a fast similarity measure are applied for efficiency while fine-grained tokenization and an accurate similarity measure are used for effectiveness.In experiments,we compare ML-Parser with two existing online log parsing approaches,Drain and Spell,on ten real-world datasets,five labeled and five unlabeled.On the five labeled datasets,we use the proportion of correctly parsed logs to measure the accuracy,and ML-Parser achieves the highest accuracy on four datasets.On the whole ten datasets,we use Loss metric to measure the parsing quality.ML-Parse achieves the highest quality on seven out of the ten datasets while maintaining relatively high efficiency.
文摘数字技术为全球服务带来了可能性,可以在社区和博物馆之间建立联系,鼓励人们参与数字遗产的创建,提升博物馆的观众量(Cassidy et al.,2017)。通过博物馆和社区:欧洲、拉丁美洲和加勒比的概念、经验和可持续性(EU-LAC博物馆,一个由8个机构组成的联盟,通过社区博物馆学研究欧洲、拉丁美洲和加勒比之间的社会、技术和文化关系)在欧盟地平线2020计划资助下举办了一系列的社区研讨会,横跨三大洲的20多家博物馆评估了社区和社区博物馆的产出、经验和学术成果。300多名参与者对3D文物进行了数字化,打造了虚拟天体之旅,为了配合数字资源,他们还起草了维基百科上的内容。虚拟博物馆基础设施可作为数字资源库,以地理学的方式来展示藏品以及参与社区和博物馆之间的不同联系。
