基于N-gram剪枝技术的隐患文本自动评估模型

An Automatic Assessment Model Based on N-gram Pruning Technique for Hidden Danger Text

摘要: 为了自动分析海上钻井平台隐患文本中蕴含的隐患响应程度信息，量化隐患严重程度，提出一种基于N-gram词袋向量的隐患响应等级量化评估模型。首先针对1565条钻井平台的现场隐患记录进行分词与过滤处理；其次再以N-gram作为特征单元重塑词袋维度；然后提出使用逆TF-IDF值来强化特征值；最后，使用朴素贝叶斯构建隐患量化模型。结果表明：使用该方法的隐患量化评估模型具有较高的精确率、召回率及F1值。

Abstract: To automatically analyze the response level information of hidden dangers contained in hidden danger texts and quantify the severity, a quantitative evaluation model based on N-gram word bag vectors is proposed for the response level of hidden dangers. Firstly, segment and filter the on-site hazard records of 1565 drilling platforms; Secondly, using N-gram as feature units to reshape the bag of words dimension; Then, it is proposed to use the inverse TF-IDF value to enhance the feature values; Finally, use naive Bayes to construct a hazard quantification model. The results show that the hazard quantification evaluation model using this method has high accuracy, recall, and F1 value.