基于多头注意力机制与特征融合的航天软件静态警报自动确认方法研究

Research on Automatic Confirmation Method of Static Alerts for Aerospace Software Based on Multi-Head Attention Mechanism and Feature Fusion

摘要: 本课题针对航天软件静态测试中误报率高、人工审查工作量大的问题，提出了一种基于深度学习的静态警报自动确认方法。首先，利用预训练模型Codebert对代码进行向量化，解决了传统词嵌入方法无法准确处理代码结构和语义的问题。其次，设计了一种CNN-BiGRU模型，结合卷积神经网络(CNN)的局部特征提取能力和双向门控循环单元(BiGRU)的全局序列特征提取能力，提升了模型的特征提取效果。进一步，为应对长代码中token距离较远、重要信息难以识别的问题，在CNN-BiGRU模型基础上引入多头注意力机制，构建了CNN-BiGRU-Multi-Head Attention模型，使模型能够识别并调整重要token的权重，忽略远距离token的干扰。实验结果表明，所提出的模型在静态警报自动确认任务中表现优异，有效降低了误报率并减少了人工审查的工作量，为软件质量保障提供了高效的技术支持。

Abstract: This topic addresses the problems of high false alarm rate and heavy manual review workload in static testing of aerospace software, and proposes a deep-learning-based automatic confirmation method for static alerts. First, the pre-trained model Codebert is utilized to vectorize the code, which solves the problem that traditional word embedding methods cannot accurately deal with the structure and semantics of the code. Second, a CNN-BiGRU model is designed, which combines the local feature extraction capability of convolutional neural network (CNN) and the global sequential feature extraction capability of bi-directional gated recurrent unit (BiGRU) to improve the feature extraction effect of the model. Further, in order to cope with the problem of long distance of tokens and difficulty in recognizing important information in long codes, the CNN-BiGRU-Multi-Head Attention model is constructed by introducing the Multi-Head Attention mechanism on the basis of the CNN-BiGRU model, so that the model can recognize and adjust the weight of the important tokens, and ignore the interference of the long-distance tokens. The experimental results show that the proposed model performs well in the static alert auto-confirmation task, effectively reduces the false alarm rate and reduces the workload of manual review, and provides efficient technical support for software quality assurance.