基于YOLOX的移动应用显示异常检测研究
Research on Display Anomaly Detection of Mobile Applications Based on YOLOX
DOI: 10.12677/SEA.2023.126095, PDF,    科研立项经费支持
作者: 李美静, 李 瑛*, 孔 婧, 刘益玮:北华航天工业学院计算机学院,河北 廊坊
关键词: 目标检测异常检测YOLOX移动测试Object Detection Anomaly Detection YOLOX Mobile Testing
摘要: 针对现有移动应用中显示异常检测算法检测精度不高、检测性能低下的问题,提出一种基于YOLOX的目标检测模型实现对四类常见显示异常的检测工作。针对小异常目标缺检、漏检问题,扩展特征融合网络的特征层输入尺度并进行特征融合,同时添加一个针对小目标的检测头,提升对小异常目标检测能力。通过引入坐标注意力机制,将位置信息和通道信息结合来增强网络对显示异常的识别。最后通过GIoU定位损失,实现高精度检测定位。实验结果表明,改进的YOLOX算法最终mAP达到81.10%,相比较YOLOX-s模型提高了2.25%,同时改进后检测模型与其他主流模型相比拥有良好的检测精度与模型泛化能力。该模型为移动应用显示异常智能化检测奠定了基础。
Abstract: Aiming at the problems of low detection accuracy and low detection performance of existing display anomaly detection algorithms in mobile applications, an object detection model based on YOLOX was proposed to detect four common types of display anomalies. Aiming at the problem of missing detection and missing detection of small abnormal targets, the input scale of the feature layer of the feature fusion network is extended and the feature fusion is performed. At the same time, a detection head for small targets is added to improve the detection ability of small abnormal targets. By introducing the coordinate attention mechanism, the location information and channel information are combined to enhance the recognition of display anomalies. Finally, the GIoU positioning loss was used to achieve high-precision detection and positioning. Experimental results show that the final mAP of the improved YOLOX algorithm reaches 81.10%, which is 2.25% higher than that of the YoloX-S model. At the same time, the improved detection model has good detection accuracy and model generalization ability compared with other mainstream models. This model lays the foundation for intelligent detection of mobile application display anomalies.
文章引用:李美静, 李瑛, 孔婧, 刘益玮. 基于YOLOX的移动应用显示异常检测研究[J]. 软件工程与应用, 2023, 12(6): 965-974. https://doi.org/10.12677/SEA.2023.126095

参考文献

[1] 郝琳. 面向GUI控件识别的深度学习图像匹配算法研究[D]: [硕士学位论文]. 廊坊: 北华航天工业学院, 2023.
[2] Liu, Z., Chen, C., Wang, J., et al. (2020) Owl Eyes: Spotting UI display Issues via Visual Understanding. Proceedings of the 35th IEEE/ACM International Conference on Automated Software Engineering, New York, 21-25 December 2020, 398-409. [Google Scholar] [CrossRef
[3] 王寅, 黄河基, 李佳芮. 基于YOLO的移动应用自动测试[J]. 现代信息科技, 2023, 7(18): 106-109.
[4] 郑炜, 唐辉, 陈翔, 等. 安卓移动应用兼容性测试综述[J]. 计算机研究与发展, 2022, 59(6): 1371-1384.
[5] 戴业伟. 基于深度学习的移动应用界面显示问题检测[D]: [硕士学位论文]. 成都: 四川大学, 2021.
[6] Liu, Z., Chen, C., Wang, J., et al. (2022) Nighthawk: Fully Automated Localizing UI Display Issues via Visual Understanding. IEEE Transactions on Software Engineering, 49, 403-418. [Google Scholar] [CrossRef
[7] 刘洋, 战荫伟. 基于深度学习的小目标检测算法综述[J]. 计算机工程与应用, 2021, 57(2): 37-48.
[8] Ge, Z., Liu, S., Wang, F., et al. (2021) YOLOX: Exceeding YOLO Series in 2021. arXiv, 1, 1-7.
[9] 鞠默然, 罗江宁, 王仲博, 等. 融合注意力机制的多尺度目标检测算法[J]. 光学学报, 2020, 40(13): 132-140.
[10] 廖延娜, 姚亮. 改进YOLOX的桥梁病害检测识别[J]. 应用光学, 2023, 44(4): 794-800.
[11] 谷长江, 高法钦. 改进YOLOX-S的金属零件缺陷检测算法研究[J]. 计算机时代, 2023(7): 29-33.
[12] 刘健. 基于YOLOX的输电线路异物检测算法研究及软件设计[D]: [硕士学位论文]. 徐州: 中国矿业大学, 2022.
[13] 薛峰, 武君胜, 张涛, 等. 面向移动应用自动化测试的同构用户界面视觉判断方法[J]. 西北工业大学学报, 2022, 40(4): 805-810.
[14] Li, Y.C., et al. (2017) DroidBot: A Lightweight UI-Guided Test Input Generator for Android. 2017 IEEE/ACM 39th International Conference on Software Engineering Companion (ICSE-C), Buenos Aires, 20-28 May 2017, 23-26. [Google Scholar] [CrossRef