基于通道特征增强的火灾视频识别

Fire Video Recognition Based on Channel Feature Enhancement

摘要: 火灾对全球人民的生命财产安全造成了巨大的威胁。在火灾检测领域中，使用计算机视觉技术检测火灾对保障人民的生命和财产安全具有重要意义。针对经典的火灾识别方法无法高效地利用火焰运动特征的问题，提出基于通道特征增强的Video Swin Transformer (Video Swin Transformer based on Channel Feature Enhancement, VST-CFE)网络。VST-CFE主要包含Video Swin Transformer (VST)块和通道特征增强(Channel Feature Enhancement, CFE)块。为了利用在三维窗口划分时VST块丢失的火焰运动信息，设计了CFE块。通过建立通道信息的语义模型，CFE块增强了描述火焰运动的能力，从而提升了VST-CFE网络识别火焰的准确率。在LVFD数据集上开展大量的实验，实验结果表明VST-CFE优于基准方法VST。在该数据集上，VST-CFE的F1分数是88.16%，比基准方法VST的F1分数提高了1.75%。

Abstract: Fires pose a huge threat to the safety of people’s lives and property around the world. In the field of fire detection, the usage of computer vision technology to detect fires is of great significance for ensuring the safety of people’s lives and property. Aiming at the problem that classic fire recognition methods cannot efficiently utilize the motion feature of flames, a Video Swin Transformer based on Channel Feature Enhancement (VST-CFE) network is proposed. VST-CFE mainly includes the Video Swin Transformer (VST) block and the Channel Feature Enhancement (CFE) block. To utilize the motion information of flames lost in the VST block during 3D window partitioning, the CFE block is designed. By establishing the semantic model of channel information, the CFE block enhances the ability to describe flame motion, thereby improving the accuracy of the VST-CFE network in recognizing flames. Extensive experiments are conducted on the LVFD dataset, and the experimental results demonstrate that the VST-CFE method outperforms the baseline method VST. On this dataset, the F1 score of VST-CFE is 88.16%, which is 1.75% higher than the F1 score of the baseline method.