海洋环境下具有原型的集成实例分割网络

Integrated Instance Segmentation Network with Prototypes in Marine Environment

摘要: 随着人类对海洋世界的探索活动日益增多，自动检测与识别海洋物体愈发重要。相对于仅仅获得目标大小与位置信息，海洋生物的实例分割更具价值，因为其可以进一步提供目标的形状信息。基于上述背景，本文提出了一种新的方法，通过整合原型模块到实例分割模型中，以获得更好的性能。原型模块由原型训练与原型区域两部分组成来保证原型的类代表性与边界稳定性。其中，我们通过随机挑选部分异类相似样本来训练原型区域模块，来更好地模拟类原型边界。最终，我们将原型模块融合到传统实例分割模型中，以实现更准确的海洋生物分割。实验结果表明，我们提出的原型整合方法在海洋数据集上取得了显著的精度提升，并能更好地区分异类相似样本，从而有效改善了实例分割模型的性能。

Abstract: The importance of automatically detecting and identifying marine objects has increased in tandem with the rise in human exploration activities in the maritime environment. Compared to obtaining only target size and position information, instance segmentation of marine organisms is more valuable as it can further provide shape information about the targets. This paper proposes a new method by integrating a prototype module into the instance segmentation model to achieve better performance. The prototype module consists of prototype training and prototype region to ensure the class representativeness and boundary stability of the prototypes. Specifically, we train the prototype region module by randomly selecting some dissimilar samples to better simulate the boundary of class prototypes. Ultimately, we integrate the prototype module into the traditional instance segmentation model to achieve more accurate segmentation of marine organisms. Experimental results demonstrate that our proposed prototype integration method achieves significant accuracy improvement on the marine dataset and better distinguishes dissimilar samples, effectively improving the performance of the instance segmentation model.