基于改进Swin Transformer的深度哈希检索模型

Deep Hash Retrieval Model Based on Improved Swin Transformer

摘要: 随着互联网和多媒体技术的飞速发展，数字图像已经成为现代社会中信息传播和交流的主要载体之一。人们每天都在生成和消费海量的图像数据，从社交媒体的图片分享到专业领域的图像分析，图像信息的规模和复杂性都在不断增长。与此同时，针对这些数据的检索需求也在快速增加，尤其是在需要快速定位和提取特定内容的场景中。然而，现实世界中的图像数据往往呈现出一种长尾分布的特性，即某些类别的数据非常丰富，而另一些类别的数据却极其稀缺。这种不平衡的数据分布为图像检索技术带来了巨大的挑战，尤其是在基于深度哈希技术的检索方法中，如何有效处理长尾分布成为研究的关键问题。针对这个问题，本文从模型层面构建了基于改进Swin Transformer哈希检索模型，以校验本文所设计长尾哈希检索模型在现实场景下的性能表现。详细内容如下：在面对长尾分布图像检索任务中对图像的局部的特征提取能力不足时，提出一种创新的解决方案。该方法核心在于利用双流网络架构将CNN的局部特征与Transformer的全局特征进行融合。同时，基于哈希层的输出数据设计了多目标损失函数。通过以上策略能够实现卷积的局部细节特征与自注意力的全局上下文特征的融合。实验结果表明，本模型能够实现高性能的哈希图像检索且优于当前主流模型，对各类数据集均取得最好或者次好的性能指标。

Abstract: With the rapid development of the Internet and multimedia technology, digital images have become one of the primary carriers for information dissemination and communication in modern society. People generate and consume vast amounts of image data every day—from picture sharing on social media to image analysis in professional fields, the scale and complexity of image information are continuously growing. At the same time, the demand for retrieving this data is also increasing rapidly, especially in scenarios where specific content needs to be quickly located and extracted. However, image data in the real world often exhibits a long-tail distribution characteristic—certain categories of data are highly abundant, while others are extremely scarce. This unbalanced data distribution poses significant challenges to image retrieval technologies, especially for retrieval methods based on deep hashing. Effectively addressing long-tail distribution has become a key research issue. To tackle this problem, this paper constructs a hash retrieval model based on an improved Swin Transformer at the model level, to evaluate the performance of the proposed long-tail hash retrieval model in real-world scenarios. Details are as follows: when the local feature extraction capability of images is insufficient in long-tail image retrieval tasks, an innovative solution is proposed. The core of this method lies in employing a two-stream network architecture that fuses the local features of CNNs with the global features of Transformers. Meanwhile, a multi-objective loss function is designed based on the output of the hash layer. This strategy enables the fusion of convolutional local detail features with the global contextual features from self-attention mechanisms. Experimental results demonstrate that this model can achieve high-performance hash-based image retrieval and outperforms current mainstream models, achieving the best or second-best performance indicators across various datasets.