低空视频影像自适应关键帧提取与快速拼接
Adaptive Key Frames Extraction and Fast Image Mosaic of Low Altitude Aerial Video
DOI: 10.12677/JISP.2018.74021, PDF,  被引量    科研立项经费支持
作者: 李含伦:中国电子科技集团公司第三研究所,北京;李丰凯:首都师范大学三维信息获取与应用教育部重点实验室,北京
关键词: 快速实时拼接关键帧提取正射校正精度评价Real-Time Mosaic Extract Key Frames Orthographical Correction Accuracy Eevaluation
摘要: 无人飞行器超低空飞行,获取图像幅宽小,数量多,重复率高,为获取全测区的图像需要图像拼接。目前航空影像拼接广泛使用基于特征匹配的图像配准方法。特征匹配的计算量大,错误率高,影响了图像拼接的速度。针对上述问题提出了一种自适应关键帧的图像拼接方法。该方法根据基准影像和给定的重叠度自适应提取关键帧影像,使用正解和反解相结合的方法完成对关键帧影像的正射校正。通过坐标解算得到每个关键帧影像中需要参与拼接的部分,然后使用横向流型拼接方法将每个关键帧中参与拼接的部分拼接形成测区全图。实验结果表明本文方法在保证较高的拼接精度下可以实现航拍影像的快速实时拼接,很大程度上提高了图像拼接的效率。本文方法可以实现航拍影像快速拼接,满足现场数据检验以及其它快速应急响应的需求,在灾害应急保障与救援中有重要应用意义。
Abstract: Images captured by unmanned aerial vehicle have small image width, large quantity, and high overlap rate. In order to get the image of whole measurement area, image mosaicking is necessary. Feature matching method is widely used in the field of aerial image mosaicing. Feature matching has many disadvantages such as heavy burden of calculation, high error rate, so affected the speed of image stitching greatly. To solve those problems, an adaptive key frame was proposed. Extracting method extracts key frame images according to overlap rate of images and gets the orthographical correction of key frame images by using the combination of direct method and inverse solution method. The part involved in image mosaicing of every key frame was obtained by using its coordinates. Then we get the mosaiced image of the whole area by using flow pattern stitching method. Experimental results show that the method proposed in this paper can realize real-time aerial image stitching with high precision and can improve the efficiency of image mosacing sig-nificantly. The method proposed in this paper can realize real-time aerial image stitching and meet requirements of rapid response, especially in disaster emergency response and rescue.
文章引用:李含伦, 李丰凯. 低空视频影像自适应关键帧提取与快速拼接[J]. 图像与信号处理, 2018, 7(4): 179-190. https://doi.org/10.12677/JISP.2018.74021

参考文献

[1] 崔红霞, 孙杰, 林宗坚. 无人机遥感设备的自动化控制系统[J]. 测绘科学, 2004, 29(1): 47-49.
[2] 张建. 无人机高清视频图像实时拼接算法研究[D]: [硕士学位论文]. 沈阳: 沈阳大学, 2014.
[3] 李长春, 齐修东, 雷添杰, 等. 基于改进SURF算法的无人机遥感影像快速拼接[J]. 地理与地理信息科学, 2013, 29(5): 22-25.
[4] 杨常清, 王孝通, 徐晓刚, 等. 基于特征空间的航空影像自动配准算法[J]. 测绘学报, 2005, 34(3): 218-222.
[5] 赵向阳, 杜利民. 一种全自动稳健的图像拼接融合算法[J]. 中国图象图形学报, 2004, 9(4): 417-422.
[6] 王勇, 何晓川, 刘清华, 等. 一种感兴趣区域寻优搜索的全自动图像拼接算法[J]. 电子与信息学报, 2009, 31(2): 261-264.
[7] Szeliski, R. (1996) Video Mosaics for Virtual Environments. IEEE Computer Graphics & Applications, 16, 22-30.
[Google Scholar] [CrossRef
[8] Kuglin, C.D. and Mines, D.C. (1975) The Phase Correlation Image Alignment Method. Proceedings of IEEE International Conference on Cybernetics and Society, New York, 9, 163-165.
[9] 刘金根, 吴志鹏, 刘上乾, 等.一种基于特征区域分割的图像拼接算法[J]. 西安电子科技大学学报: 自然科学版, 2002, 29(6): 768-771.
[10] 尚明姝, 解凯. 一种基于特征的全自动图像拼接算法[J]. 网络新媒体技术, 2006, 27(6): 747-750.
[11] 韩文超. 基于POS系统的无人机遥感图像拼接技术研究与实现[D]: [硕士学位论文]. 南京: 南京大学, 2011.
[12] 任超锋. 航空视频影像的正射影像制作关键技术研究[D]: [硕士学位论文]. 武汉: 武汉大学, 2014.
[13] Sun, J., Xie, J., Li, J., et al. (2012) A Key-Frame Selection Method for Semi-automatic 2D-to-3D Conversion. Communications in Computer & Information Science, 331, 465-470.
[Google Scholar] [CrossRef
[14] Fadaeieslam, M.J., Fathy, M. and Soryani, M. (2009) Key Frames Selection into Panoramic Mosaics. Proceedings of the 7th International Conference on Information, Communications and Signal Processing, Macau, 8-10 December 2009, 1-5.
[15] 李岩山, 裴继红, 谢维信, 等. 一种新的无人机航拍序列图像快速拼接方法[J]. 电子学报, 2012, 40(5): 935-940.
[16] 刘善磊, 赵银娣, 王光辉, 等. 一种关键帧的自动提取方法[J]. 测绘科学, 2012, 37(5): 112-114, 117.
[17] 彭晓东, 林宗坚. 无人飞艇低空航测系统[J]. 测绘科学, 2009, 34(4): 11-14.
[18] Hao, J., Yu, S.X. and Martin, D.R. (2011) Linear Scale and Rotation Invariant Matching. IEEE Transactions on Pattern Analysis & Machine Intelligence, 33, 1339-1355.
[Google Scholar] [CrossRef
[19] Wang, J., Peng, J., Wu, J., et al. (2013) Image Fusion with Double Sparse Representation in Wavelet Domain. 4th IEEE International Conference on Software Engineering and Service Science (ICSESS), Beijing, 23-25 May 2013, 1006-1009.
[20] 曹楠, 王萍. 基于SIFT特征匹配的图像无缝拼接算法[J]. 计算机与应用化学, 2011, 28(2): 242-244.
[21] Lowe, D.G. (1999) Object Recognition from Local Scale-Invariant Features. Proceedings of the Seventh IEEE Interna-tional Conference on Computer Vision, Kerkyra, 20-27 September 1999, 1150-1157 vol.2.
[22] Lowe, D.G. (2004) Distinctive Image Features from Scale-Invariant Keypoints. International Journal of Computer Vision, 60, 91-110.
[Google Scholar] [CrossRef
[23] Fischler, M.A. and Bolles, R.C. (1987) Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography. Readings in Computer Vision: Issues, Problems, Principles, and Paradigms. Morgan Kaufmann Publishers Inc., 726-740.