基于H.266/VVC的帧内预测方法综述
A Review of Intra Prediction Methods Based on H.266/VVC
DOI: 10.12677/csa.2024.1412249, PDF,    科研立项经费支持
作者: 胡 涛, 李 桐：北京印刷学院信息工程学院，北京
关键词: 通用视频编码(VVC)；帧内预测；CU快速划分；帧内模式选择；VVC； Intra Prediction； Fast CU Partition Prediction； Intra Mode Selection
摘要: VVC编码框架的帧内预测一直以来都是视频编码优化的主要内容，尽可能提升帧内预测效率有助于提高VVC标准的适用能力。本文旨在对帧内预测在VVC编码框架的效率优化方法进行系统综述，详细分析了VVC编码框架的结构和原理，阐述了VVC编码框架的发展历程，并深入分析了当前VVC帧内预测的研究现状。本文主要从CU快速划分算法研究、帧内预测模式优化算法研究、帧内预测算法最新进展研究三个角度对帧内预测算法进行研究和性能比较，并且从目前算法的局限和当前技术条件出发，提供未来的研究方向，为帧内预测相关研究提供参考。
Abstract: The intra prediction in the VVC coding framework has always been a primary focus for optimizing video encoding, and enhancing the efficiency of intra prediction is crucial for improving the applicability of the VVC standard. This paper aims to provide a systematic review of the efficiency optimization of intra prediction within the VVC coding framework, detailing the structure and principles of the VVC coding framework, elucidating its development history, and thoroughly analyzing the current state of research on VVC intra prediction. This paper mainly compares the performance of intra-frame prediction algorithms from three perspectives: the research of CU rapid partition algorithm, the research of intra-frame prediction mode optimization algorithm, and the research of the latest progress of intra-frame prediction algorithm, and provides future research directions from the limitations of the current algorithm and the current technical conditions, so as to provide reference for the research related to intra-frame prediction.
文章引用：胡涛, 李桐. 基于H.266/VVC的帧内预测方法综述[J]. 计算机科学与应用, 2024, 14(12): 153-163. https://doi.org/10.12677/csa.2024.1412249

参考文献

[1] Cisco (2019) Cisco Visual Networking Index: Forecast and Trends, 2017-2022.
https://www.cisco.com/c/en/us/solutions/collateral/service-provider/visual-networking-index-vni/white-paper-c11-741490.html
[2] Bordes, P., Clare, G., Henry, F., Raulet, M., Viéron, J. and Labs, O. (2012) An Overview of the Emerging HEVC Standard. International Symposium on Signal, Image, Video and Communications (ISIVC 2012), Valenciennes.
https://www.researchgate.net/publication/274891219_An_overview_of_the_emerging_HEVC_standard
[3] Wien, M. and Bross, B. (2020) Versatile Video Coding—Algorithms and Specification. 2020 IEEE International Conference on Visual Communications and Image Processing (VCIP), Macau, 1-4 December 2020, 1-3. [Google Scholar] [CrossRef] 
[4] Pakdaman, F., Adelimanesh, M.A., Gabbouj, M. and Hashemi, M.R. (2020) Complexity Analysis of Next-Generation VVC Encoding and Decoding. 2020 IEEE International Conference on Image Processing (ICIP), Abu Dhabi, 25-28 October 2020, 3134-3138. [Google Scholar] [CrossRef] 
[5] Li, J., Zhang, S. and Yang, F. (2022) Random Forest Accelerated CU Partition for Inter Prediction in H.266/VVC. 2022 IEEE International Conference on Multimedia and Expo (ICME), Taipei City, 18-22 July 2022, 1-6. [Google Scholar] [CrossRef] 
[6] Lo, Y., Chen, J. and Lo, J. (2024) Speed up H.266/VVC Inter-Coding by Background Analysis and Learning Models. 2024 International Conference on Consumer Electronics-Taiwan Region (ICCE-Taiwan Region), Taichung, 9-11 July 2024, 21-22. [Google Scholar] [CrossRef] 
[7] Zhang, Q., Zhao, Y., Jiang, B., Huang, L. and Wei, T. (2020) Fast CU Partition Decision Method Based on Texture Characteristics for H.266/VVC. IEEE Access, 8, 203516-203524. [Google Scholar] [CrossRef] 
[8] Lin, T.-L., Jiang, H.-Y., Huang, J.-Y. and Chang, P.-C. (2018) Fast Binary Tree Partition Decision in H.266/FVC Intra Coding. 2018 IEEE International Conference on Consumer Electronics-Taiwan Region (ICCE-TW), Taichung, 19-21 May 2018, 1-2. [Google Scholar] [CrossRef] 
[9] Cui, J., Zhang, T., Gu, C., Zhang, X. and Ma, S. (2020) Gradient-Based Early Termination of CU Partition in VVC Intra Coding. 2020 Data Compression Conference (DCC), Snowbird, 24-27 March 2020, 103-112. [Google Scholar] [CrossRef] 
[10] Chen, J., Sun, H., Katto, J., Zeng, X. and Fan, Y. (2019) Fast QTMT Partition Decision Algorithm in VVC Intra Coding Based on Variance and Gradient. 2019 IEEE Visual Communications and Image Processing (VCIP), Sydney, 1-4 December 2019, 1-4. [Google Scholar] [CrossRef] 
[11] Chen, J., Chiu, Y., Lee, C. and Tsai, Y. (2019) Utilize Neighboring LCU Depth Information to Speedup FVC/H.266 Intra Coding. 2019 International Conference on System Science and Engineering (ICSSE), Dong Hoi, 20-21 July 2019, 308-312. [Google Scholar] [CrossRef] 
[12] Li, T., Xu, M., Tang, R., Chen, Y. and Xing, Q. (2021) DeepQTMT: A Deep Learning Approach for Fast QTMT-Based CU Partition of Intra-Mode VVC. IEEE Transactions on Image Processing, 30, 5377-5390. [Google Scholar] [CrossRef] [PubMed]
[13] Hu, Y., Yang, W., Li, M. and Liu, J. (2019) Progressive Spatial Recurrent Neural Network for Intra Prediction. IEEE Transactions on Multimedia, 21, 3024-3037. [Google Scholar] [CrossRef] 
[14] Park, S. and Kang, J. (2021) Fast Multi-Type Tree Partitioning for Versatile Video Coding Using a Lightweight Neural Network. IEEE Transactions on Multimedia, 23, 4388-4399. [Google Scholar] [CrossRef] 
[15] Tang, G., Jing, M., Zeng, X. and Fan, Y. (2019) Adaptive CU Split Decision with Pooling-Variable CNN for VVC Intra Encoding. 2019 IEEE Visual Communications and Image Processing (VCIP), Sydney, 1-4 December 2019, 1-4. [Google Scholar] [CrossRef] 
[16] 李维, 范彩霞. H.266/VVC帧内预测模式快速判决方法[J]. 计算机工程, 2021, 47(10): 221-225, 235.
[17] Chen, Y., Yu, L., Wang, H., Li, T. and Wang, S. (2010) A Novel Fast Intra Mode Decision for Versatile Video Coding. Journal of Visual Communication and Image Representation, 71, Article ID: 102849. [Google Scholar] [CrossRef] 
[18] Zhang, Q., Jing, R., et al. (2019) Fast Mode Decision Based on Gradient Information in 3D-HEVC. IEEE Access, 7, 135448-135456. [Google Scholar] [CrossRef] 
[19] Dong, X., Shen, L., Yu, M. and Yang, H. (2022) Fast Intra Mode Decision Algorithm for Versatile Video Coding. IEEE Transactions on Multimedia, 24, 400-414. [Google Scholar] [CrossRef] 
[20] Zouidi, N., Belghith, F., Kessentini, A. and Masmoudi, N. (2019) Fast Intra Prediction Decision Algorithm for the QTBT Structure. 2019 IEEE International Conference on Design & Test of Integrated Micro & Nano-Systems (DTS), Gammarth, 28 April-1 May 2019, 1-6. [Google Scholar] [CrossRef] 
[21] De-Luxan-Hernandez, S., Schwarz, H., Marpe, D. and Wiegand, T. (2018) Fast Line-Based Intra Prediction for Video Coding. 2018 IEEE International Symposium on Multimedia (ISM), Taichung, 10-12 December 2018, 135-138. [Google Scholar] [CrossRef] 
[22] Yuan, F., Lei, J., Pan, Z., Peng, B. and Xie, H. (2024) λ-Domain Rate Control via Wavelet-Based Residual Neural Network for VVC HDR Intra Coding. IEEE Transactions on Image Processing, 33, 6189-6203. [Google Scholar] [CrossRef] [PubMed]
[23] Wang, D., Yu, J., Lu, X., Dufaux, F., Guo, H., Guo, H., et al. (2024) Fast Coding Mode Prediction for Intra Prediction in VVC SCC. 2024 IEEE International Conference on Image Processing (ICIP), Abu Dhabi, 27-30 October 2024, 1903-1909. [Google Scholar] [CrossRef] 
[24] Wang, Y., Feng, S., Zhang, W., Li, K. and Yang, F. (2024) Fast H.266/VVC Intra Coding by Early Skipping Joint Coding of Chroma Residuals. IEEE Signal Processing Letters, 31, 2465-2469. [Google Scholar] [CrossRef] 
[25] Sun, T., Wang, Y., Huang, Z. and Sun, J. (2024) STRANet: Soft-Target and Restriction-Aware Neural Network for Efficient VVC Intra Coding. IEEE Transactions on Circuits and Systems for Video Technology, 34, 11993-12005. [Google Scholar] [CrossRef] 
[26] Schäfer, M., Pfaff, J., Schwarz, H., Marpe, D. and Wiegand, T. (2024) Nonlinear Transform Coding for VVC Intra Coding. 2024 Picture Coding Symposium (PCS), Taichung, 12-14 June 2024, 1-5. [Google Scholar] [CrossRef] 
[27] Lu, W., Pavez, E., Ortega, A., Zhao, X. and Liu, S. (2024) Adaptive Online Learning of Separable Path Graph Transforms for Intra-Prediction. 2024 Picture Coding Symposium (PCS), Taichung, 12-14 June 2024, 1-5. [Google Scholar] [CrossRef] 
[28] Wang, D., Yu, J., Lu, X., Dufaux, F., Hang, B., Guo, H., et al. (2024) Fast Mode and CU Splitting Decision for Intra Prediction in VVC SCC. IEEE Transactions on Broadcasting, 70, 872-883. [Google Scholar] [CrossRef] 
[29] Huang, Y., Yu, J., Wang, D., Lu, X., Dufaux, F., Guo, H., et al. (2024) Learning-Based Fast Splitting and Directional Mode Decision for VVC Intra Prediction. IEEE Transactions on Broadcasting, 70, 681-692. [Google Scholar] [CrossRef] 
[30] Si, L., Zhu, W. and Zhang, Q. (2023) Fast Adaptive CU Partition Decision Algorithm for VVC Intra Coding. IEEE Access, 11, 119766-119778. [Google Scholar] [CrossRef] 
[31] Huang, Y., Chen, J. and Tsai, Y. (2021) Speed up H.266/QTMT Intra-Coding Based on Predictions of Resnet and Random Forest Classifier. 2021 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, 10-12 January 2021, 1-6. [Google Scholar] [CrossRef] 
[32] Zhao, T., Huang, Y., Feng, W., Xu, Y. and Kwong, S. (2023) Efficient VVC Intra Prediction Based on Deep Feature Fusion and Probability Estimation. IEEE Transactions on Multimedia, 25, 6411-6421. [Google Scholar] [CrossRef] 
[33] Tang, N., Cao, J., Liang, F., Wang, J., Liu, H., Wang, X., et al. (2019) Fast CTU Partition Decision Algorithm for VVC Intra and Inter Coding. 2019 IEEE Asia Pacific Conference on Circuits and Systems (APCCAS), Bangkok, 11-14 November 2019, 361-364. [Google Scholar] [CrossRef]