基于稳定扩散模型的AR显示装置像质提升与智能交互方法

Image Quality Improvement and Intelligent Interaction Method of AR Display Device Based on Stable Diffusion Model

摘要: 本文针对现有AR显示装置在图像质量提升领域的固有缺陷，以扩散生成模型为基础，改进设计了一种基于稳定扩散模型的AR显示装置像质提升与智能交互方法。该像质提升方法将通用Diffusion扩散模型和Encoder-Dedecoder的结构相结合，将场景图像输入经过训练的像质提升模型中，通过编码器将输入的场景图像转换为隐变量特征，然后通过反向扩散模块中训练好的深度神经网络层按时间节点的逆向顺序对隐变量特征进行反向迭代计算逐层生成降噪隐变量特征，直至得到最终的降噪隐变量特征，最后通过解码器将最终的降噪隐变量特征转换为降噪处理后的像质提升图像。通过相关试验证明本文方法相较于通用Diffusion扩散模型迭代速度更快，生成性能指标更好。在此基础上，本文还进一步设计了相应的智能交互方法，能够通过稳定扩散模型实现场景图像的降噪增强以及场景图像与所需交互信息之间的智能融合，且还能够将稳定扩散模型进行本地终端部署以避免不必要的数据远程传输消耗。

Abstract: The invention specifically relates to a method for image quality improvement and intelligent inter-action of an AR display device based on a stable diffusion model. Image quality improvement methods include: The scene image is input into the trained image quality improvement model, and the input scene image is converted into hidden variable features through the encoder. Then, the trained deep neural network layer in the reverse diffusion module performs reverse iterative calculation on the hidden variable features according to the reverse order of time nodes to generate the noise reduction hidden variable features layer by layer until the final noise reduction hidden variable features are obtained. Finally, the final hidden variable features of noise reduction are converted into the image quality improvement image after noise reduction by decoder. The invention further discloses a corresponding intelligent interaction method. The invention can realize the noise reduction and enhancement of the scene image and the intelligent fusion between the scene image and the required interactive information through the stable diffusion model, and can also deploy the stable diffusion model to the local terminal to avoid unnecessary consumption of remote data transmission.