虚拟现实环境下虚拟手交互方法研究
Research on Virtual Hand Interaction for Vehicle Assembly Training in Virtual Reality
DOI: 10.12677/CSA.2022.124099, PDF,    国家自然科学基金支持
作者: 钟贵强, 战荫伟, 杨 卓, 廖声亮：广东工业大学，计算机学院，广东 广州
关键词: 虚拟装配；虚拟手；虚拟现实；自然抓取；抓取规则；物理粒子；Virtual Assembly； Virtual Hands； Virtual Reality； Natural Grasps； Grasping Rule； Physical Particles
摘要: 为了模拟汽车虚拟装配培训环境下的虚拟手交互，设计了一种基于物理粒子和刚性骨架的虚拟手模型：使用刚体模拟虚拟手的骨骼，将具有物理特性的粒子耦合到蒙皮网格上相应的位置，动态地调整刚度值。提出了一种算法复杂度低的辅助抓取方法，将虚拟手抓取物体的情况分为被抓取和未被抓取两个状态，有效地减少了物体意外掉落的情况，提高了抓取的稳定性。最后将虚拟手模型集成到车辆装配培训系统，通过对照实验验证本方法可以有效地提高交互真实感，在所有任务场景中都得到了满意的效果。
Abstract: In order to simulate the virtual hand interaction in the automobile assembly training environment, a virtual hand model based on physical particles and rigid skeleton was designed. Rigid bodies are used to simulate the skeletons of virtual hands, physical particles are coupled to the corresponding positions on the skin grids, and the stiffness values are dynamically adjusted. An auxiliary grasping method is proposed of low complexity and better grasping stability, which divides the manipulation into two states: caught or not get caught, and prevents the object from falling off unexpectedly. Finally, the virtual hand model is integrated into the vehicle assembly training system. Comparative experiments demonstrate that this method can effectively improve the interactive realism and achieve excellent results in all the assigned task scenarios.
文章引用：钟贵强, 战荫伟, 杨卓, 廖声亮. 虚拟现实环境下虚拟手交互方法研究[J]. 计算机科学与应用, 2022, 12(4): 965-972. https://doi.org/10.12677/CSA.2022.124099

参考文献

[1] Oprea, S., Martinez-Gonzalez, P. and Garcia-Garcia, A. (2019) A Visually Realistic Grasping System for Object Manip-ulation and Interaction in Virtual Reality Environments. Computers & Graphics, 83, 77-86. [Google Scholar] [CrossRef] 
[2] Höll, M., Oberweger, M., Arth, C. and Lepetit, V. (2018) Efficient Physics-Based Implementation for Realistic Hand-Object Interaction in Virtual Reality. IEEE Conference on Virtual Real-ity and 3D User Interfaces, Tuebingen/Reutlingen, 18-22 March 2018, 175-182. [Google Scholar] [CrossRef] 
[3] 杨晓文, 张志纯, 况立群, 韩燮. 基于虚拟手的人机交互关键技术[J]. 计算机应用, 2015, 35(10): 2945-2949.
[4] Erleben, K., Macklin, M. and Andrews, S. (2020) The Match-stick Model for Anisotropic Friction Cones. Computer Graphics Forum, 39, 450-461. [Google Scholar] [CrossRef] 
[5] Xu, J., Danielczuk, M., Steinbach, E. and Goldberg, K. (2020) 6DFC: Effi-ciently Planning Soft Non-Planar Area Contact Grasps Using 6D Friction Cones. 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, 31 May-31 August 2020, 7891-7897. [Google Scholar] [CrossRef] 
[6] 胡晨, 张学聃, 马惠敏. 适应物体形状的虚拟手抓取[J]. 中国图象图形学报, 2017, 22(5): 663-670.
[7] 邹俞, 晁建刚, 林万洪. 虚拟手抓持规则融合策略研究[J]. 计算机工程与科学, 2019, 41(7): 1203-1211.
[8] 邹俞, 晁建刚, 林万洪. 基于局部坐标系构建的抓持物体固连方法[J]. 计算机仿真, 2019, 36(4): 334-339+344.
[9] Talvas, A., Marchal, M., Duriez, C. and Otaduy, M.A. (2015) Aggregate Constraints for Virtual Manipulation with Soft Fingers. IEEE Transactions on Visualization and Computer Graphics, 21, 452-461. [Google Scholar] [CrossRef] 
[10] Talvas, A., Marchal, M. and Lécuyer, A. (2013) The God-Finger Method for Improving 3D Interaction with Virtual Objects through Simulation of Contact Area. 2013 IEEE Symposium on 3D User Interfaces, Orlando, 16-17 March 2013, 111-114. [Google Scholar] [CrossRef] 
[11] Delrieu, T., Weistroffer, V. and Gazeau, J.P. (2020) Precise and Realistic Grasping and Manipulation in Virtual Reality without Force Feedback. IEEE Conference on Virtual Reality and 3D User Interfaces, Georgia, 22-26 March 2020, 266-274. [Google Scholar] [CrossRef] 
[12] Verschoor, M., Lobo, D. and Otaduy, M.A. (2018) Soft Hand Simulation for Smooth and Robust Natural Interaction. IEEE Conference on Virtual Reality and 3D User Interfaces, Tuebingen/Reutlingen, 18-22 March 2018, 183-190. [Google Scholar] [CrossRef] 
[13] Kim, J. and Park, J. (2015) Physics-Based Hand Interaction with Virtual Objects. IEEE International Conference on Robotics and Automation, Seattle, 26-30 May 2015, 3814-3819. [Google Scholar] [CrossRef] 
[14] Jacobs, J. and Froehlich, B. (2011) A Soft Hand Model for Physically-Based Manipulation of Virtual Objects. IEEE Virtual Reality Conference, Singapore, 19-23 March 2011, 11-18. [Google Scholar] [CrossRef] 
[15] Chessa, M., Maiello, G., Klein, L.K., Paulun, V.C. and So-lari, F. (2019) Grasping Objects in Immersive Virtual Reality. 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Osaka, 23-27 March 2019, 1749-1754. [Google Scholar] [CrossRef] 
[16] Quan, W., Yang, H., Han, C. and Li, Y. (2020) Realistic Interaction System for Human Hand in Virtual Environments. 2020 International Conference on Intelligent Transportation, Big Data & Smart City (ICITBS), Vientiane, 11-12 January 2020, 772-778. [Google Scholar] [CrossRef]