基于力触觉再现的博物馆文物沉浸式交互系统设计与性能评估

Design and Performance Evaluation of an Immersive Interaction System for Museum Artifacts Based on Haptic Reproduction

摘要: 针对传统博物馆数字展陈存在触觉感知缺失、沉浸感不足、文物易损耗等问题，本文设计一套面向文物展陈、基于力触觉模拟反馈技术的博物馆沉浸式交互装置。系统采用仿真先行、实体落地研发思路，构建上位机–控制中枢–执行端三层架构，以改进型SFS算法实现文物二维图像到三维表面形态的高精度重建，建立图像几何特征与压电振动反馈的映射模型，完成视觉信息到物理触感的转化。硬件采用集成ESP8266的指套式结构，搭载四路压电振动阵列与压力、姿态传感器，实现轻量化、低延迟、高灵敏度的触觉反馈输出。软件搭建电脑端与手机端双平台，以手机热点构建局域网通信环境，由电脑端承担服务器完成实时数据解算，支持文物图像自由缩放、区域选框与多终端协同交互。实验与设计分析表明，该装置可精准复原文物纹理、轮廓与材质特征，有效弥补传统数字展示的感官断层问题，在文物保护、沉浸式科普、无障碍导览等场景具备较高应用价值。

Abstract: Traditional digital exhibition in museums suffers from lack of tactile perception, insufficient immersion and easy wear of cultural relics. This paper presents an immersive interactive device for cultural relic exhibition based on haptic simulation and feedback technology. Following the research philosophy of simulation prior to physical implementation, the system adopts a three-layer architecture consisting of upper computer, control hub and execution terminal. The improved SFS algorithm is used to reconstruct the 3D surface morphology of cultural relics with high precision from 2D images. A mapping model between geometric image features and piezoelectric vibration feedback is established to realize the conversion from visual information to physical tactile sensation. The hardware is designed as a fingerstall structure integrated with ESP8266, equipped with a four-channel piezoelectric vibration array, pressure sensors and attitude sensors, delivering lightweight, low-latency and high-sensitivity tactile feedback. Dual software platforms for computer and mobile phone are developed, and a local area network is built via mobile hotspot. The computer acts as a server for real-time data calculation, supporting free image scaling, regional selection and multi-terminal collaborative interaction for cultural relics. Experimental results and design analysis show that the device can accurately simulate the texture, contour and surface geometric features of cultural relics, and effectively make up for the sensory defects of traditional digital exhibition. It has great application potential in cultural relic protection, immersive popular science and barrier-free navigation.