多模态交互场景下编程语言的扩展与适配技术
Extension and Adaptation Techniques of Programming Languages in Multimodal Interaction Scenarios
摘要: 随着智能交互技术的演进,多模态交互已广泛渗透于智能家居、车载系统等领域,传统文本编程语言难以适配语音、视觉等多模态信息的解析与融合需求。本文聚焦多模态交互对编程语言的核心挑战,系统阐述语法层、语义层、运行时的扩展维度与关键技术,结合实践验证结果剖析应用效能,最后展望未来发展趋势,为多模态编程语言的研发与应用提供理论与实践参考。
Abstract: With the evolution of intelligent interaction technology, multimodal interaction has widely penetrated into fields such as smart homes and car systems. Traditional text programming languages are difficult to adapt to the parsing and fusion needs of multimodal information such as speech and vision. This article focuses on the core challenges that multimodal interaction poses to programming languages. It systematically elaborates on the extension dimensions and key technologies of syntax, semantics, and runtime, and analyzes application effectiveness based on practical verification results. Finally, it looks forward to future development trends, providing theoretical and practical references for the research and application of multimodal programming languages.
参考文献
|
[1]
|
朱敏敏. 基于深度学习的多模态融合源码漏洞修复研究[D]: [硕士学位论文]. 南昌: 江西师范大学, 2025.
|
|
[2]
|
沈万里. 基于Modevol多模态微课发展初中生计算思维的 Python教学设计与实践[D]: [硕士学位论文]. 北京: 中央民族大学, 2024.
|
|
[3]
|
于博文. 基于多模态代码表征的图学习错误定位[D]: [硕士学位论文]. 北京: 北京化工大学, 2024.
|
|
[4]
|
李勋. 安卓API的多模态信息表示与应用方法研究[D]: [博士学位论文]. 长春: 吉林大学, 2024.
|
|
[5]
|
庄子聪. 基于代码结构的多模态代码表征学习研究[D]: [硕士学位论文]. 广州: 华南理工大学, 2024.
|
|
[6]
|
曹莉. 多模态Chatbox的构建与研究[D]: [硕士学位论文]. 镇江: 江苏大学, 2023.
|
|
[7]
|
张兆旭. 基于预训练和多模态数据扩充的代码自动修复模型[D]: [硕士学位论文]. 哈尔滨: 哈尔滨工业大学, 2023.
|