面向钻井地质设计知识问答的检索增强与生成优化方法
Retrieval-Augmented and Generation Optimized Method for Question Answering in Drilling Geological Design
DOI: 10.12677/csa.2026.168275, PDF,    科研立项经费支持
作者: 魏小涛*:中国石油大学(北京)克拉玛依校区石油学院,新疆 克拉玛依;段俊卿:北京交通大学软件学院,北京;梁任腾:中兴通讯股份有限公司,北京;陈瑞军, 张 伟, 王世明, 刘永杰:红有软件股份有限公司,新疆 克拉玛依
关键词: 大语言模型检索增强生成参数高效微调钻井地质设计领域知识问答Large Language Model Retrieval-Augmented Generation Parameter-Efficient Fine-Tuning Drilling Geological Design Domain Knowledge QA
摘要: 在企业知识问答场景下,大模型支撑系统经常会存在知识缺失、泛化回复、实体关系提取能力弱以及可追溯性不足等问题,因此,本文提出一种面向油田钻井地质设计领域的检索增强与生成优化协同方法。该方法将Ict-Retriever作为检索前端,通过企业文档切片与向量索引实现外部知识召回。同时构建钻井地质设计专用指令微调数据集ICT-DrillGeoDesign,该数据集涵盖地层岩性、压力预测、钻井液设计、井身结构等核心领域知识。除此之外,对ChatGLM3-6B模型进行QLoRA微调,进而得到面向钻井地质设计业务的大模型IctLM-Drill。最后,后续研究将围绕钻井地质设计规范、油气层特征、钻井工程参数以及安全预警标准等核心文档构建领域知识图谱,让系统能够完成地质设计问答、实体关系抽取以及设计参数推荐等任务。实验结果表明,IctLM-Drill在原始ChatGLM3-6B基础上,BLEU、PPL、Distinct指标上分别达到0.458、6.82、9.15。联动Ict-Retriever后,端到端模型指标进一步提升至0.658、6.42、16.87。该方法有效提升了钻井地质设计场景下问答的准确性、专业性和实用性,为油田钻井工程设计提供了智能化支撑。
Abstract: Large language model-based question-answering systems deployed in enterprise environments often face several practical challenges, including incomplete domain knowledge, generic responses, weak capability in extracting entity relations, and limited answer traceability. To address these issues, this paper proposes a retrieval-augmented and generation-enhanced framework for the drilling geological design domain in oilfields. The framework incorporates Ict-Retriever as the retrieval module. Enterprise documents are segmented into manageable passages and encoded into a vector index to support efficient retrieval of relevant external knowledge. In parallel, a domain-specific instruction-tuning dataset, named ICT-DrillGeoDesign, is constructed for drilling geological design tasks. The dataset covers key technical topics, including formation lithology, pressure prediction, drilling fluid design, and wellbore structure design. Based on this dataset, ChatGLM3-6B is fine-tuned using QLoRA to obtain IctLM-Drill, a domain-adapted language model for drilling geological design. In addition, a domain knowledge graph will be developed from core technical materials in the future, including drilling geological design specifications, reservoir characteristics, drilling engineering parameters, and safety warning standards. The knowledge graph enables the system to support multiple downstream tasks, such as domain question answering, entity and relation extraction, and drilling design parameter recommendation. Experimental results show that IctLM-Drill achieves BLEU, PPL, and Distinct scores of 0.458, 6.82, and 9.15, respectively, outperforming the original ChatGLM3-6B model. After integrating Ict-Retriever, the end-to-end system further improves the corresponding results to 0.658, 6.42, and 16.87. These results demonstrate that the proposed framework can effectively improve the accuracy, domain relevance, and practical usefulness of question answering in drilling geological design scenarios, providing intelligent support for oilfield drilling engineering design.
文章引用:魏小涛, 段俊卿, 梁任腾, 陈瑞军, 张伟, 王世明, 刘永杰. 面向钻井地质设计知识问答的检索增强与生成优化方法[J]. 计算机科学与应用, 2026, 16(8): 204-219. https://doi.org/10.12677/csa.2026.168275

参考文献

[1] Gao, Y., Xiong, Y., Gao, X., et al. (2023) Retrieval-Augmented Generation for Large Language Models: A Survey. arXiv:2312.10997.
[2] 熊凯, 杜理, 丁效, 刘挺, 秦兵, 付博. 面向文本推理的知识增强预训练语言模型[J]. 中文信息学报, 2022, 36(12): 27-35.
[3] 袁乐, 刘绍华, 王禹, 等. 大语言模型检索增强生成优化技术研究综述[J]. 计算机学报, 2026, 49(2): 383-422.
[4] Lewis, P., Perez, E., Piktus, A., et al. (2020) Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks. 2020 Advances in Neural Information Processing Systems, Vancouver, 6-12 December 2020, 9459-9474.
[5] 张犬俊, 谢杨, 房春荣, 等. 检索增强生成在软件工程中的应用综述[J]. 软件学报, 2026, 37(3): 1316-1339.
[6] Hu, E.J., Shen, Y., Wallis, P., et al. (2022) LoRA: Low-Rank Adaptation of Large Language Models. 2022 International Conference on Learning Representations, Online, 25-29 April 2022, 1-26.
[7] Dettmers, T., Pagnoni, A., Holtzman, A. and Zettlemoyer, L. (2023) QLoRA: Efficient Finetuning of Quantized LLMs. Advances in Neural Information Processing Systems 36, New Orleans, 10-16 December 2023, 10088-10015.
https://doi.org/10.52202/075280-0441
[8] Du, Z., Qian, Y., Liu, X., Ding, M., Qiu, J., Yang, Z., et al. (2022) GLM: General Language Model Pretraining with Autoregressive Blank Infilling. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Dublin, May 2022, 320-335.
https://doi.org/10.18653/v1/2022.acl-long.26
[9] Team GLM, Zeng, A., Xu, B., Wang, B., et al. (2024) ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools. arXiv:2406.12793.
[10] Wang, Y., Kordi, Y., Mishra, S., Liu, A., Smith, N.A., Khashabi, D., et al. (2023) Self-Instruct: Aligning Language Models with Self-Generated Instructions. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Toronto, July 2023, 13484-13508.
https://doi.org/10.18653/v1/2023.acl-long.754
[11] Karpukhin, V., Oguz, B., Min, S., Lewis, P., Wu, L., Edunov, S., et al. (2020) Dense Passage Retrieval for Open-Domain Question Answering. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Online, November 2020, 6769-6781.
https://doi.org/10.18653/v1/2020.emnlp-main.550
[12] 冯掌印. 浅谈大模型时代下的检索增强[C]//中国计算语言学大会. 2024.
[13] 王亮. 检索增强生成(RAG)驱动的知识服务: 原理、范式及评估[J]. 科技与出版, 2025(4): 37-46.
[14] Yuan, S., Zhao, H., Du, Z., Ding, M., Liu, X., Cen, Y., et al. (2021) WuDaoCorpora: A Super Large-Scale Chinese Corpora for Pre-Training Language Models. AI Open, 2, 65-68.
https://doi.org/10.1016/j.aiopen.2021.06.001
[15] 李冬梅, 张扬, 李东远, 等. 实体关系抽取方法研究综述[J]. 计算机研究与发展, 2020, 57(7): 1424-1448.
[16] 鄂海红, 张文静, 肖思琪, 等. 深度学习实体关系抽取研究综述[J]. 软件学报, 2019, 30(6): 1793-1818.
[17] 中华人民共和国共和国石油天然气行业标准. SY/T 5615-2004石油天然气地质编图规范及图式[S]. 北京: 石油工业出版社, 2004.
[18] 中国石油集团地质研究院. 钻井地质设计手册[M]. 北京: 石油工业出版社, 2020.
[19] Papineni, K., Roukos, S., Ward, T., et al. (2002) BLEU: a Method for Automatic Evaluation of Machine Translation. Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, Philadelphia, 7-12 July 2002, 311-318.
[20] Li, J., Galley, M., Brockett, C., Gao, J. and Dolan, B. (2016) A Diversity-Promoting Objective Function for Neural Conversation Models. Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, June 2016, 110-119.
https://doi.org/10.18653/v1/n16-1014