基于高光谱图像的巴沙鱼煎制状态识别方法研究
Research on a Method for Identifying the Frying State of Basa Fish Based on Hyperspectral Imaging
摘要: 为实现巴沙鱼不同煎制状态的快速、客观与无损判别,本文提出一种利用高光谱成像技术构建巴沙鱼煎制状态智能识别方法。搭建起巴沙鱼煎制状态分类依据,将巴沙鱼煎制过程划分为生、半熟、熟和过熟四种状态。通过高光谱相机采集不同煎制阶段巴沙鱼样本的空间–光谱三维数据,并对原始数据进行黑白校正与固定空间裁剪,构建标准化高光谱数据集。在特征建模方面,设计了一种CsTsrpModel分类模型,引入相对位置编码增强模型对空间–光谱位置信息的感知能力以及稀疏注意力机制优化注意力计算过程,提高模型对重要特征的聚焦能力。结果表明,CsTsrpModel模型在巴沙鱼煎制状态感知中取得了最佳性能,其准确率、精确率、召回率和F1分数分别达到94.83%、94.94%、94.83%和94.79%。研究结果验证了基于高光谱成像与深度学习方法在巴沙鱼煎制状态识别中的可行性与有效性。
Abstract: To achieve rapid, objective, and nondestructive discrimination of different frying states of Basa fish (Pangasius bocourti), this study proposes an intelligent identification method based on hyperspectral imaging technology. A classification framework for frying states was established, in which the frying process was divided into four categories: raw, half-cooked, fully cooked, and overcooked. Spatial-spectral three-dimensional data of samples at different frying stages were acquired using a hyperspectral camera. The raw data were subjected to black-white calibration and fixed spatial cropping to construct a standardized hyperspectral dataset. In terms of feature modeling, a classification model named CsTsrpModel was developed. Relative positional encoding was introduced to enhance the model’s perception of spatial-spectral positional information, and a sparse attention mechanism was incorporated to optimize the attention computation process, thereby improving the model’s ability to focus on critical features. The results demonstrate that the CsTsrpModel achieved the best performance in frying state recognition, with accuracy, precision, recall, and F1-score reaching 94.83%, 94.94%, 94.83%, and 94.79%, respectively. These findings validate the feasibility and effectiveness of integrating hyperspectral imaging and deep learning for frying state identification of basa fish.
文章引用:杨松, 王文凯, 王国旭, 赵倬艺, 王慧慧. 基于高光谱图像的巴沙鱼煎制状态识别方法研究[J]. 人工智能与机器人研究, 2026, 15(2): 481-489. https://doi.org/10.12677/airr.2026.152047

参考文献

[1] Jia, Y., Hu, L., Liu, R., Yang, W., Khalifa, I., Bi, J., et al. (2024) Innovations and Challenges in the Production of Prepared Dishes Based on Central Kitchen Engineering: A Review and Future Perspectives. Innovative Food Science & Emerging Technologies, 91, Article ID: 103521. [Google Scholar] [CrossRef
[2] Ran, X., Lin, D., Zheng, L., Li, Y. and Yang, H. (2023) Kinetic Modelling of the Mass and Heat Transfer of a Plant-Based Fishball Alternative during Deep-Fat Frying and Air Frying and the Changes in Physicochemical Properties. Journal of Food Engineering, 350, Article ID: 111457. [Google Scholar] [CrossRef
[3] Fang, M., Huang, G. and Sung, W. (2021) Mass Transfer and Texture Characteristics of Fish Skin during Deep-Fat Frying, Electrostatic Frying, Air Frying and Vacuum Frying. LWT, 137, Article ID: 110494. [Google Scholar] [CrossRef
[4] FAO (2024) The State of World Fisheries and Aquaculture 2024. Food and Agriculture Organization of the United Nations.
[5] 刘海, 郑福平, 熊振海, 等. 高光谱成像技术在肉品品质评价中的应用[J]. 食品科学, 2018, 39(11): 276-283.
https://link.cnki.net/urlid/11.2206.TS.20170519.0940.024
[6] Hassoun, A., Cropotova, J., Rustad, T., Heia, K., Lindberg, S. and Nilsen, H. (2020) Use of Spectroscopic Techniques for a Rapid and Non-Destructive Monitoring of Thermal Treatments and Storage Time of Sous-Vide Cooked Cod Fillets. Sensors, 20, Article 2410. [Google Scholar] [CrossRef] [PubMed]
[7] Feng, C., Makino, Y. and García Martín, J.F. (2020) Hyperspectral Imaging Coupled with Multivariate Analysis and Image Processing for Detection and Visualisation of Colour in Cooked Sausages Stuffed in Different Modified Casings. Foods, 9, Article 1089. [Google Scholar] [CrossRef] [PubMed]
[8] Rasti, B., Hong, D., Hang, R., Ghamisi, P., Kang, X., Chanussot, J., et al. (2020) Feature Extraction for Hyperspectral Imagery: The Evolution from Shallow to Deep: Overview and Toolbox. IEEE Geoscience and Remote Sensing Magazine, 8, 60-88. [Google Scholar] [CrossRef
[9] Li, N., Wang, Z. and Cheikh, F.A. (2024) Discriminating Spectral-Spatial Feature Extraction for Hyperspectral Image Classification: A Review. Sensors, 24, Article 2987. [Google Scholar] [CrossRef] [PubMed]
[10] Zhong, Z., Li, Y., Ma, L., Li, J. and Zheng, W. (2022) Spectral-Spatial Transformer Network for Hyperspectral Image Classification: A Factorized Architecture Search Framework. IEEE Transactions on Geoscience and Remote Sensing, 60, 1-15. [Google Scholar] [CrossRef
[11] Yang, J., et al. (2021) Focal Self-Attention for Local-Global Interactions in Vision Transformers. arXiv: 2107.00641
[12] 邵颖, 王小红, 吴文锦, 等. 5种淡水鱼肌肉热特性比较研究[J]. 食品科学, 2016, 37(19): 106-111.
[13] Aussanasuwannakul, A., Weber, G.M., Salem, M., Yao, J., Slider, S., Manor, M.L., et al. (2012) Effect of Sexual Maturation on Thermal Stability, Viscoelastic Properties, and Texture of Female Rainbow Trout, Oncorhynchus mykiss, Fillets. Journal of Food Science, 77, S77-S83. [Google Scholar] [CrossRef] [PubMed]
[14] Jia, B., Wang, W., Ni, X., Lawrence, K.C., Zhuang, H., Yoon, S., et al. (2020) Essential Processing Methods of Hyperspectral Images of Agricultural and Food Products. Chemometrics and Intelligent Laboratory Systems, 198, Article ID: 103936. [Google Scholar] [CrossRef
[15] Osborne, B.G., Fearn, T. and Hindle, P.H. (1993) Practical NIR Spectroscopy with Applications in Food and Beverage Analysis. Addison-Wesley Longman Ltd.
[16] Ma, J., Sun, D., Pu, H., Cheng, J. and Wei, Q. (2019) Advanced Techniques for Hyperspectral Imaging in the Food Industry: Principles and Recent Applications. Annual Review of Food Science and Technology, 10, 197-220. [Google Scholar] [CrossRef] [PubMed]
[17] Khoshnoudi-Nia, S. and Moosavi-Nasab, M. (2019) Prediction of Various Freshness Indicators in Fish Fillets by One Multispectral Imaging System. Scientific Reports, 9, Article No. 14704. [Google Scholar] [CrossRef] [PubMed]
[18] Cheng, J., Dai, Q., Sun, D., Zeng, X., Liu, D. and Pu, H. (2013) Applications of Non-Destructive Spectroscopic Techniques for Fish Quality and Safety Evaluation and Inspection. Trends in Food Science & Technology, 34, 18-31. [Google Scholar] [CrossRef
[19] Zhu, F.L., He, Y. and Shao, Y.N. (2015) Application of Near-Infrared Hyperspectral Imaging to Predicting Water Content in Salmon Flesh. Spectroscopy and Spectral Analysis, 35, 113-117.