基于MYA-LSTM的课堂表现预测
Prediction of In-Class Performance Based on MYA-LSTM
DOI: 10.12677/ORF.2023.132048, PDF,   
作者: 王 藏, 秦 学, 齐 睿:贵州大学大数据与信息工程学院,贵州 贵阳;袁有树:北京中医药大学中医学院,北京
关键词: MFO注意力机制LSTM课堂表现预测MFO Attention Mechanism LSTM Prediction of In-Class Performance
摘要: 本文基于长短期记忆(LSTM)模型分析学习过程中生成的行为数据并预测下一阶段的课堂行为表现,使教师能够基于此对学生采取精细的学习干预。考虑到传统的LSTM-Attention模型注意层参数计算方式优化空间不足,导致模型性能低下,本文提出基于改进的飞蛾扑火优化算法寻找注意层参数的长短期记忆(MYA-LSTM)分类预测模型,首先将注意力机制引入到LSTM网络前,其次,针对MFO算法容易陷入局部最优、收敛精度低的缺点,本文提出MYMFO算法,在种群初始化阶段加入混沌策略以及寻优后期引入柯西变异,最后利用MYMFO对注意层参数进行寻优。通过分析12个基准测试函数的仿真结果,MYMFO算法对比MFO算法的寻优精度得到了有效的提升,同时在课堂行为表现的预测实验中,MYA-LSTM对比使用未改进的MFO算法来寻找注意层参数的MA-LSTM模型在“上课积极度”、“课堂参与度”和“知识掌握度”三种课堂行为表现上的F1值分别提升了3.66、3.77和3.14,而MYA-LSTM对比LSTM-Attention在三种课堂行为上的F1值分别提升了4.53、4.46、4.56,充分证明了MYA-LSTM模型的有效性。
Abstract: This study uses the behavior data generated during the Long Short Term Memory (LSTM) model analysis learning process to predict the classroom performance in the next stage, which will enable teachers to take more refined learning interventions for students. Considering that the traditional LSTM-Attention model pays attention to the insufficient optimization space of the calculation method of layer parameters, resulting in the low performance of the model. In this paper, a Long Short Term Memory (MYA-LSTM) classification model based on the improved MFO algorithm to find the parameters of the attention layer is proposed. Firstly, the attention mechanism is introduced before the LSTM network. Secondly, we propose a MYMFO algorithm that adds chaos strategy in the population initialization stage and introduces Cauchy mutation in the later stage of optimization. Finally, MYMFO is used to optimize the parameters of the attention layer. By analyzing the simulation results of 12 benchmark test functions, the optimization accuracy of MYMFO algorithm compared with MFO algorithm has been effectively improved. At the same time, in the prediction experiment of classroom behavior performance, MYA-LSTM compared with the MA-LSTM model, which uses the improved MFO algorithm to find the attention layer parameters, has increased the F1 values of “class enthusiasm”, “class participation” and “knowledge mastery” in three classroom behavior performances by 3.66, 3.77 and 3.14, respec-tively, compared with LSTM-Attention, MYA-LSTM increased the F1 value of three classroom behaviors by 4.53, 4.46 and 4.56 respectively, which fully proves the effectiveness of MYA-LSTM model.
文章引用:王藏, 秦学, 袁有树, 齐睿. 基于MYA-LSTM的课堂表现预测[J]. 运筹与模糊学, 2023, 13(2): 490-503. https://doi.org/10.12677/ORF.2023.132048

参考文献

[1] Yang, J., Zhao, C.C. and Xing, C.X. (2019) Big Data Market Optimization Pricing Model Based on Data Quality. Complexity, 2019, Article ID: 5964068. [Google Scholar] [CrossRef
[2] Stufi, M., Bacic, B. and Stoimenov, L. (2020) Big Data Analytics and Processing Platform in Czech Republic Healthcare. Applied Scienc-es-Basel, 10, 1705. [Google Scholar] [CrossRef
[3] Niu, B., et al. (2017) Analysis and Modeling for Big Data in Cancer Research. Biomed Research International, 2017, Article ID: 4649191. [Google Scholar] [CrossRef] [PubMed]
[4] Li, B. and Lei, Q. (2022) Hybrid IoT and Data Fusion Model for e-Commerce Big Data Analysis. Wireless Communications & Mobile Computing, 2022, Article ID: 2292321. [Google Scholar] [CrossRef
[5] Zhang, F.C. and Lin, H. (2022) Energy Economy and Energy Structure Optimization Countermeasures Based on Big Data Mining. Wireless Communications & Mobile Computing, 2022, Article ID: 4711551. [Google Scholar] [CrossRef
[6] Zhao, L. and Jia, Y.H. (2021) Cluster Coordination between High-Speed Rail Transportation Hub Construction and Regional Economy Based on Big Data. Complexity, 2021, Article ID: 6610882. [Google Scholar] [CrossRef
[7] Liu, S.Y. (2022) Application of Big Data Technology in Urban Greenway Design. Security and Communication Networks, 2022, Article ID: 4826523. [Google Scholar] [CrossRef
[8] Peng, X. and Xu, Q.M. (2020) Investigating Learners’ Behaviors and Discourse Content in MOOC Course Reviews. Computers & Education, 143, Article ID: 103673. [Google Scholar] [CrossRef
[9] Bhalchandra, P., et al. (2017) Discovering Significant Performing Variables of Athlete Students through Data Mining Techniques. International Conference on Computing, Analytics and Networking (ICCAN), Bhubaneswar, 3-5 July 2017, 613-623. [Google Scholar] [CrossRef
[10] Hooshyar, D. and Yang, Y. (2021) Predicting Course Grade through Comprehensive Modelling of Students’ Learning Behavioral Pattern. Complexity, 2021, Article ID: 7463631. [Google Scholar] [CrossRef
[11] Mengash, H.A. (2020) Using Data Mining Techniques to Predict Student Performance to Support Decision Making in University Admission Systems. IEEE Access, 8, 55462-55470. [Google Scholar] [CrossRef
[12] Yang, Y.W., et al. (2020) Predicting Course Achievement of University Students Based on Their Procrastination behaviour on Moodle. Soft Computing, 24, 18777-18793. [Google Scholar] [CrossRef
[13] Chen, J.M., et al. (2018) Course Per-formance Prediction for Basic Courses of Universities Based on Support Vector Machine. Journal of Physics: Conference Series, 1168, Article ID: 032066.
[14] Zhang, Y., Zhang, Q. and Liu, X. (2020) Dropout Predictions of Ideological and Political MOOC Learners Based on Big Data. 19th Annual Wuhan International Conference on E-Business (WHICEB), Wuhan, 29-31 May 2020, 27-32.
[15] Tang, X.Q., et al. (2022) Dropout Rate Prediction of Massive Open Online Courses Based on Convolutional Neural Networks and Long Short-Term Memory Network. Mobile Information Systems, 2022, Article ID: 8255965. [Google Scholar] [CrossRef
[16] Qu, S.J., et al. (2019) Predicting Student Achievement Based on Temporal Learning Behavior in MOOCs. Applied Sciences-Basel, 9, 5539. [Google Scholar] [CrossRef
[17] Khalil, H. and Ebner, M. (2014) MOOCs Completion Rates and Possible Methods to Improve Retention—A Literature Review. World Conference on Educational Multimedia, Hypermedia and Telecommunications (ED-Media), Tampere, 23-27 June 2014, 1305-1313.
[18] Lin, L., et al. (2019) Recurrent Models of Visual Co-Attention for Person Re-Identification. IEEE Access, 7, 8865-8875. [Google Scholar] [CrossRef
[19] Bahdanau, D., Cho, K. and Bengio, Y.J.C.S. (2014) Neural Machine Translation by Jointly Learning to Align and Translate.
[20] Kalita, D.J., Singh, V.P. and Kumar, V. (2021) A Dynamic Framework for Tuning SVM Hyper Parameters Based on Moth-Flame Optimization and Knowledge-Based-Search. Expert Systems with Applications, 168, Article ID: 114139. [Google Scholar] [CrossRef
[21] Ouyang, W.M. (2021) Classroom Education Effect Evalua-tion Model Based on MFO Intelligent Optimization Algorithm. Journal of Intelligent & Fuzzy Systems, 40, 6791-6802. [Google Scholar] [CrossRef
[22] Wu, G.F., Zheng, J. and Zhai, J. (2021) Individualized Learning Evaluation Model Based on Hybrid Teaching. International Journal of Electrical Engineering Education. [Google Scholar] [CrossRef
[23] Hodo, E., et al. (2016) Threat Analysis of IoT Networks Using Artificial Neural Network Intrusion Detection System. 2016 International Symposium on Networks, Com-puters and Communications (ISNCC), Yasmine Hammamet, 11-13 May 2016, 1-6. [Google Scholar] [CrossRef
[24] Yang, A.M., et al. (2019) Design of Intrusion Detection System for Internet of Things Based on Improved BP Neural Network. IEEE Access, 7, 106043-106052. [Google Scholar] [CrossRef
[25] Song, D., et al. (2020) Forecasting Stock Market Index Based on Pattern-Driven Long Short-Term Memory. Economic Computation and Economic Cybernetics Studies and Research, 54, 25-41. [Google Scholar] [CrossRef
[26] Ma, M., et al. (2022) Predicting Machine’s Performance Record Using the Stacked Long Short-Term Memory (LSTM) Neural Networks. Journal of Applied Clinical Medical Physics, 23, e13558. [Google Scholar] [CrossRef] [PubMed]
[27] Chen, Y. (2020) Voltages Prediction Algorithm Based on LSTM Recurrent Neural Network. Optik, 220, Article ID: 164869. [Google Scholar] [CrossRef
[28] Kim, T.Y. and Cho, S.B. (2019) Predicting Residential Energy Consumption Using CNN-LSTM Neural Networks. Energy, 182, 72-81. [Google Scholar] [CrossRef
[29] Mu, L., et al. (2020) Hourly and Daily Urban Water De-mand Predictions Using a Long Short-Term Memory Based Model. Journal of Water Resources Planning and Management, 146, Article ID: 05020017. [Google Scholar] [CrossRef
[30] Shi, Y., et al. (2021) Improved ACD-Based Fi-nancial Trade Durations Prediction Leveraging LSTM Networks and Attention Mechanism. Mathematical Problems in Engineering, 2021, Article ID: 7854512. [Google Scholar] [CrossRef
[31] Chen, S. and Ge, L. (2019) Exploring the Attention Mechanism in LSTM-Based Hong Kong Stock Price Movement Prediction. Quantitative Finance, 19, 1507-1515. [Google Scholar] [CrossRef
[32] Xiao, K., et al. (2021) Attention-Based Long Short-Term Memory Network Temperature Prediction Model. 2021 7th International Conference on Condition Monitoring of Machinery in Non-Stationary Operations (CMMNO), Guangzhou, 20-22 May 2021, 278-281.
[33] Mirjalili, S. (2015) Moth-Flame Optimization Algorithm: A Novel Nature-Inspired Heuristic Paradigm. Knowledge-Based Systems, 89, 228-249. [Google Scholar] [CrossRef
[34] Abdel-Mawgoud, H., et al. (2021) Optimal Allocation of DG and Capacitor in Distribution Networks Using a Novel Hybrid MFO-SCA Method. Electric Power Components and Systems, 49, 259-275. [Google Scholar] [CrossRef
[35] Trivedi, I.N., et al. (2018) Optimal Power Flow with Voltage Stability Improvement and Loss Reduction in Power System Using Moth-Flame Optimizer. Neural Com-puting & Applications, 30, 1889-1904. [Google Scholar] [CrossRef
[36] Jangir, P., et al. (2016) Economic Load Dispatch Problem with Ramp Rate Limits and Prohibited Operating Zones Solve Using Levy Flight Moth-Flame Optimizer. 2016 In-ternational Conference on Energy Efficient Technologies for Sustainability (ICEETS), Nagercoil, 7-8 April 2016, 442-447.
[37] Yang, L., et al. (2018) An Improved Chaotic ACO Clustering Algorithm. 20th IEEE International Conference on High Performance Computing and Communications (HPCC)/16th IEEE International Conference on Smart City (SmartCity)/4th IEEE International Conference on Data Science and Systems (DSS), Exeter, 28-30 June 2018, 1642-1649. [Google Scholar] [CrossRef
[38] Feng, J.H., et al. (2017) A Novel Chaos Op-timization Algorithm. Multimedia Tools and Applications, 76, 17405-17436. [Google Scholar] [CrossRef
[39] Chen, H.W., et al. (2021) Application of Distributed Seagull Optimization Improved Algorithm in Sentiment Tendency Prediction. 15th International Conference on Complex, Intelligent and Software Intensive Systems (CISIS), Asan, 1-3 July 2021, 90-99. [Google Scholar] [CrossRef
[40] Jiang, K.Q., Jiang, M.Y. and IEEE (2021) Lion Swarm Optimization Based on Balanced Local and Global Search with Different Distributions. IEEE International Con-ference on Progress in Informatics and Computing (IEEE PIC), Shanghai, 17-19 December 2021, 276-280. [Google Scholar] [CrossRef