运用Delphi法构建基于计算机辅助语言评估系统一级条目的可行性分析

The Delphi Method Is Used to Construct the Feasibility Analysis of the First Level Items in the Computer Aided Language Assessment System

摘要: 目的：运用Delphi法构建基于计算机辅助语言评估系统一级条目，发挥计算机的辅助作用，通过构建计算机辅助下的语言评估检测指标，为计算机语言智能系统量表构建提供理论基础。方法：文献查阅借鉴国内外语言量表应用情况，筛选一级指标，采用Delphi法，选取25位专家并对指标进行问卷调查和意见咨询。结果：国内外排名前三量表汉语失语检查法(ABC)、BDAE、WAB、结合(36项目)Token (筛查)，筛选出一级条目池。参与评卷专家25名(平均年龄38.41岁)，62.5%以上专家为硕士及以上学历。专家积极系数88%，意见提出率40%，Kendall’s W系数0.361，差异有统计学意义(P < 0.001)，根据专家意见集中程度筛选语言一级筛查条目是：听觉理解、自发性语言、口语表达、命名、阅读、复述。结论：专家意见集中，协调程度一致，筛选出合适的语言评估系统一级条目，为计算机构建语言评估智能系统量表提供可靠的理论基础。

Abstract: Objective: To construct a level 1 item of the computer-aided language assessment system (CATS) based on Delphi method. Methods: The first level indicators were screened by referring to the application of cognitive scale at home and abroad, and 25 experts were selected by Delphi method to conduct questionnaire survey and opinion consultation on the indicators. Results: Chinese aphasia test (ABC), BDAE, WAB, and combination (36 items) Token (screening) of the top three scales at home and abroad were selected to screen the first-level item pool. Twenty-five experts (average age 38.41 years old) participated in the marking, and 62.5% or more of them had master degree or above. The expert positive coefficient was 88%, the opinion proposal rate was 40%, Kendall’s W coefficient was 0.361, the difference was statistically significant (P < 0.001). The language level 1 screening items were auditory comprehension, spontaneous language, oral expression, naming, reading, and rehearsal according to the degree of expert opinion concentration. Conclusions: The expert opinion is concentrated, the degree of coordination is consistent, and the appropriate level 1 items of the cognitive assessment system are screened out, which provides a reliable theoretical basis for the computer to construct the intelligent language assessment system scale.