Publication Information

Authors:

• Irina Pandarova, Leuphana University Lüneburg
• Torben Schmidt, Leuphana University Lüneburg
• Johannes Hartig, Leibniz Institute for Research and Information in Education (DIPF)
• Ahcène Boubekki, Leuphana University Lüneburg
• Roger Dale Jones, Leuphana University Lüneburg & Technical University Braunschweig
• Ulf Brefeld, Leuphana University Lüneburg

Pages:

• 342-367

Keywords:

• Adaptivity, Intelligent language tutoring systems, Item difficulty prediction, Item response theory, Machine learning, Second language acquisition

Abstract:

• Advances in computer technology and artificial intelligence create opportunities for developing adaptive language learning technologies which are sensitive to individual learner characteristics. This paper focuses on one form of adaptivity in which the difficulty of learning content is dynamically adjusted to the learner’s evolving language ability. A pilot study is presented which aims to advance the (semi-)automatic difficulty scoring of grammar exercise items to be used in dynamic difficulty adaptation in an intelligent language tutoring system for practicing English tenses. In it, methods from item response theory and machine learning are combined with linguistic item analysis in order to calibrate the difficulty of an initial exercise pool of cued gap-filling items (CGFIs) and isolate CGFI features predictive of item difficulty. Multiple item features at the gap, context and CGFI levels are tested and relevant predictors are identified at all three levels. Our pilot regression models reach encouraging prediction accuracy levels which could, pending additional validation, enable the dynamic selection of newly generated items ranging from moderately easy to moderately difficult. The paper highlights further applications of the proposed methodology in the area of adapting language tutoring, item design and second language acquisition, and sketches out issues for future research.