Publication Information

Authors:

• Christopher MacLellan, Drexel University
• Kenneth R. Koedinger, Carnegie Mellon University

Pages:

• 76-117

Keywords:

• Authoring tools, Intelligent tutoring systems, Interactive machine learning, Simulated agents

Abstract:

• Intelligent tutoring systems are effective for improving students’ learning outcomes (Pane et al. 2013; Koedinger and Anderson, International Journal of Artificial Intelligence in Education, 8, 1–14, 1997; Bowen et al. Journal of Policy Analysis and Management, 1, 94–111 2013). However, constructing tutoring systems that are pedagogically effective has been widely recognized as a challenging problem (Murray 2003; Murray, International Journal of Artificial Intelligence in Education, 10, 98–129, 1999). In this paper, we explore the use of computational models of apprentice learning, or computer models that learn interactively from examples and feedback, for authoring expert-models via demonstrations and feedback (Matsuda et al. International Journal of Artificial Intelligence in Education, 25(1), 1–34 2014) across a wide range of domains. To support these investigations, we present the Apprentice Learner Architecture, which posits the types of knowledge, performance, and learning components needed for apprentice learning. We use this architecture to create two models: the Decision Tree model, which non-incrementally learns skills, and the Trestle model, which instead learns incrementally. Both models draw on the same small set of prior knowledge (six operators and three types of relational knowledge) to support expert model authoring. Despite their limited prior knowledge, we demonstrate their use for efficiently authoring a novel experimental design tutor and show that they are capable of learning an expert model for seven additional tutoring systems that teach a wide range of knowledge types (associations, categories, and skills) across multiple domains (language, math, engineering, and science). This work shows that apprentice learner models are efficient for authoring tutors that would be difficult to build with existing non-programmer authoring approaches (e.g., experimental design or stoichiometry tutors). Further, we show that these models can be applied to author tutors across eight tutor domains even though they only have a small, fixed set of prior knowledge. This work lays the foundation for new interactive machine-learning based authoring paradigms that empower teachers and other non-programmers to build pedagogically effective educational technologies at scale.