Pedagogical agent

Last updated

A pedagogical agent is a concept borrowed from computer science and artificial intelligence and applied to education, usually as part of an intelligent tutoring system (ITS). It is a simulated human-like interface between the learner and the content, in an educational environment. A pedagogical agent is designed to model the type of interactions between a student and another person. Mabanza and de Wet define it as "a character enacted by a computer that interacts with the user in a socially engaging manner". [1] A pedagogical agent can be assigned different roles in the learning environment, such as tutor or co-learner, [2] depending on the desired purpose of the agent. "A tutor agent plays the role of a teacher, while a co-learner agent plays the role of a learning companion". [1]

Contents

Computerized agent designed to facilitate interaction between the computer program and the person. Automated online assistant.png
Computerized agent designed to facilitate interaction between the computer program and the person.

History

The history of Pedagogical Agents is closely aligned with the history of computer animation. As computer animation progressed, it was adopted by educators to enhance computerized learning by including a lifelike interface between the program and the learner. The first versions of a pedagogical agent were more cartoon than person, like Microsoft's Clippy which helped users of Microsoft Office load and use the program's features in 1997. However, with developments in computer animation, pedagogical agents can now look lifelike. By 2006 there was a call to develop modular, reusable agents to decrease the time and expertise required to create a pedagogical agent. [3] There was also a call in 2009 to enact agent standards. [4] The standardization and re-usability of pedagogical agents is less of an issue since the decrease in cost and widespread availability of animation tools. [5] [6] Individualized pedagogical agents can be found across disciplines including medicine, math, law, language learning, automotive, and armed forces. [1] They are used in applications directed to every age, from preschool to adult. [1]

Distributed cognition theory

Distributed cognition theory is the method in which cognition progresses in the context of collaboration with others. Pedagogical agents can be designed to assist the cognitive transfer to the learner, operating as artifacts or partners with collaborative role in learning. To support the performance of an action by the user, the pedagogical agent can act as a cognitive tool as long as the agent is equipped with the knowledge that the user lacks. The interactions between the user and the pedagogical agent can facilitate a social relationship. The pedagogical agent may fulfill the role of a working partner. [7]

Socio-cultural learning theory

Socio-cultural learning theory is how the user develops when they are involved in learning activities in which there is interaction with other agents. A pedagogical agent can: intervene when the user requests, provide support for tasks that the user cannot address, and potentially extend the learners cognitive reach. Interaction with the pedagogical agent may elicit a variety of emotions from the learner. The learner may become excited, confused, frustrated, and/or discouraged. These emotions affect the learners' motivation. [7]

Extraneous Cognitive Load

Extraneous cognitive load is the extra effort being exerted by an individual's working memory due to the way information is being presented. A pedagogical agent can increase the user's cognitive load by distracting them and becoming the focus of their attention, causing split attention between the instructional material and the agent. Agents can reduce the perceived cognitive load by providing narration and personalization that can also promote a user's interest and motivation. [8] While research on the reduction of cognitive load from pedagogical  agents is minimal, more studies have shown that agents do not increase it. [9] [10]

Effectiveness

It has been suggested by researchers that pedagogical agents may take on different roles in the learning environment. [11] Examples of these roles are: supplanting, scaffolding, coaching, testing, or demonstrating or modelling a procedure. A pedagogical agent as a tutor has not been demonstrated to add any benefit to an educational strategy in equivalent lessons with and without a pedagogical agent. [12] According to Richard Mayer, there is some support in research for pedagogical agent increasing learning, but only as a presenter of social cues. [13] A co-learner pedagogical agent is believed to increase the student's self-efficacy. By pointing out important features of instructional content, a pedagogical agent can fulfill the signaling function, which research on multimedia learning has shown to enhance learning. Research has demonstrated that human-human interaction may not be completely replaced by pedagogical agents, but learners may prefer the agents to non-agent multimedia systems. [11] This finding is supported by social agency theory.

Much like the varying effectiveness of the pedagogical agent roles in the learning environment, agents that take into account the user's affect have had mixed results. Research has shown pedagogical agents that make use of the users’ affect have been found to increase user knowledge retention, motivation, and perceived self-efficacy. [14] [15] However, with such a broad range of modalities in affective expressions, it is often difficult to utilize them. [16] Additionally, having agents detect a user's affective state with precision remains challenging, as displays of affect are different across individuals. [17]

Design

Attractiveness

The appearance of a pedagogical agent can be manipulated to meet the learning requirements. The attractiveness of a pedagogical agent can enhance student's learning when the users were the opposite gender of the pedagogical agent. Male students prefer a sexy appearance of a female pedagogical agents and dislike the sexy appearance of male agents. Female students were not attracted by the sexy appearance of either male or female pedagogical agents. [18]

Affective Response

Pedagogical agents have reached a point where they can convey and elicit emotion, but also reason about and respond to it. These agents are often designed to elicit and respond to affective actions from users through various modalities such as speech, facial expressions, and body gestures. [19] They respond to the affective state of the given user, and make use of these modalities using a wide array of sensors incorporated into the design of the agent. [20] Specifically in education and training applications, pedagogical agents are often designed to increasingly recognize when users or learners exhibit frustration, boredom, confusion, and states of flow. [21] The added recognition in these agents is a step toward making them more emotionally intelligent, comforting and motivating the users as they interact.

Digital Representation

The design of a pedagogical agent often begins with its digital representation, whether it will be 2D or 3D and static or animated. Several studies have developed pedagogical agents that were both static and animated, then evaluated the relative benefits. Similar to other design considerations, the improved learning from static or animated agents remains questionable. One study showed that the appearance of an agent portrayed using a static image can impact a user's recall, based on the visual appearance. Other research found results that suggest static agent images improve learning outcomes. However, several other studies found user's learned more when the pedagogical agent was animated rather than static. [22] [23] Recently a meta-analysis of such research found a negligible improvement in learning via pedagogical agents, suggesting more work needs to be done in the area to support any claims. [24]

Related Research Articles

Multimedia is a form of communication that uses a combination of different content forms such as text, audio, images, animations, or video into a single interactive presentation, in contrast to traditional mass media, such as printed material or audio recordings, which features little to no interaction between users. Popular examples of multimedia include video podcasts, audio slideshows and animated videos. Multimedia also contains the principles and application of effective interactive communication such as the building blocks of software, hardware, and other technologies. The five main building blocks of multimedia are text, image, audio, video, and animation.

Affective computing is the study and development of systems and devices that can recognize, interpret, process, and simulate human affects. It is an interdisciplinary field spanning computer science, psychology, and cognitive science. While some core ideas in the field may be traced as far back as to early philosophical inquiries into emotion, the more modern branch of computer science originated with Rosalind Picard's 1995 paper on affective computing and her book Affective Computing published by MIT Press. One of the motivations for the research is the ability to give machines emotional intelligence, including to simulate empathy. The machine should interpret the emotional state of humans and adapt its behavior to them, giving an appropriate response to those emotions.

Instructional scaffolding is the support given to a student by an instructor throughout the learning process. This support is specifically tailored to each student; this instructional approach allows students to experience student-centered learning, which tends to facilitate more efficient learning than teacher-centered learning. This learning process promotes a deeper level of learning than many other common teaching strategies.

Situated cognition is a theory that posits that knowing is inseparable from doing by arguing that all knowledge is situated in activity bound to social, cultural and physical contexts.

<span class="mw-page-title-main">Constructivism (philosophy of education)</span> Philosophical viewpoint about the nature of knowledge; theory of knowledge

Constructivism is a theory in education which posits that individuals or learners do not acquire knowledge and understanding by passively perceiving it within a direct process of knowledge transmission, rather they construct new understandings and knowledge through experience and social discourse, integrating new information with what they already know. For children, this includes knowledge gained prior to entering school. It is associated with various philosophical positions, particularly in epistemology as well as ontology, politics, and ethics. The origin of the theory is also linked to Swiss developmental psychologist Jean Piaget's theory of cognitive development.

In cognitive psychology, cognitive load refers to the amount of working memory resources used. However, it is essential to distinguish it from the actual construct of Cognitive Load (CL) or Mental Workload (MWL), which is studied widely in many disciplines. According to work conducted in the field of instructional design and pedagogy, broadly, there are three types of cognitive load: intrinsic cognitive load is the effort associated with a specific topic; extraneous cognitive load refers to the way information or tasks are presented to a learner; and germane cognitive load refers to the work put into creating a permanent store of knowledge. However, over the years, the additivity of these types of cognitive load has been investigated and questioned. Now it is believed that they circularly influence each other.

Educational animations are animations produced for the specific purpose of fostering learning. It is associated with educational technology with the way it supports teaching and learning through the use of technological tools to facilitate learning and to improve performance.

An intelligent tutoring system (ITS) is a computer system that aims to provide immediate and customized instruction or feedback to learners, usually without requiring intervention from a human teacher. ITSs have the common goal of enabling learning in a meaningful and effective manner by using a variety of computing technologies. There are many examples of ITSs being used in both formal education and professional settings in which they have demonstrated their capabilities and limitations. There is a close relationship between intelligent tutoring, cognitive learning theories and design; and there is ongoing research to improve the effectiveness of ITS. An ITS typically aims to replicate the demonstrated benefits of one-to-one, personalized tutoring, in contexts where students would otherwise have access to one-to-many instruction from a single teacher, or no teacher at all. ITSs are often designed with the goal of providing access to high quality education to each and every student.

Computer-supported collaborative learning (CSCL) is a pedagogical approach wherein learning takes place via social interaction using a computer or through the Internet. This kind of learning is characterized by the sharing and construction of knowledge among participants using technology as their primary means of communication or as a common resource. CSCL can be implemented in online and classroom learning environments and can take place synchronously or asynchronously.

Affective design describes the design of user interfaces in which emotional information is communicated to the computer from the user in a natural and comfortable way. The computer processes the emotional information and adapts or responds to try to improve the interaction in some way. The notion of affective design emerged from the field of human–computer interaction (HCI), specifically from the developing area of affective computing. Affective design serves an important role in user experience (UX) as it contributes to the improvement of the user's personal condition in relation to the computing system. The goals of affective design focus on providing users with an optimal, proactive experience. Amongst overlap with several fields, applications of affective design include ambient intelligence, human–robot interaction, and video games.

Adaptive hypermedia (AH) uses hypermedia which is adaptive according to a user model. In contrast to regular hypermedia, where all users are offered the same set of hyperlinks, adaptive hypermedia (AH) tailors what the user is offered based on a model of the user's goals, preferences and knowledge, thus providing links or content most appropriate to the current user.

E-learning theory describes the cognitive science principles of effective multimedia learning using electronic educational technology.

The split-attention effect is a learning effect inherent within some poorly designed instructional materials. It is apparent when the same modality is used for various types of information within the same display. Users must split their attention between the materials, for example, an image and text, to understand the information being conveyed. The split-attention effect can occur physically through visual and auditory splits and temporally when time distances two pieces of information that should be connected.

AutoTutor is an intelligent tutoring system developed by researchers at the Institute for Intelligent Systems at the University of Memphis, including Arthur C. Graesser that helps students learn Newtonian physics, computer literacy, and critical thinking topics through tutorial dialogue in natural language. AutoTutor differs from other popular intelligent tutoring systems such as the Cognitive Tutor, in that it focuses on natural language dialog. This means that the tutoring occurs in the form of an ongoing conversation, with human input presented using either voice or free text input. To handle this input, AutoTutor uses computational linguistics algorithms including latent semantic analysis, regular expression matching, and speech act classifiers. These complementary techniques focus on the general meaning of the input, precise phrasing or keywords, and functional purpose of the expression, respectively. In addition to natural language input, AutoTutor can also accept ad hoc events such as mouse clicks, learner emotions inferred from emotion sensors, and estimates of prior knowledge from a student model. Based on these inputs, the computer tutor determine when to reply and what speech acts to reply with. This process is driven by a "script" that includes a set of dialog-specific production rules.

Adaptive learning, also known as adaptive teaching, is an educational method which uses computer algorithms as well as artificial intelligence to orchestrate the interaction with the learner and deliver customized resources and learning activities to address the unique needs of each learner. In professional learning contexts, individuals may "test out" of some training to ensure they engage with novel instruction. Computers adapt the presentation of educational material according to students' learning needs, as indicated by their responses to questions, tasks and experiences. The technology encompasses aspects derived from various fields of study including computer science, AI, psychometrics, education, psychology, and brain science.

The expertise reversal effect refers to the reversal of the effectiveness of instructional techniques on learners with differing levels of prior knowledge. The primary recommendation that stems from the expertise reversal effect is that instructional design methods need to be adjusted as learners acquire more knowledge in a specific domain. Expertise is described as "the ability to perform fluently in a specific class of tasks."

Learning analytics is the measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimizing learning and the environments in which it occurs. The growth of online learning since the 1990s, particularly in higher education, has contributed to the advancement of Learning Analytics as student data can be captured and made available for analysis. When learners use an LMS, social media, or similar online tools, their clicks, navigation patterns, time on task, social networks, information flow, and concept development through discussions can be tracked. The rapid development of massive open online courses (MOOCs) offers additional data for researchers to evaluate teaching and learning in online environments.

Individual variation in second-language acquisition is the study of why some people learn a second language better than others. Unlike children who acquire a language, adults learning a second language rarely reach the same level of competence as native speakers of that language. Some may stop studying a language before they have fully internalized it, and others may stop improving despite living in a foreign country for many years. It also appears that children are more likely than adults to reach native-like competence in a second language. There have been many studies that have attempted to explain these phenomena.

<span class="mw-page-title-main">Gamification of learning</span> Educational approach aiming to promote learning by using video game design and game elements

The gamification of learning is an educational approach that seeks to motivate students by using video game design and game elements in learning environments. The goal is to maximize enjoyment and engagement by capturing the interest of learners and inspiring them to continue learning. Gamification, broadly defined, is the process of defining the elements which comprise games, make those games fun, and motivate players to continue playing, then using those same elements in a non-game context to influence behavior. In other words, gamification is the introduction of game elements into a traditionally non-game situation.

Seductive details are often used in textbooks, lectures, slideshows, and other forms of educational content to make a course more interesting or interactive. Seductive details can take the form of text, animations, photos, illustrations, sounds or music and are by definition: (1) interesting and (2) not directed toward the learning objectives of a lesson. John Dewey, in 1913, first referred to this as "fictitious inducements to attention." While illustrated text can enhance comprehension, illustrations that are not relevant can lead to poor learning outcomes. Since the late 1980s, many studies in the field of educational psychology have shown that the addition of seductive details results in poorer retention of information and transfer of learning. Thalheimer conducted a meta-analysis that found, overall, a negative impact for the inclusion of seductive details such as text, photos or illustrations, and sounds or music in learning content. More recently, a 2020 paper found a similar effect for decorative animations This reduction to learning is called the seductive details effect. There have been criticisms of this theory. Critics argue that seductive details do not always impede understanding and that seductive details can sometimes be motivating for learners.

References

  1. 1 2 3 4 Mabanza, N; de Wet, L (2014). "Determining the Usability Effect of Pedagogical Interface Agents on Adult Computer Literacy Training". E-Learning Paradigms and Applications. pp. 145–183. doi:10.1007/978-3-642-41965-2_6. ISBN   978-3-642-41964-5.{{cite book}}: |journal= ignored (help)
  2. Chin, Doris B.; Dohmen, Ilsa M.; Cheng, Britte H.; Oppezzo, Marily A.; Chase, Catherine C.; Schwartz, Daniel L. (2010). "Preparing students for future learning with Teachable Agents". Education Tech Research Dev. 58 (6): 649–669. doi:10.1007/s11423-010-9154-5. S2CID   54686518.
  3. Silveira, R.A.; Gomes, E.R.; Vicari, R (2006). "Intelligent Learning Objects: An Agent Approach to Create Interoperable Learning Objects". In Kumar, D; Turner, J (eds.). Education for the 21st Century-Impact of CIT and Digital Resources. Boston: Springer. pp. 411–415.
  4. Veletsianos, George; Miller, Charles; Doering, Aaron (2009). "ENALI: A research and design framework for virtual characters and pedagogical agents" (PDF). Educational Computing Research. 41 (2): 171–194. doi:10.2190/EC.41.2.c. hdl: 10613/5076 . S2CID   145034418.
  5. Govindasamy, Malliga K. (2014). "Animated pedagogical agents: A review of agent technology software in electronic learning environments". Journal of Educational Multimedia and Hypermedia. 23 (2): 163–188.
  6. Schroeder, Noah L.; Adesope, Olusola O. (2012). "A case for the use of pedagogical agents in online learning environments". Journal of Teaching and Learning with Technology. 1 (2): 43–47.
  7. 1 2 Apostol, Ailviu; Şoica, Oana; Manasia, Lorendana; Ştefan, Cătălin (2013). "Virtual Pedagogical Agents in the Context of Virtual Learning Environments: Framework and Theoretical Models". ELearning & Software for Education (2): 531–536. doi:10.12753/2066-026X-13-194. S2CID   257202012.
  8. Yung, Hsin I (2011). "Decreasing Extraneous Cognitive Load in Multimedia Environment: Effects of the Pedagogical Agent". Computers and Advanced Technology in Education. Calgary, AB, Canada: ACTAPRESS. doi:10.2316/p.2011.734-055. ISBN   9780889868885.
  9. Schroeder, N. L (2017). "The influence of a pedagogical agent on learners' cognitive load" (PDF). Journal of Educational Technology & Society. 20 (4): 138–147.
  10. Davis, Robert O. (2018). "The impact of pedagogical agent gesturing in multimedia learning environments: A meta-analysis". Educational Research Review. 24: 193–209. doi:10.1016/j.edurev.2018.05.002. S2CID   149837782.
  11. 1 2 Schroeder, Noah L.; Adesope, Olusola O. (Spring 2014). "A Systematic Review of Pedagogical Agents' Persona, Motivation, and Cognitive Load Implications for Learners". Journal of Research on Technology in Education. 46 (3): 229. doi:10.1080/15391523.2014.888265. S2CID   144689960.
  12. Clark, Richard E.; Fledon, David F. (2014). "Ten Common but Questionable Principles of Multimedia Learning". In Mayer, Richard (ed.). The Cambridge Handbook of Multimedia Learning. New York, NY: Cambridge University Press. ISBN   978-1-107-61031-6.
  13. Mayer, Richard (2014). "Principles Based on Social Cues". In Mayer, Richard (ed.). The Cambridge Handbook of Multimedia Learning. New York, NY: Cambridge University Press. ISBN   978-1-107-61031-6.
  14. Conati, Cristina; Zhao, Xiaohong (2004). "Building and evaluating an intelligent pedagogical agent to improve the effectiveness of an educational game". Proceedings of the 9th International Conference on Intelligent User Interface - IUI '04. IUI '04. New York, New York, USA: ACM Press: 6–13. CiteSeerX   10.1.1.67.6798 . doi:10.1145/964445.964446. ISBN   978-1581138153.
  15. Mumm, Jonathan; Mutlu, Bilge (2011). "Designing motivational agents: The role of praise, social comparison, and embodiment in computer feedback". Computers in Human Behavior. 27 (5): 1643–1650. doi:10.1016/j.chb.2011.02.002. ISSN   0747-5632.
  16. Patterson, Kathleen (2011). "Demystifying Emotion Handbook of Emotions, Third Edition. Michael Lewis, Jeannette M. Haviland-Jones and Lisa Feldman Barrett (Eds.). (2008). New York: The Guilford Press, 848 pp., $95.00 (HB)". Journal of the International Neuropsychological Society. 17 (3): 566–569. doi:10.1017/s1355617711000506. ISSN   1355-6177. S2CID   143971132.
  17. Picard, R. W. (2000). "Affective computing". Pattern Analysis and Applications. 1: 71–73. doi:10.1007/bf01238028. S2CID   26564332.
  18. Wang, Chih-Chien; Yeh, Wei-Jyh (2013). "Avatars with Sex Appeal as Pedagogical Agents: Attractiveness, Trustworthiness, Expertise, and Gender Differences". Journal of Educational Computing Research. 48 (4): 403–429. doi:10.2190/EC.48.4.a. S2CID   147595253.
  19. Johnson, W. Lewis; Lester, James C. (2016). "Face-to-Face Interaction with Pedagogical Agents, Twenty Years Later". International Journal of Artificial Intelligence in Education. 26 (1): 25–36. doi: 10.1007/s40593-015-0065-9 . ISSN   1560-4292.
  20. Grafsgaard, Joseph; Wiggins, Joseph; Boyer, Kristy Elizabeth; Wiebe, Eric; Lester, James (2014). "Predicting learning and affect from multimodal data streams in task-oriented tutorial dialogue". Educational Data Mining 2014.
  21. Swartout, William; Artstein, Ron; Forbell, Eric; Foutz, Susan; Lane, H. Chad; Lange, Belinda; Morie, Jacquelyn Ford; Rizzo, Albert Skip; Traum, David (2013-12-15). "Virtual Humans for Learning". AI Magazine. 34 (4): 13. doi: 10.1609/aimag.v34i4.2487 . ISSN   0738-4602.
  22. The Effects of Pedagogical Agent Voice and Animation on Learning, Motivation and Perceived Persona. Proceedings of ED-MEDIA 2003 -- World Conference on Educational Multimedia, Hypermedia & Telecommunications: AACE. 2003. ISBN   9781880094488. OCLC   1008947184.{{cite book}}: CS1 maint: location (link)
  23. Mayer, Richard E.; DaPra, C. Scott (2012). "An embodiment effect in computer-based learning with animated pedagogical agents". Journal of Experimental Psychology: Applied. 18 (3): 239–252. doi:10.1037/a0028616. ISSN   1939-2192. PMID   22642688.
  24. Mayer, Richard E. (2014), "Principles Based on Social Cues in Multimedia Learning: Personalization, Voice, Image, and Embodiment Principles", in Mayer, Richard (ed.), The Cambridge Handbook of Multimedia Learning, Cambridge University Press, pp. 345–368, doi:10.1017/cbo9781139547369.017, ISBN   9781139547369