Learning engineering

Last updated

Learning Engineering is the systematic application of evidence-based principles and methods from educational technology and the learning sciences to create engaging and effective learning experiences, support the difficulties and challenges of learners as they learn, and come to better understand learners and learning. It emphasizes the use of a human-centered design approach in conjunction with analyses of rich data sets to iteratively develop and improve those designs to address specific learning needs, opportunities, and problems, often with the help of technology. Working with subject-matter and other experts, the Learning Engineer deftly combines knowledge, tools, and techniques from a variety of technical, pedagogical, empirical, and design-based disciplines to create effective and engaging learning experiences and environments and to evaluate the resulting outcomes. While doing so, the Learning Engineer strives to generate processes and theories that afford generalization of best practices, along with new tools and infrastructures that empower others to create their own learning designs based on those best practices.

Contents

Supporting learners as they learn is complex, and design of learning experiences and support for learners usually requires interdisciplinary teams.

Supporting learners as they learn is complex, and design of learning experiences and support for learners usually requires interdisciplinary teams. Learning Engineering is Multidisciplinary.png
Supporting learners as they learn is complex, and design of learning experiences and support for learners usually requires interdisciplinary teams.

Learning engineers themselves might specialize in designing learning experiences that unfold over time, engage the population of learners, and support their learning; automated data collection and analysis; design of learning technologies; design of learning platforms; improve environments or conditions that support learning; or some combination. The products of learning engineering teams include on-line courses (e.g., a particular MOOC), software platforms for offering online courses, learning technologies (e.g., ranging from physical manipulatives to electronically-enhanced physical manipulatives to technologies for simulation or modeling to technologies for allowing immersion), after-school programs, community learning experiences, formal curricula, and more. Learning engineering teams require expertise associated with the content that learners will learn, the targeted learners themselves, the venues in which learning is expected to happen, educational practice, software engineering, and sometimes even more.

Learning engineering teams employ an iterative design process for supporting and improving learning. Initial designs are informed by findings from the learning sciences. Refinements are informed by analysis of data collected as designs are carried out in the world. Methods from learning analytics, design-based research, and rapid large-scale experimentation are used to evaluate designs, inform refinements, and keep track of iterations. [1] [2] [3] According to the IEEE Standards Association's IC Industry Consortium on Learning Engineering, "Learning Engineering is a process and practice that applies the learning sciences using human-centered engineering design methodologies and data-informed decision making to support learners and their development." [4]


History

Herbert Simon, a cognitive psychologist and economist, first coined the term learning engineering in 1967. [5] However, associations between the two terms learning and engineering began emerging earlier, in the 1940s [6] and as early as the 1920s. [6] [7] Simon argued that the social sciences, including the field of education, should be approached with the same kind of mathematical principles as other fields like physics and engineering. [8]

Simon’s ideas about learning engineering continued to reverberate at Carnegie Mellon University, but the term did not catch on until businessman Bror Saxberg began marketing it in 2014 after visiting Carnegie Mellon University and the Pittsburgh Science of Learning Center, or LearnLab for short. Bror Saxberg brought his team from the for-profit education company, Kaplan, to visit CMU. The team went back to Kaplan with what we now call learning engineering to enhance, optimize, test, and sell their educational products. Bror Saxberg would later co-write with Frederick Hess, founder of the American Enterprise Institute's Conservative Education Reform Network, the 2014 book using the term learning engineering.

In 2017, the IEEE Standards Association form the IC Industry Consortium on Learning Engineering as a part of its Industry Connections program.

Learning engineering is an iterative process, informed by data, that starts with a challenge in context. The Creation stage may use iterative human-centered design-build cycles. Learning Engineering Process with Iterative Design-Build.png
Learning engineering is an iterative process, informed by data, that starts with a challenge in context. The Creation stage may use iterative human-centered design-build cycles.

Between 2017 and 2019, ICICLE formed eight Special Interest Groups (SIGs) as a collaborative resource to support the growth of Learning Engineering. The Curriculum, and Credentials SIG chaired by Kenneth Koedinger pioneered the work on a formal definition of learning engineering. Later work by the Design SIG led by Aaron Kessler led to the development of a learning engineering process model. In 2024 ICICLE changed its name to International Consortium for Innovation and Collaboration in Learning Engineering and became part of the IEEE Learning Technology Standards Committee.

Overview

Learning Engineering is aimed at addressing a deficit in the application of science and engineering methodologies to education and training. Its advocates emphasize the need to connect computing technology and generated data with the overall goal of optimizing learning environments. [9]

Learning Engineering initiatives aim to improve educational outcomes by leveraging computing to dramatically increase the applications and effectiveness of learning science as a discipline. Digital learning platforms have generated large amounts of data which can reveal immediately actionable insights. [10]

The Learning Engineering field has the further potential to communicate educational insights automatically available to educators. For example, learning engineering techniques have been applied to the issue of drop-out or high failure rates. Traditionally, educators and administrators have to wait until students actually withdraw from school or nearly fail their courses to accurately predict when the drop out will occur. Learning engineers are now able to use data on off-task behavior [11] or wheel spinning [12] to better understand student engagement and predict whether individual students are likely to fail.

This data enables educators to spot struggling students weeks or months prior to being in danger of dropping out. Proponents of Learning Engineering posit that data analytics will contribute to higher success rates and lower drop-out rates. [13]

Learning Engineering can also assist students by providing automatic and individualized feedback.

Carnegie Learning’s tool LiveLab, for instance, employs big data to create a learning experience for each student user by, in part, identifying the causes of student mistakes. Research insights gleaned from LiveLab analyses allow teachers to see student progress in real-time.

Common approaches

A/B Testing

A/B testing compares two versions of a given program and allows researchers to determine which approach is most effective. In the context of Learning Engineering, platforms like TeacherASSIST [14] and Coursera use A/B testing to determine which type of feedback is the most effective for learning outcomes. [15]

Neil Heffernan’s work with TeacherASSIST includes hint messages from teachers that guide students toward correct answers. Heffernan’s lab runs A/B tests between teachers to determine which type of hints result in the best learning for future questions. [16] [17]

UpGrade is an open-source platform for conducting A/B testing and large-sclae field experiments in education. [18] It allows EdTech companies to run experiments within their own software. ETRIALS leverages ASSISTments and give scientists freedom to run experiments in authentic learning environments. Terracotta is a research platform that supports teachers' and researchers' abilities to easily run experiments in live classes.

Educational Data Mining

Educational Data Mining involves analyzing data from student use of educational software to understand how software can improve learning for all students. Researchers in the field, such as Ryan Baker at the University of Pennsylvania, have developed models of student learning, engagement, and affect to relate them to learning outcomes. [19]

Platform Instrumentation

Education tech platforms link educators and students with resources to improve learning outcomes.

Dataset Generation

Datasets provide the raw material that researchers use to formulate educational insights. For example, Carnegie Mellon University hosts a large volume of learning interaction data in LearnLab's DataShop. [20] Their datasets range from sources like Intelligent Writing Tutors [21] to Chinese tone studies [22] to data from Carnegie Learning’s MATHia platform.

Kaggle, a hub for programmers and open source data, regularly hosts machine learning competitions. In 2019, PBS partnered with Kaggle to create the 2019 Data Science Bowl. [23] The DataScience Bowl sought machine learning insights from researchers and developers, specifically into how digital media can better facilitate early-childhood STEM learning outcomes.

Datasets, like those hosted by Kaggle PBS and Carnegie Learning, allow researchers to gather information and derive conclusions about student outcomes. These insights help predict student performance in courses and exams. [24]

Learning Engineering in Practice

Combining education theory with data analytics has contributed to the development of tools that differentiate between when a student is wheel spinning (i.e., not mastering a skill within a set timeframe) and when they are persisting productively. [25] Tools like ASSISTments [26] alert teachers when students consistently fail to answer a given problem, which keeps students from tackling insurmountable obstacles, [27] promotes effective feedback [27] and educator intervention, and increases student engagement.

Studies have found that Learning Engineering may help students and educators to plan their studies before courses begin. For example, UC Berkeley Professor Zach Pardos uses Learning Engineering to help reduce stress for community college students matriculating into four-year institutions. [28] Their predictive model analyzes course descriptions and offers recommendations regarding transfer credits and courses that would align with previous directions of study. [29]

Similarly, researchers Kelli Bird and Benjamin Castlemen’s work focuses on creating an algorithm to provide automatic, personalized guidance for transfer students. [30] The algorithm is a response to the finding that while 80 percent of community college students intend to transfer to a four-year institution, only roughly 30 percent actually do so. [31] Such research could lead to a higher pass/fail rate [32] and help educators know when to intervene to prevent student failure or drop out. [33] [34]

Criticisms of Learning Engineering

Researchers and educational technology commentators have published critiques of learning engineering. [6] [35] The criticisms raised include that learning engineering misrepresents the field of learning sciences and that despite stating it is based on cognitive science, it actually resembles a return to behaviorism. Others have also commented that learning engineering exists as a form of surveillance capitalism. Other fields, such as instructional systems design, have criticized that learning engineering rebrands the work of their own field.

Still others have commented critically on learning engineering's use of metaphors and figurative language. Often a term or metaphor carries a different meaning for professionals or academics from different domains. At times a term that is used positively in one domain carries a strong negative perception in another domain. [36]

Challenges for Learning Engineering Teams

The multidisciplinary nature of learning engineering creates challenges. The problems that learning engineering attempts to solve often require expertise in diverse fields such as software engineering, instructional design, domain knowledge, pedagogy/andragogy, psychometrics, learning sciences, data science, and systems engineering. In some cases, an individual Learning Engineer with expertise in multiple disciplines might be sufficient. However, learning engineering problems often exceed any one person’s ability to solve.

A 2021 convening of thirty learning engineers produced recommendations that key challenges and opportunities for the future of the field involve enhancing R&D infrastructure, supporting domain-based education research, developing components for reuse across learning systems, enhancing human-computer systems, better engineering implementation in schools, improving advising, optimizing for the long-term instead of short-term, supporting 21st-century skills, improved support for learner engagement, and designing algorithms for equity. [37]

See also

Related Research Articles

Instructional design (ID), also known as instructional systems design and originally known as instructional systems development (ISD), is the practice of systematically designing, developing and delivering instructional materials and experiences, both digital and physical, in a consistent and reliable fashion toward an efficient, effective, appealing, engaging and inspiring acquisition of knowledge. The process consists broadly of determining the state and needs of the learner, defining the end goal of instruction, and creating some "intervention" to assist in the transition. The outcome of this instruction may be directly observable and scientifically measured or completely hidden and assumed. There are many instructional design models but many are based on the ADDIE model with the five phases: analysis, design, development, implementation, and evaluation.

Instructional scaffolding is the support given to a student by an instructor throughout the learning process. This support is specifically tailored to each student; this instructional approach allows students to experience student-centered learning, which tends to facilitate more efficient learning than teacher-centered learning. This learning process promotes a deeper level of learning than many other common teaching strategies.

<span class="mw-page-title-main">Active learning</span> Educational technique

Active learning is "a method of learning in which students are actively or experientially involved in the learning process and where there are different levels of active learning, depending on student involvement." Bonwell & Eison (1991) states that "students participate [in active learning] when they are doing something besides passively listening." According to Hanson and Moser (2003) using active teaching techniques in the classroom can create better academic outcomes for students. Scheyvens, Griffin, Jocoy, Liu, & Bradford (2008) further noted that "by utilizing learning strategies that can include small-group work, role-play and simulations, data collection and analysis, active learning is purported to increase student interest and motivation and to build students ‘critical thinking, problem-solving and social skills". In a report from the Association for the Study of Higher Education, authors discuss a variety of methodologies for promoting active learning. They cite literature that indicates students must do more than just listen in order to learn. They must read, write, discuss, and be engaged in solving problems. This process relates to the three learning domains referred to as knowledge, skills and attitudes (KSA). This taxonomy of learning behaviors can be thought of as "the goals of the learning process." In particular, students must engage in such higher-order thinking tasks as analysis, synthesis, and evaluation.

M-learning, or mobile learning, is a form of distance education where learners use portable devices such as mobile phones to learn anywhere and anytime. The portability that mobile devices provide allows for learning anywhere, hence the term "mobile" in "mobile learning." M-learning devices include computers, MP3 players, mobile phones, and tablets. M-learning can be an important part of informal learning.

A learning management system (LMS) is a software application for the administration, documentation, tracking, reporting, automation, and delivery of educational courses, training programs, materials or learning and development programs. The learning management system concept emerged directly from e-Learning. Learning management systems make up the largest segment of the learning system market. The first introduction of the LMS was in the late 1990s. Learning management systems have faced a massive growth in usage due to the emphasis on remote learning during the COVID-19 pandemic.

Educational technology is the combined use of computer hardware, software, and educational theory and practice to facilitate learning. When referred to with its abbreviation, "EdTech," it often refers to the industry of companies that create educational technology. In EdTech Inc.: Selling, Automating and Globalizing Higher Education in the Digital Age, Tanner Mirrlees and Shahid Alvi (2019) argue "EdTech is no exception to industry ownership and market rules" and "define the EdTech industries as all the privately owned companies currently involved in the financing, production and distribution of commercial hardware, software, cultural goods, services and platforms for the educational market with the goal of turning a profit. Many of these companies are US-based and rapidly expanding into educational markets across North America, and increasingly growing all over the world."

Universal Design for Learning (UDL) is an educational framework based on research in the learning sciences, including cognitive neuroscience, that guides the development of flexible learning environments and learning spaces that can accommodate individual learning differences.

An intelligent tutoring system (ITS) is a computer system that imitates human tutors and aims to provide immediate and customized instruction or feedback to learners, usually without requiring intervention from a human teacher. ITSs have the common goal of enabling learning in a meaningful and effective manner by using a variety of computing technologies. There are many examples of ITSs being used in both formal education and professional settings in which they have demonstrated their capabilities and limitations. There is a close relationship between intelligent tutoring, cognitive learning theories and design; and there is ongoing research to improve the effectiveness of ITS. An ITS typically aims to replicate the demonstrated benefits of one-to-one, personalized tutoring, in contexts where students would otherwise have access to one-to-many instruction from a single teacher, or no teacher at all. ITSs are often designed with the goal of providing access to high quality education to each and every student.

Computer-supported collaborative learning (CSCL) is a pedagogical approach wherein learning takes place via social interaction using a computer or through the Internet. This kind of learning is characterized by the sharing and construction of knowledge among participants using technology as their primary means of communication or as a common resource. CSCL can be implemented in online and classroom learning environments and can take place synchronously or asynchronously.

Formative assessment, formative evaluation, formative feedback, or assessment for learning, including diagnostic testing, is a range of formal and informal assessment procedures conducted by teachers during the learning process in order to modify teaching and learning activities to improve student attainment. The goal of a formative assessment is to monitor student learning to provide ongoing feedback that can help students identify their strengths and weaknesses and target areas that need work. It also helps faculty recognize where students are struggling and address problems immediately. It typically involves qualitative feedback for both student and teacher that focuses on the details of content and performance. It is commonly contrasted with summative assessment, which seeks to monitor educational outcomes, often for purposes of external accountability.

E-learning theory describes the cognitive science principles of effective multimedia learning using electronic educational technology.

<span class="mw-page-title-main">Open education</span> Educational movement

Open education is an educational movement founded on openness, with connections to other educational movements such as critical pedagogy, and with an educational stance which favours widening participation and inclusiveness in society. Open education broadens access to the learning and training traditionally offered through formal education systems and is typically offered through online and distance education. The qualifier "open" refers to the elimination of barriers that can preclude both opportunities and recognition for participation in institution-based learning. One aspect of openness or "opening up" education is the development and adoption of open educational resources in support of open educational practices.

<span class="mw-page-title-main">Evidence-based education</span> Paradigm of the education field

Evidence-based education (EBE) is the principle that education practices should be based on the best available scientific evidence, rather than tradition, personal judgement, or other influences. Evidence-based education is related to evidence-based teaching, evidence-based learning, and school effectiveness research. For example, research has shown that spaced repetition "leads to more robust memory formation than massed training does, which involves short or no intervals".

Learning analytics is the measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimizing learning and the environments in which it occurs. The growth of online learning since the 1990s, particularly in higher education, has contributed to the advancement of Learning Analytics as student data can be captured and made available for analysis. When learners use an LMS, social media, or similar online tools, their clicks, navigation patterns, time on task, social networks, information flow, and concept development through discussions can be tracked. The rapid development of massive open online courses (MOOCs) offers additional data for researchers to evaluate teaching and learning in online environments.

Educational data mining (EDM) is a research field concerned with the application of data mining, machine learning and statistics to information generated from educational settings. At a high level, the field seeks to develop and improve methods for exploring this data, which often has multiple levels of meaningful hierarchy, in order to discover new insights about how people learn in the context of such settings. In doing so, EDM has contributed to theories of learning investigated by researchers in educational psychology and the learning sciences. The field is closely tied to that of learning analytics, and the two have been compared and contrasted.

A virtual learning environment (VLE) in educational technology is a web-based platform for the digital aspects of courses of study, usually within educational institutions. They present resources, activities, and interactions within a course structure and provide for the different stages of assessment. VLEs also usually report on participation and have some level of integration with other institutional systems. In North America, VLEs are often referred to as Learning Management Systems (LMS).

<span class="mw-page-title-main">OER Commons</span> Freely accessible online library

OER Commons is a freely accessible online library that allows teachers and others to search and discover open educational resources (OER) and other freely available instructional materials.

<span class="mw-page-title-main">Kahoot!</span> Norwegian online educational quiz game

Kahoot! is a Norwegian online game-based learning platform. It has learning games, also known as "kahoots", which are user-generated multiple-choice quizzes that can be accessed via a web browser or the Kahoot! app.

<span class="mw-page-title-main">Online learning in higher education</span> Development in distance education that began in the mid-1980s

Online learning involves courses offered by primary institutions that are 100% virtual. Online learning, or virtual classes offered over the internet, is contrasted with traditional courses taken in a brick-and-mortar school building. It is a development in distance education that expanded in the 1990s with the spread of the commercial Internet and the World Wide Web. The learner experience is typically asynchronous but may also incorporate synchronous elements. The vast majority of institutions utilize a learning management system for the administration of online courses. As theories of distance education evolve, digital technologies to support learning and pedagogy continue to transform as well.

<span class="mw-page-title-main">Okhee Lee</span> American education scholar

Okhee Lee is an American education scholar and professor of childhood education.

References

  1. Dede, Chris; Richards, John; Saxberg, Bror (2018). "Learning Engineering for Online Education: Theoretical Contexts and Design-Based Examples". Routledge & CRC Press. Retrieved 2020-07-21.
  2. Saxberg, Bror (April 2017). "Learning Engineering: Proceedings of the Fourth (2017) ACM Conference on Learning @ Scale". doi:10.1145/3051457.3054019. S2CID   12156278.{{cite journal}}: Cite journal requires |journal= (help)
  3. Koedinger, Ken (April 2016). "Learning Engineering: Proceedings of the Third (2016) ACM Conference on Learning @ Scale". doi: 10.1145/2876034.2876054 . S2CID   29186611.{{cite journal}}: Cite journal requires |journal= (help)
  4. "IEEE ICICLE: A volunteer professional organization committed to the development of Learning Engineering as a profession and as an academic discipline".
  5. Simon, Herbert A. (Winter 1967). "The Job of a College President". Carnegie Mellon University University Libraries - Digital Collections.
  6. 1 2 3 Watters, Audrey (2019-07-12). "The History of the Future of the 'Learning Engineer'". Hack Education. Retrieved 2020-07-21.
  7. Wilcox, Karen E.; Sarma, Sanjay; Lippel, Philip (April 2016). "Online Education: A Catalyst for Higher Education Reforms" (PDF). MIT Online Education Policy Initiative.
  8. "The Sveriges Riksbank Prize in Economic Sciences in Memory of Alfred Nobel 1978". NobelPrize.org. Retrieved 2020-07-21.
  9. Saxberg, Bror (April 2017). "Learning Engineering: Proceedings of the Fourth (2017) ACM Conference on Learning @ Scale". doi:10.1145/3051457.3054019. S2CID   12156278.{{cite journal}}: Cite journal requires |journal= (help)
  10. Koedinger, Kenneth; Cunningham, Kyle; Skogsholm, Alida; Leber, Brett; Stamper, John (2010-10-25). "A Data Repository for the EDM Community". Handbook of Educational Data Mining. Chapman & Hall/CRC Data Mining and Knowledge Discovery Series. Vol. 20103384. pp. 43–55. doi:10.1201/b10274-6. ISBN   978-1-4398-0457-5.
  11. Cocea, Mihaela; Hershkovitz, Arnon; Baker, Ryan S.J.d. "The Impact of Off-task and Gaming Behaviors on Learning: Immediate or Aggregate?" (PDF). Penn Center for Learning Analytics.
  12. Beck, Joseph E.; Gong, Yue (2013). Lane, H. Chad; Yacef, Kalina; Mostow, Jack; Pavlik, Philip (eds.). "Wheel-Spinning: Students Who Fail to Master a Skill". Artificial Intelligence in Education. Lecture Notes in Computer Science. Berlin, Heidelberg: Springer. 7926: 431–440. doi:10.1007/978-3-642-39112-5_44. ISBN   978-3-642-39112-5.
  13. Milliron, Mark David; Malcolm, Laura; Kil, David (Winter 2014). "Insight and Action Analytics: Three Case Studies to Consider". Research & Practice in Assessment. 9: 70–89. ISSN   2161-4210.
  14. Heffernan, Neil. "TEACHER ASSIST". sites.google.com. Retrieved 2020-07-21.
  15. Saber, Dan (2018-06-15). "How A/B Testing Powers Pedagogy on Coursera". Medium. Retrieved 2020-07-21.
  16. Thanaporn, Patikorn; Heffernan, Neil. "Effectiveness of Crowd-Sourcing On-Demand Tutoring from Teachers in Online Learning Platforms". Google Docs. Retrieved 2020-07-21.
  17. "Programme". Learning @ Scale 2020. Retrieved 2020-07-21.
  18. https://github.com/CarnegieLearningWeb/UpGrade
  19. Fischer, Christian; Pardos, Zachary A.; Baker, Ryan Shaun; Williams, Joseph Jay; Smyth, Padhraic; Yu, Renzhe; Slater, Stefan; Baker, Rachel; Warschauer, Mark (2020-03-01). "Mining Big Data in Education: Affordances and Challenges". Review of Research in Education. 44 (1): 130–160. doi: 10.3102/0091732X20903304 . ISSN   0091-732X. S2CID   219091098.
  20. "Datashop". Pittsburgh Science of Learning Center Datashop. Retrieved 2020-07-21.
  21. "Intelligent Writing Tutor". Pittsburgh Science of Learning Center Datashop. Retrieved 2020-07-21.
  22. "Chinese tone study". Pittsburgh Science of Learning Center Datashop. Retrieved 2020-07-21.
  23. "2019 Data Science Bowl". Kaggle. Retrieved 2020-07-21.
  24. Baker, Ryan S.J.D. (2010). "Data mining for education" (PDF). International Encyclopedia of Education. 7: 112–118. doi:10.1016/B978-0-08-044894-7.01318-X.
  25. Kai, Shimin; Almeda, Ma Victoria; Baker, Ryan S.; Heffernan, Cristina; Heffernan, Neil (2018-06-30). "Decision Tree Modeling of Wheel-Spinning and Productive Persistence in Skill Builders". Journal of Educational Data Mining. 10 (1): 36–71. doi:10.5281/zenodo.3344810. ISSN   2157-2100.
  26. "ASSISTments: Free Education Tool for Teachers & Students". ASSISTments. Retrieved 2020-07-21.
  27. 1 2 Heffernan, Neil (2019-10-09). "Persistence Is Not Always Productive: How to Stop Students From Spinning Their Wheels - EdSurge News". EdSurge. Retrieved 2020-07-21.
  28. "Zach Pardos is Using Machine Learning to Broaden Pathways from Community College". UC Berkeley School of Information. 2019-09-30. Retrieved 2020-07-21.
  29. Hodges, Jill (2019-09-30). "This is Data Science: Using Machine Learning to Broaden Pathways from Community College: Computing, Data Science, and Society". UC Berkeley - Computing, Data Science, and Society. Retrieved 2020-07-21.
  30. Castleman, Benjamin; Bird, Kelli. "Personalized Pathways to Successful Community College Transfer: Leveraging machine learning strategies to customized transfer guidance and support". The Abdul Latif Jameel Poverty Action Lab (J-PAL). Retrieved 2020-07-21.
  31. Ginder, S.; Kelly-Reid, J.E.; Mann, F.B. (2017-12-28). "Enrollment and Employees in Postsecondary Institutions, Fall 2016; and Financial Statistics and Academic Libraries, Fiscal Year 2016: First Look (Provisional Data)". National Center for Employment Statistics. Retrieved 2020-07-21.
  32. Kakish, Kamal; Pollacia, Lissa (2018-04-17). "Adaptive Learning to Improve Student Success and Instructor Efficiency in Introductory Computing Course".{{cite journal}}: Cite journal requires |journal= (help)
  33. Delaney, Melissa (2019-05-31). "Universities Use AI to Boost Student Graduation Rates". Technology Solutions That Drive Education. Retrieved 2020-07-21.
  34. Kakish, Kamal; Pollacia, Lissa (2018-04-17). "Adaptive Learning to Improve Student Success and Instructor Efficiency in Introductory Computing Course".{{cite journal}}: Cite journal requires |journal= (help)
  35. Lee, Victor R. (2022-08-12). "Learning sciences and learning engineering: A natural or artificial distinction?". Journal of the Learning Sciences: 1–17. doi: 10.1080/10508406.2022.2100705 . ISSN   1050-8406. S2CID   251547280.
  36. Chandler, Chelsea; Kessler, Aaron; Fortman, Jacob (2020). "Language Matters: Exploring the Use of Figurative Language at ICICLE 2019". Proceedings of the 2019 Conference on Learning Engineering (PDF). IEEE IC Consortium on Learning Engineering.
  37. Baker, Ryan; Boser, Ulrich (2021). High-Leverage Opportunities for Learning Engineering (PDF) (Report).

Further reading

Mark Lieberman. "Learning Engineers Inch Toward the Spotlight". Inside Higher Education. September 26, 2018.

The Simon Initiative

International Consortium for Innovation and Collaboration in Learning Engineering