Assessment in computer-supported collaborative learning

Last updated

Assessment in computer-supported collaborative learning (CSCL) environments is a subject of interest to educators and researchers. The assessment tools utilized in computer-supported collaborative learning settings are used to measure groups' knowledge learning processes, the quality of groups' products and individuals' collaborative learning skills.

Contents

Perspective

Traditional assessment is equated with individualized exams and evaluations. However, in online collaborative learning, assessment requires a broader perspective as it encompasses the collaborative interactions using asynchronous and synchronous communications between group members. Assessment has been found to have a significant effect on CSCL by motivating learners through accountability and constructive feedback. It supports students in growing familiar with the course content through discourse and effectively encourages the participation of students. [1]

Four metaphors of CLCS

There are four metaphors of Assessment of (Computer-Supported) Collaborative Learning such as:

a.acquisition metaphor

b.the participation metaphor

c. the knowledge creation metaphor

d.a sociocultural-based group cognition metaphor.

The usage of the acquisition metaphor during the learning process is directly connected to the accumulation of knowledge in the students`mind. Learning is evaluated based on the individual gain.

The participation metaphor emphasis that the learning process does not only happen in an individual or isolated environment but in an interactive socio-cultural environment where the students participate and collaborate with each-other.

The knowledge creation metaphor focuses mostly on the collaborative activities. There are cases when the individual activities are stressed as well in terms of students as individuals who collaborate and interact actively during the learning process.

A socio-cultural-based group cognition metaphor refers to the individuals`participation during the learning process who share meaning, ideas and opinions to the other members of the group. [2]

Instructor's role in CSCL assessment

A paradigm shift occurs in the assessment of the products and processes in CSCL. In the traditional educational setting, final assessment is performed exclusively by the instructor. [3] (p. 232) In CSCL, the instructor designs, facilitates, direct instruction and provide technical guidance. [4] The participants take an active role in setting the standard criteria for assessing individual and group learning.

Intelligent Support For CSCL Assessment

The teacher`s assessment should include its function(summative or formative), type(peer assessment, portfolio`s, learning journals), format( rating scales,rubrics,feedback), focus(cognitive/social or motivational processes) and degree of student involvement(self,peer,co-.teacher assessment) are very essential.

Technology use in CSCL assessment

Various technologies may provide information that may be used for assessment purposes. For example, email, computer conferencing systems, bulletin boards, and hypermedia can be used as media for communication between group members in CSCL classrooms. [5] (p. 13). This technology can be used to keep a record of the students' interactions. This interaction record enables the instructor and students in assessing a learner's participation and collaboration with the group. [6] (p. 664).

Process assessment vs. product assessment

In CSCL settings, the relative value of the collaborative process and the product must be appropriately balanced. The pedagogical principle in CSCL environments is the assumption that knowledge is constructed through social negotiation and discussion with others. This social interaction encourages critical thinking and understanding. [7] (p. 309) When learning occurs through social interaction, knowledge building can also be observed through text analysis or discourse analysis. One way to assess knowledge construction in online collaborative settings is by collecting and analyzing the discursive events recorded and kept as history in computer conferencing systems in the form of virtual artifact. Transcripts can be used to determine the quantity and quality of interactions in negotiating meaning of the course material. [8] (p. 379) The instructor evaluates the messages exchanged by the students for meaningfulness and pertinence in regards to the target content.

Assessment of the process

Instructors can use discourse analysis to assess the students' learning of the collaborative process itself. The instructor can make use of the dialogue to look for cues of collaboration: support and respect in their criticisms, consideration of other teammates' opinions, negotiation of meaning, demonstration of mutual understanding, achievement of consensus, problem-solving, and time and task management issues. Another consideration in assessing students' collaborative skills, is the students' competence in online collaboration. As proficiency develops in progressive stages, the instructor can design the assessment to account for the students' developing competence in progressive steps throughout the online collaborative process. [8] (p. 378)

Assessment of the product

Collaborative products can be used to assess learners' knowledge acquisition. The products can be: a concept map, a report, a research paper, an essay, a wiki, a website, etc. Two assessable elements of collaborative product are the overall quality of the collaborative product and the contributions of each individual. [9] (p. 386) Each member of the group must participate in the collaborative activities. The products created by groups of students in CSCL contexts cannot be used as the sole evidence of knowledge acquisition. Although a quality product may be important, it is the process that generates the actual learning." [9] (p. 170)

Self and peer assessment

Self assessment in CSCL, students taking responsibility of learning by evaluating and judging aspects of their own learning activity. [10] In peer assessment, individuals take into account the quantity and quality of their own product or performance. [11] In CSCL, these two types of assessments are dynamically interrelated. The aim of self and peer assessments in CSCL is to improve students' learning, and develop individual learning skills as well as grading individual learning outcomes. [10] Self and peer assessment:

  1. drives students' learning;
  2. aids students in recognizing individual potential and sharing collaborative work effectively and efficiently;
  3. enables instructors to perceive the effect of individual learning through discourse;
  4. informs the instructor of the students' opinion change and skill improvement that occurs through adversity in the online collaborative process;
  5. develops students as retrospective thinkers. [12]

Group work assessment

Group work assessment in CSCL measures the quantity and quality of students' learning as a team. Group work or teamwork is a collaborative learning situation in which students share the task of developing a product presented at the end of the course. [13] Group work is not measured and interpreted independently but evaluated with other assessment tools, and plays a role in assisting learners' to reflect on their learning process. [13] Group work assessment:

  1. diagnoses the collaborative learning process and shows the instructor what works and what does not;
  2. identifies and corrects destructive conflict in collaborative learning;
  3. facilitates learners' reflection making the collaborative task effective and efficient;
  4. allows the instructor to monitor the collaborative learning processes and gather the information about individual performance and contributions to product quality.

E-portfolio assessment

E-portfolio can be used in assessment of CSCL activities by showing students' growth or proficiency in learning. Organizing information about individual students, the instructor keeps track of the student's learning process. These portfolios are managed online and are referred to as electronic portfolio, digital portfolio, or web-portfolio. In using E-portfolios in CSCL assessment an instructor determines:

  1. purpose;
  2. type;
  3. choice of items to include;
  4. guidelines or criteria;
  5. impact on the teacher and students;
  6. self-reflection component. [14]

Collaborative Learning

Collaborative Learning (CL) is a useful practice which is common at all levels of education. The latest developments in the field of Technology lead to a new discipline which is known as ComputerSupported Collaborative Learning (CSCL).The usage of computers during the Collaborative Learning (CL) established a shift in the methodology that the teachers used to have during their learning processes as well as an understanding of how group work affects individual and group cognition.

Assessment in Computer-supported collaborative learning (CSCL) environments is shaped by:

a.what is measured

b.its purpose.

The entire process distinguishes two important purposes:

1.formative

2.summative.

Summative assessment(assessment of learning) is described as individualistic and decontextualized which is realized in an isolated way from the learning process. It is used at the end of the course and its main purpose is to check the students`progression throughout the entire learning process. In other words how well the students performed. Summative assessment focuses mostly on the cognitive approaches which are used to educate the students. It is designed by the teacher who uses only a single performance score.

On the other hand,Formative assessment (assessment for learning) is contextualized and represents a picture of the learners` features. It is the most essential part of the learning process which is used by the teacher several times to evaluate the students` knowledge. Formative assessment is not used only at the end of the course. It comprises motivational, social and cognitive aspects of the learning process. Also, this type of assessment doesn`t use only a single score but creates a profile for each student. [15]

Notes

  1. ↑ Macdonald, (2003)
  2. ↑ Assessment of (Computer-Supported) Collaborative Learning
  3. ↑ McConnell (1999)
  4. ↑ Anderson, et al.2001
  5. ↑ Hoare, V (2007)
  6. ↑ Suther, D. (2007)
  7. ↑ Pozzi, Manca, Persico and Sarti (2007)
  8. 1 2 Macdonald (2003)
  9. 1 2 Pozzi et al. (2007)
  10. 1 2 Falchikov, (1986)
  11. ↑ Lee, (2006)
  12. ↑ Knight, (1995)
  13. 1 2 De Hoyos(2004)
  14. ↑ Butler & McMunn, (2006)
  15. ↑ Assessment of (Computer-Supported) Collaborative Learning

Related Research Articles

Instructional scaffolding is the support given to a student by an instructor throughout the learning process. This support is specifically tailored to each student; this instructional approach allows students to experience student-centered learning, which tends to facilitate more efficient learning than teacher-centered learning. This learning process promotes a deeper level of learning than many other common teaching strategies.

Situated learning is a theory that explains an individual's acquisition of professional skills and includes research on apprenticeship into how legitimate peripheral participation leads to membership in a community of practice. Situated learning "takes as its focus the relationship between learning and the social situation in which it occurs".

Student-centered learning Methods of teaching

Student-centered learning, also known as learner-centered education, broadly encompasses methods of teaching that shift the focus of instruction from the teacher to the student. In original usage, student-centered learning aims to develop learner autonomy and independence by putting responsibility for the learning path in the hands of students by imparting to them skills, and the basis on how to learn a specific subject and schemata required to measure up to the specific performance requirement. Student-centered instruction focuses on skills and practices that enable lifelong learning and independent problem-solving. Student-centered learning theory and practice are based on the constructivist learning theory that emphasizes the learner's critical role in constructing meaning from new information and prior experience.

Educational assessment or educational evaluation is the systematic process of documenting and using empirical data on the knowledge, skill, attitudes, and beliefs to refine programs and improve student learning. Assessment data can be obtained from directly examining student work to assess the achievement of learning outcomes or can be based on data from which one can make inferences about learning. Assessment is often used interchangeably with test, but not limited to tests. Assessment can focus on the individual learner, the learning community, a course, an academic program, the institution, or the educational system as a whole. The word 'assessment' came into use in an educational context after the Second World War.

Electronic assessment, also known as digital assessment, e-assessment, online assessment or computer-based assessment, is the use of information technology in assessment such as educational assessment, health assessment, psychiatric assessment, and psychological assessment. This covers a wide range of activity ranging from the use of a word processor for assignments to on-screen testing. Specific types of e-assessment include multiple choice, online/electronic submission, computerized adaptive testing such as the Frankfurt Adaptive Concentration Test, and computerized classification testing.

Collaborative learning is a situation in which two or more people learn or attempt to learn something together. Unlike individual learning, people engaged in collaborative learning capitalize on one another's resources and skills. More specifically, collaborative learning is based on the model that knowledge can be created within a population where members actively interact by sharing experiences and take on asymmetric roles. Put differently, collaborative learning refers to methodologies and environments in which learners engage in a common task where each individual depends on and is accountable to each other. These include both face-to-face conversations and computer discussions. Methods for examining collaborative learning processes include conversation analysis and statistical discourse analysis.

Educational technology is the combined use of computer hardware, software, and educational theory and practice to facilitate learning. When referred to with its abbreviation, edtech, it is often referring to the industry of companies that create educational technology.

Group cognition is a social, largely linguistic phenomenon whereby a group of people produce a sequence of utterances that performs a cognitive act. That is, if a similar sequence was uttered or thought by an individual it would be considered an act of cognition or thinking. The group can be a small group, such as 3–5 people talking together or working together online. The group can also be a larger collective, such as a classroom of students or a global community contributing asynchronously to an extended discourse on a problem or topic or to a knowledge repository like Wikipedia. The theory of group cognition is a postcognitivism philosophy, which considers a larger unit of analysis than an individual mind as a producer of cognitive activities such as creative problem solving.

Computer-supported collaborative learning (CSCL) is a pedagogical approach wherein learning takes place via social interaction using a computer or through the Internet. This kind of learning is characterized by the sharing and construction of knowledge among participants using technology as their primary means of communication or as a common resource. CSCL can be implemented in online and classroom learning environments and can take place synchronously or asynchronously.

Formative assessment, formative evaluation, formative feedback, or assessment for learning, including diagnostic testing, is a range of formal and informal assessment procedures conducted by teachers during the learning process in order to modify teaching and learning activities to improve student attainment. The goal of a formative assessment is to monitor student learning to provide ongoing feedback that can help students identify their strengths and weaknesses and target areas that need work. It also helps faculty recognize where students are struggling and address problems immediately. It typically involves qualitative feedback for both student and teacher that focuses on the details of content and performance. It is commonly contrasted with summative assessment, which seeks to monitor educational outcomes, often for purposes of external accountability.

The Stanford Learning Lab was an applied research organization that "carried out projects to improve the quality of teaching and learning in higher education through effective application of information technologies and the sciences of learning". It was created in 1997 on the recommendation of the Stanford University President's Commission on Technology in Teaching and Learning. Professors Larry Leifer and Larry Friedlander lead a staff of researchers, technologists, educators, and teaching and learning specialists who worked with Stanford faculty to enhance learning by students in their courses. The Stanford Learning Lab completed its work in the spring of 2002 and was followed by The Stanford Center for Innovations in Learning (SCIL), which inherited core capabilities in technology development, educational program evaluation, and learning design and continued to perform research in these areas.

A Knowledge Building Community (KBC) is a community in which the primary goal is knowledge creation rather than the construction of specific products or the completion of tasks. This notion is fundamental in Knowledge building theory. If knowledge is not realized for a community then we do not have knowledge building. Examples of KBCs are

An instructional simulation, also called an educational simulation, is a simulation of some type of reality but which also includes instructional elements that help a learner explore, navigate or obtain more information about that system or environment that cannot generally be acquired from mere experimentation. Instructional simulations are typically goal oriented and focus learners on specific facts, concepts, or applications of the system or environment. Today, most universities make lifelong learning possible by offering a virtual learning environment (VLE). Not only can users access learning at different times in their lives, but they can also immerse themselves in learning without physically moving to a learning facility, or interact face to face with an instructor in real time. Such VLEs vary widely in interactivity and scope. For example, there are virtual classes, virtual labs, virtual programs, virtual library, virtual training, etc. Researchers have classified VLE in 4 types:

Intercultural communicative competence in computer-supported collaborative learning is the application of computer-supported collaborative learning (CSCL) to provide intercultural communicative competence (ICC).

Peer feedback is a practice where feedback is given by one student to another. Peer feedback provides students opportunities to learn from each other. After students finish a writing assignment but before the assignment is handed in to the instructor for a grade, the students have to work together to check each other's work and give comments to the peer partner. Comments from peers are called as peer feedback. Peer feedback can be in the form of corrections, opinions, suggestions, or ideas to each other. Ideally, peer feedback is a two-way process in which one cooperates with the other.

Competency-based learning or competency-based education is a framework for teaching and assessment of learning. It is also described as a type of education based on predetermined "competencies," which focuses on outcomes and real-world performance. Competency-based learning is sometimes presented as an alternative to traditional methods of assessment in education.

Differentiated instruction Framework or philosophy for effective teaching

Differentiated instruction and assessment, also known as differentiated learning or, in education, simply, differentiation, is a framework or philosophy for effective teaching that involves providing all students within their diverse classroom community of learners a range of different avenues for understanding new information in terms of: acquiring content; processing, constructing, or making sense of ideas; and developing teaching materials and assessment measures so that all students within a classroom can learn effectively, regardless of differences in their ability. Differentiated instruction, according to Carol Ann Tomlinson, is the process of "ensuring that what a student learns, how he or she learns it, and how the student demonstrates what he or she has learned is a match for that student's readiness level, interests, and preferred mode of learning." According to Boelens et al. (2018), differentiation can be on two different levels: the administration level and the classroom level. The administration level takes the socioeconomic status and gender of students into consideration. At the classroom level, differentiation revolves around content, processing, product, and effects. On the content level, teachers adapt what they are teaching to meet the needs of students. This can mean making content more challenging or simplified for students based on their levels. The process of learning can be differentiated as well. Teachers may choose to teach individually at a time, assign problems to small groups, partners or the whole group depending on the needs of the students. By differentiating product, teachers decide how students will present what they have learnt. This may take the form of videos, graphic organizers, photo presentations, writing, and oral presentations. All these take place in a safe classroom environment where students feel respected and valued—effects.

Mobile computer-supported collaborative learning may have different meanings depending on the context in which it is applied. Mobile CSCL includes any in-class and out-of-class use of handheld mobile devices such as cell phones, smart phones, and personal digital assistants (PDAs) to enable collaborative learning.

A virtual learning environment (VLE) in educational technology is a web-based platform for the digital aspects of courses of study, usually within educational institutions. They present resources, activities, and interactions within a course structure and provide for the different stages of assessment. VLEs also usually report on participation; and have some level of integration with other institutional systems.

In education, authentic learning is an instructional approach that allows students to explore, discuss, and meaningfully construct concepts and relationships in contexts that involve real-world problems and projects that are relevant to the learner. It refers to a "wide variety of educational and instructional techniques focused on connecting what students are taught in school to real-world issues, problems, and applications. The basic idea is that students are more likely to be interested in what they are learning, more motivated to learn new concepts and skills, and better prepared to succeed in college, careers, and adulthood if what they are learning mirrors real-life contexts, equips them with practical and useful skills, and addresses topics that are relevant and applicable to their lives outside of school."

References

This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.