Instructional manipulation check

Last updated
Blue-dot task, a check designed to detect participants who fail to read the instructions. After Oppenheimer et al. BlueDotTask.pdf
Blue-dot task, a check designed to detect participants who fail to read the instructions. After Oppenheimer et al.

An instructional manipulation check , often abbreviated IMC, is a special kind of question inserted in a questionnaire among the regular questions, designed to check whether respondents are paying attention to the instructions. [2] Discarding responses by participants who fail to read the instructions increases the signal-to-noise ratio and can thereby increase the statistical power of an experiment. The tool was developed by Oppenheimer et al. [1]

Eliminating random responses this way before performing statistical hypothesis testing may be considered a legitimate form of data manipulation, but should be duly mentioned in publications reporting on the outcome of the experiment in question. [3]

Blue-dot task

Among several forms an IMC can take, a popular one is the so-called blue-dot task, [3] suitable for on-line questionnaires. A number of larger blue circles are arranged according to a Likert scale from (say) "very rarely" to "very frequently". Participants who ignore the instructions and merely want to finish the task will just click any one of these circles. The instructions, however, ask the participants to ignore the larger circles and instead click a little blue dot at the bottom of the screen. Oppenheimer et al. report that in a large sample of undergraduate participants, approximately 7% failed this task. [1]

Related Research Articles

<span class="mw-page-title-main">Design of experiments</span> Design of tasks

The design of experiments, also known as experiment design or experimental design, is the design of any task that aims to describe and explain the variation of information under conditions that are hypothesized to reflect the variation. The term is generally associated with experiments in which the design introduces conditions that directly affect the variation, but may also refer to the design of quasi-experiments, in which natural conditions that influence the variation are selected for observation.

Questionnaire construction refers to the design of a questionnaire to gather statistically useful information about a given topic. When properly constructed and responsibly administered, questionnaires can provide valuable data about any given subject.

Survey methodology is "the study of survey methods". As a field of applied statistics concentrating on human-research surveys, survey methodology studies the sampling of individual units from a population and associated techniques of survey data collection, such as questionnaire construction and methods for improving the number and accuracy of responses to surveys. Survey methodology targets instruments or procedures that ask one or more questions that may or may not be answered.

The representativeness heuristic is used when making judgments about the probability of an event being representional in character and essence of known prototypical event. It is one of a group of heuristics proposed by psychologists Amos Tversky and Daniel Kahneman in the early 1970s as "the degree to which [an event] (i) is similar in essential characteristics to its parent population, and (ii) reflects the salient features of the process by which it is generated". The representativeness heuristic works by comparing an event to a prototype or stereotype that we already have in mind. For example, if we see a person who is dressed in eccentric clothes and reading a poetry book, we might be more likely to think that they are a poet than an accountant. This is because the person's appearance and behavior are more representative of the stereotype of a poet than an accountant.

In psychology, the Asch conformity experiments or the Asch paradigm were a series of studies directed by Solomon Asch studying if and how individuals yielded to or defied a majority group and the effect of such influences on beliefs and opinions.

IMC may refer to:

<span class="mw-page-title-main">Wason selection task</span> Test in the study of deductive reasoning

The Wason selection task is a logic puzzle devised by Peter Cathcart Wason in 1966. It is one of the most famous tasks in the study of deductive reasoning. An example of the puzzle is:

You are shown a set of four cards placed on a table, each of which has a number on one side and a color on the other. The visible faces of the cards show 3, 8, blue and red. Which card(s) must you turn over in order to test that if a card shows an even number on one face, then its opposite face is blue?

<span class="mw-page-title-main">Response bias</span> Type of bias

Response bias is a general term for a wide range of tendencies for participants to respond inaccurately or falsely to questions. These biases are prevalent in research involving participant self-report, such as structured interviews or surveys. Response biases can have a large impact on the validity of questionnaires or surveys.

Deindividuation is a concept in social psychology that is generally thought of as the loss of self-awareness in groups, although this is a matter of contention. For the social psychologist, the level of analysis is the individual in the context of a social situation. As such, social psychologists emphasize the role of internal psychological processes. Other social scientists, such as sociologists, are more concerned with broad social, economic, political, and historical factors that influence events in a given society.

Prospective memory is a form of memory that involves remembering to perform a planned action or recall a planned intention at some future point in time. Prospective memory tasks are common in daily life and range from the relatively simple to extreme life-or-death situations. Examples of simple tasks include remembering to put the toothpaste cap back on, remembering to reply to an email, or remembering to return a rented movie. Examples of highly important situations include a patient remembering to take medication or a pilot remembering to perform specific safety procedures during a flight.

A self-report study is a type of survey, questionnaire, or poll in which respondents read the question and select a response by themselves without any outside interference. A self-report is any method which involves asking a participant about their feelings, attitudes, beliefs and so on. Examples of self-reports are questionnaires and interviews; self-reports are often used as a way of gaining participants' responses in observational studies and experiments.

The door-in-the-face technique is a compliance method commonly studied in social psychology. The persuader attempts to convince the respondent to comply by making a large request that the respondent will most likely turn down, much like a metaphorical slamming of a door in the persuader's face. The respondent is then more likely to agree to a second, more reasonable request, than if that same request is made in isolation. The DITF technique can be contrasted with the foot-in-the-door (FITD) technique, in which a persuader begins with a small request and gradually increases the demands of each request. Both the FITD and DITF techniques increase the likelihood a respondent will agree to the second request.

Computer-assisted web interviewing (CAWI) is an Internet surveying technique in which the interviewee follows a script provided in a website. The questionnaires are made in a program for creating web interviews. The program allows for the questionnaire to contain pictures, audio and video clips, links to different web pages, etc. The website is able to customize the flow of the questionnaire based on the answers provided, as well as information already known about the participant. It is considered to be a cheaper way of surveying since one doesn't need to use people to hold surveys unlike computer-assisted telephone interviewing. With the increasing use of the Internet, online questionnaires have become a popular way of collecting information. The design of an online questionnaire has a dramatic effect on the quality of data gathered. There are many factors in designing an online questionnaire; guidelines, available question formats, administration, quality and ethic issues should be reviewed. Online questionnaires should be seen as a sub-set of a wider-range of online research methods.

Conformity is the act of matching attitudes, beliefs, and behaviors to group norms, politics or being like-minded. Norms are implicit, specific rules, guidance shared by a group of individuals, that guide their interactions with others. People often choose to conform to society rather than to pursue personal desires – because it is often easier to follow the path others have made already, rather than forging a new one. Thus, conformity is sometimes a product of group communication. This tendency to conform occurs in small groups and/or in society as a whole and may result from subtle unconscious influences, or from direct and overt social pressure. Conformity can occur in the presence of others, or when an individual is alone. For example, people tend to follow social norms when eating or when watching television, even if alone.

Psychological research refers to research that psychologists conduct for systematic study and for analysis of the experiences and behaviors of individuals or groups. Their research can have educational, occupational and clinical applications.

Manipulation check is a term in experimental research in the social sciences which refers to certain kinds of secondary evaluations of an experiment.

The N200, or N2, is an event-related potential (ERP) component. An ERP can be monitored using a non-invasive electroencephalography (EEG) cap that is fitted over the scalp on human subjects. An EEG cap allows researchers and clinicians to monitor the minute electrical activity that reaches the surface of the scalp from post-synaptic potentials in neurons, which fluctuate in relation to cognitive processing. EEG provides millisecond-level temporal resolution and is therefore known as one of the most direct measures of covert mental operations in the brain. The N200 in particular is a negative-going wave that peaks 200-350ms post-stimulus and is found primarily over anterior scalp sites. Past research focused on the N200 as a mismatch detector, but it has also been found to reflect executive cognitive control functions, and has recently been used in the study of language.

<span class="mw-page-title-main">P3b</span>

The P3b is a subcomponent of the P300, an event-related potential (ERP) component that can be observed in human scalp recordings of brain electrical activity. The P3b is a positive-going amplitude peaking at around 300 ms, though the peak will vary in latency from 250 to 500 ms or later depending upon the task and on the individual subject response. Amplitudes are typically highest on the scalp over parietal brain areas.

Literature Circles in EFL are teacher accompanied classroom discussion groups among English as a foreign language learners, who regularly get together in class to speak about and share their ideas, and comment on others' interpretations about the previously determined section of a graded reader in English, using their 'role-sheets' and 'student journals' in collaboration with each other.

<span class="mw-page-title-main">Power posing</span> Controversial self-improvement technique

Power posing is a controversial self-improvement technique or "life hack" in which people stand in a posture that they mentally associate with being powerful, in the hope of feeling more confident and behaving more assertively. Though the underlying science is disputed, its promoters continue to argue that people can foster positive life changes simply by assuming a "powerful" or "expansive" posture for a few minutes before an interaction in which confidence is needed. One popular image of the technique in practice is that of candidates "lock[ing] themselves in bathroom stalls before job interviews to make victory V's with their arms."

References

  1. 1 2 3 Daniel M. Oppenheimer; Tom Meyvis; Nicolas Davidenko (July 2009). "Instructional manipulation checks: Detecting satisficing to increase statistical power". Journal of Experimental Social Psychology . 45 (4): 867–872. doi:10.1016/j.jesp.2009.03.009.
  2. Bernard E. Whitley, Jr.; Mary E. Kite (2012). Principles of Research in Behavioral Science (Third Edition). Routledge. pp. 248–249. ISBN   978-1-136-19658-4.
  3. 1 2 Wolfgang Stroebe; Tom Postmes; Russell Spears (2012). "Scientific Misconduct and the Myth of Self-correction in Science". Perspectives on Psychological Science . 7 (6). Note 2. doi: 10.1177/1745691612460687 . PMID   26168129.