Dr. Fox effect

Last updated

The Dr. Fox effect is a correlation observed between teacher expressiveness, content coverage, student evaluation and student achievement. [1] [2] This effect also allows insight to other related effects and relationships between student achievement and evaluations of the teacher.

Contents

Experiment

The original experiment was performed at the University of Southern California School of Medicine in 1970 in which two speakers gave lectures to a classroom of MDs and PhDs (psychiatrists and psychologists) on a meaningless topic. The topic, "Mathematical Game Theory as Applied to Physician Education", was chosen to eliminate any chances the students being lectured would know something about the actual subject. Students were divided into two separate classrooms; one classroom would be lectured by an actual scientist and the other by an actor, Michael Fox, who was given the identity "Dr. Myron L. Fox", a graduate of Albert Einstein College of Medicine.

In the first half of the study the actor was instructed to teach his material in a more monotone and inexpressive voice. This lecture was then compared to the control lecture by the scientist. After the lectures, the students were tested on the information they had learned. The students who attended the lecture taught by the scientist learned more about the material and performed better on the examination.

However, when both the actor and the scientist presented their material in an engaging, expressive, and enthusiastic manner, the students rated Dr. Fox just as positively as the genuine professor. This lack of correlation between content-coverage and ratings resulting from conditions of strong expressiveness became known as "the Dr. Fox effect". [3]

In a critique of student evaluations of teaching, professor of law Deborah Jones Merritt summarized the Dr. Fox effect as it was observed in the first experiments: "The experimenters created a meaningless lecture and coached the actor to deliver it 'with an excessive use of double-talk, neologisms, non sequiturs, and contradictory statements.' At the same time, the researchers encouraged the actor to adopt a lively demeanor, convey warmth toward his audience, and intersperse his nonsensical comments with humor. The actor fooled not just one, but three separate audiences of professional and graduate students. Despite the emptiness of his lecture, fifty-five psychiatrists, psychologists, educators, graduate students, and other professionals produced evaluations of Dr. Fox that were overwhelmingly positive. The disturbing feature of the Dr. Fox study, as the experimenters noted, is that Fox's nonverbal behaviors so completely masked a meaningless, jargon-filled, and confused presentation." [4]

A 1980 study found that prestige of research could even be increased by a confounding writing style, with research competency being correlated positively to reading difficulty. [5] Anecdotal evidence has since been reported by researchers. [6]

Subsequent research

Study of Air Force Academy

In this study, students were assigned randomly to professors so that the results would not be skewed by better students enrolling with better professors. These professors were then given all the same syllabi, curriculum levels, and final examinations so the difficulty was even for all groups. There was also a follow-up course given to the students to test the value of fundamental learning that the students received. These professors taught introductory calculus to a group of more than 10,000 students to achieve the proper information.

When the evaluations were processed, the professors who were less experienced and less qualified had the best evaluations and best performances on the final examination. However the students who attended the examinations given by the more qualified and experienced professors did best on the follow-up examination. This created speculation that the professors who were more experienced taught the material in a more general manner to produce a more fundamental understanding. This became obvious as a result of the follow-up examinations.

The results showed that the professors who instilled a more fundamental meaning of the material appeared worse on the initial examination and evaluations, but eventually obtained better academic results. This finding renders questionable the validity of student evaluations. [7]

Eyal Peer and Elisha Babad

Criticisms of the original study include the experiment's lack of a control group, the use of a "Yes/No" scale, and lack of measurement evaluating learning among the participants. In a study published in the Journal of Educational Psychology in 2014, researchers Eyal Peer of Carnegie Mellon University and Elisha Babad of Hebrew University of Jerusalem recreated the original 1973 study taking these criticisms into consideration. [8]

Through their research, they found that the Dr. Fox effect was still present despite the manipulations they added. Manipulations included the use of a more in-depth questionnaire, removal of the first thirty seconds of video describing the credentials of the lecturer, and a warning at the beginning of the questionnaire to ensure that participants responded honestly.

However, the researchers found that although the students with a charismatic teacher enjoyed the lecture more, they reported that they had not actually learned anything new. This is in contrast to the original study, which argued that people attending the lecture actually believed they were learning new material. From their research they were able to reason that an enthusiastic speaker may entertain an audience, but much more is required to be a successful teacher. [9]

Halo effect

The halo effect shares similar qualities to those of the Dr. Fox effect in relation to student evaluations of teachers. The halo effect is a cognitive bias in which our general impression of a person influences how we feel and think about their character. [10] For example, attractive-looking people create a halo effect in which we perceive them as kind, smart or successful, but it may not be true because their attractive appearance interferes with our judgment of their performance capabilities. In one study examining halo effect on student evaluation, there was a better rating for teachers who provided more nonverbal immediacy, but the study also found out that a better evaluation of teachers was related to a greater halo effect. [10] In the Dr. Fox effect study, a similar effect was found when Dr. Fox presented the lecture in an expressive manner.

Effects of instructor characteristics on student evaluations

From the experiment of Dr. Fox effect, the expressiveness of a teacher when delivering lecture material can affect student evaluation of the teacher. Other than that, individual differences among teachers such as personality, popularity, lecture fluency, non verbal behavior, and attractiveness can also affect student evaluation of teachers.

Personality

Instructor personality is one factor that has been shown to affect course evaluations. [11] For example, in one study examining the big five personality dimensions, teachers who were perceived to be more extroverted, open, agreeable, and conscientious were evaluated more favorably, whereas teachers who were perceived to be more neurotic were evaluated less favorably. [12] Further, Murray and colleagues suggested that the effects of instructor personality on student evaluations of instructor vary across the type of course. [13] Although some traits, like a teacher's leadership, consistently predicted course evaluations, other traits varied across type of course. For example, a teacher's sociability positively predicted course evaluations in introductory psychology courses, but not graduate psychology courses, whereas the ambition of an instructor showed the opposite relationship – predicting evaluations of graduate, but not introductory psychology courses. [13]

Charisma

The charisma or popularity of a teacher might also be a factor that contributes to teacher effectiveness and teaching quality. In one study that examined the assessment of charisma as a factor in effective teaching, charismatic teachers tended to receive good student evaluation and were also perceived as being more funny, helpful, encouraging, knowledgeable, sympathetic and other traits that are considered charismatic. [14] Besides that, the study of Yun-Chen Huang and Shu-Hui Lin shows that different teaching methods can also increase the charisma rating of a teacher. [14] For example, teachers that are perceived to be more charismatic offer explanations, answer questions by students, vary their teaching methods, and are also interested in and express concern for their students and their learning progress. [14] Charisma of teachers is becoming more recognized recently with the introduction of an instrument to measure charisma, called "Inventory of Teaching Charisma in the College Classroom" (ICCT). [14]

Lecture fluency

The fluency of a lecturer when delivering teaching materials can contribute to the effectiveness of student evaluation of a teacher. According to the study of Shana K. Carpenter and colleague that examine the effect of lecture fluency on learning perception, a lecture that is considered to be fluent suggested that the teacher stood upright and straight, maintained eye contact, and spoke fluidly without notes whereas reasons for considering a lecture disfluent include teachers that are slumped and stand with a bent back, look away, and speak haltingly with notes. [15] Furthermore, the study also shows that fluent teachers that are prepared and well organized will receive better ratings than a disfluent teacher that is unprepared and disorganized in student evaluations of the teacher. [15] Although the same study of lecture fluency on learning perception successfully shows that lecture fluency will increase the student rating of a teacher, further interpretation of the results suggests that lecture fluency biases the students' perceptions of their own learning because lecture fluency did not actually affect the amount of information learned. [15]

Non-verbal behavior

Non verbal behavior or non verbal communication is a series of wordless behavior that is projected by the speaker to the listener. Common examples of non verbal behavior include eye contact, smile, facial expression, distance between speaker and listener and any other wordless behavior that can communicate information between people. According to Virginia P. Richmond on 'Teacher Nonverbal Immediacy', teachers that show more positive nonverbal behavior increase the immediacy between students and also contribute to higher student rating. [16] For instance, teachers with better rating by students were more likely to express non verbal behavior like smiling, walking around, head nodding and touching upper torsos whereas low rating teachers were more likely to touch their head, head shaking rather than nodding, and sitting on a chair. [16] One study by Ambady and Rosenthal shows that subjects were able to form accurate judgement of impression by just watching short video clips of teachers providing non verbal behavior. [17] An example from the study, participants were able to form accurate impressions of the teachers by just watching 10-second, 5-second, and 2-second lengths of short video clips about teachers walking to classrooms. Ambady research provides support that nonverbal behavior has a strong influence on impression formation of teachers.

Attire and appearance

The way that teachers present themselves or the attire they wear when teaching lectures can be a factor on student evaluation of teachers. According to Virginia P. Richmond, the attire of a teacher influences the way that students perceive their teacher. [16] For example, teachers are perceived to be more competent, organized, prepared and knowledgeable when they dress formally with a coat and tie but they are also presumed to be not receptive to students' needs and low in student–teacher interaction. [16] However, when teachers dress casually with collar-button shirts and jeans, they are perceived to be more friendly, flexible, fair and open but not so competent. [16] From another study about predicting teacher evaluation from physical appearance, attire and appearance may be a factor influencing the rating by students but the effect will somewhat diminish when other more important and significant information is provided. [17] For instance, the study found out that unattractive voices dilute the effects of attractive faces of teachers. [17]

Background of Dr. Fox experiment

Authors

Actor

The actor portraying Dr. Fox was given one day to prepare for the lecture and was coached by the authors to present the lecture with "an excessive use of double-talk, neologisms, non sequiturs, and contradicting statements." [18]

Motivation

There are previous reports and studies that show that the personality of a teacher/lecturer is one of the most important variables when it comes to evaluating the teacher's effectiveness. Getzels and Jackson, with support from Wallen and Travers, expressed that the personality and patterns of teacher behavior and methods presented represent the main forces for the most significant variable in evaluating the teacher's effectiveness. Goffman explains that the receptivity of the audience is strongly influenced by the person introducing the lecture, the quality of the introduction, and the speaker's involuntary expressive behavior, which becomes a decisive factor in how the audience responds to the conveying information. One study which looked at the student perceptions of educators from 7th to 12th grade and reported that the students regarded "teacher charisma or popularity" as the most important characteristic when rating teachers.

If the charisma or popularity of the teachers have such an effect on their effectiveness ratings by junior high and high school students, would the ratings be influenced in the same way with a group of well-trained professional educators in a learning situation? So what the authors were looking to see is that if a sufficiently impressive lecture was given, would it result in an experienced group of educators participating in a new learning situation feeling satisfied that they had learned from the lecture despite irrelevant, conflicting, and meaningless content conveyed by the lecturer. [1]

See also

Related Research Articles

<span class="mw-page-title-main">Body language</span> Type of nonverbal communication

Body language is a type of communication in which physical behaviors, as opposed to words, are used to express or convey information. Such behavior includes facial expressions, body posture, gestures, eye movement, touch and the use of space. The term body language is usually applied in regard to people but may also be applied to animals. The study of body language is also known as kinesics. Although body language is an important part of communication, most of it happens without conscious awareness.

<span class="mw-page-title-main">Nonverbal communication</span> Interpersonal communication through wordless (mostly visual) cues

Nonverbal communication (NVC) is the transmission of messages or signals through a nonverbal platform such as eye contact (oculesics), body language (kinesics), social distance (proxemics), touch (haptics), voice (paralanguage), physical environments/appearance, and use of objects. When communicating, we utilize nonverbal channels as means to convey different messages or signals, whereas others can interpret these message. The study of nonverbal communication started in 1872 with the publication of The Expression of the Emotions in Man and Animals by Charles Darwin. Darwin began to study nonverbal communication as he noticed the interactions between animals such as lions, tigers, dogs etc. and realized they also communicated by gestures and expressions. For the first time, nonverbal communication was studied and its relevance questioned. Today, scholars argue that nonverbal communication can convey more meaning than verbal communication.

<span class="mw-page-title-main">Credibility</span> Believability of a source or message

Credibility comprises the objective and subjective components of the believability of a source or message. Credibility dates back to Aristotle theory of Rhetoric. Aristotle defines rhetoric as the ability to see what is possibly persuasive in every situation. He divided the means of persuasion into three categories, namely Ethos, Pathos, and Logos, which he believed have the capacity to influence the receiver of a message. According to Aristotle, the term "Ethos" deals with the character of the speaker. The intent of the speaker is to appear credible. In fact, the speaker's ethos is a rhetorical strategy employed by an orator whose purpose is to "inspire trust in his audience." Credibility has two key components: trustworthiness and expertise, which both have objective and subjective components. Trustworthiness is based more on subjective factors, but can include objective measurements such as established reliability. Expertise can be similarly subjectively perceived, but also includes relatively objective characteristics of the source or message. Secondary components of credibility include source dynamism (charisma) and physical attractiveness.

<span class="mw-page-title-main">Lecture</span> Oral presentation intended to present information or teach people about a particular subject

A lecture is an oral presentation intended to present information or teach people about a particular subject, for example by a university or college teacher. Lectures are used to convey critical information, history, background, theories, and equations. A politician's speech, a minister's sermon, or even a business person's sales presentation may be similar in form to a lecture. Usually the lecturer will stand at the front of the room and recite information relevant to the lecture's content.

The halo effect is the tendency for positive or negative impressions of a person, company, country, brand, or product in one area to positively or negatively influence one's opinion or feelings. Halo effect is "the name given to the phenomenon whereby evaluators tend to be influenced by their previous judgments of performance or personality." The halo effect can be a cognitive bias which can possibly prevent someone from accepting a person, a product or a brand based on the idea of an unfounded belief on what is good or bad. A halo effect may not be a bias if there is a good reason to think attributes are correlated. For instance, if a student has a good grade in one subject it would not be an error to think they are likely to have good grades in other subjects.

Expectancy violations theory (EVT) is a theory of communication that analyzes how individuals respond to unanticipated violations of social norms and expectations. The theory was proposed by Judee K. Burgoon in the late 1970s and continued through the 1980s and 1990s as "nonverbal expectancy violations theory", based on Burgoon's research studying proxemics. Burgoon's work initially analyzed individuals' allowances and expectations of personal distance and how responses to personal distance violations were influenced by the level of liking and relationship to the violators. The theory was later changed to its current name when other researchers began to focus on violations of social behavior expectations beyond nonverbal communication.

Social perception is the study of how people form impressions of and make inferences about other people as sovereign personalities. Social perception refers to identifying and utilizing social cues to make judgments about social roles, rules, relationships, context, or the characteristics of others. This domain also includes social knowledge, which refers to one's knowledge of social roles, norms, and schemas surrounding social situations and interactions. People learn about others' feelings and emotions by picking up information they gather from physical appearance, verbal, and nonverbal communication. Facial expressions, tone of voice, hand gestures, and body position or movement are a few examples of ways people communicate without words. A real-world example of social perception is understanding that others disagree with what one said when one sees them roll their eyes. There are four main components of social perception: observation, attribution, integration, and confirmation.

In social psychology, illusory superiority is a cognitive bias wherein a person overestimates their own qualities and abilities compared to other people. Illusory superiority is one of many positive illusions, relating to the self, that are evident in the study of intelligence, the effective performance of tasks and tests, and the possession of desirable personal characteristics and personality traits. Overestimation of abilities compared to an objective measure is known as the overconfidence effect.

Thin-slicing is a term used in psychology and philosophy to describe the ability to find patterns in events based only on "thin slices", or narrow windows, of experience. The term refers to the process of making very quick inferences about the state, characteristics or details of an individual or situation with minimal amounts of information. Research has found that brief judgments based on thin-slicing are similar to those judgments based on much more information. Judgments based on thin-slicing can be as accurate, or even more so, than judgments based on much more information.

Impression formation in social psychology refers to the processes by which different pieces of knowledge about another are combined into a global or summary impression. Social psychologist Solomon Asch is credited with the seminal research on impression formation and conducted research on how individuals integrate information about personality traits. Two major theories have been proposed to explain how this process of integration takes place. The Gestalt approach views the formation of a general impression as the sum of several interrelated impressions. As an individual seeks to form a coherent and meaningful impression of another individual, previous impressions significantly influence the interpretation of subsequent information. In contrast to the Gestalt approach, the cognitive algebra approach asserts that individuals' experiences are combined with previous evaluations to form a constantly changing impression of a person. A related area to impression formation is the study of person perception, making dispositional attributions, and then adjusting those inferences based on the information available.

<span class="mw-page-title-main">Evidence-based education</span> Paradigm of the education field

Evidence-based education (EBE) is the principle that education practices should be based on the best available scientific evidence, rather than tradition, personal judgement, or other influences. Evidence-based education is related to evidence-based teaching, evidence-based learning, and school effectiveness research. For example, research has shown that spaced repetition "leads to more robust memory formation than massed training does, which involves short or no intervals".

Non-verbal leakage is a form of non-verbal behavior that occurs when a person verbalizes one thing, but their body language indicates another, common forms of which include facial movements and hand-to-face gestures. The term "non-verbal leakage" got its origin in literature in 1968, leading to many subsequent studies on the topic throughout the 1970s, with related studies continuing today.

Processing fluency is the ease with which information is processed. Perceptual fluency is the ease of processing stimuli based on manipulations to perceptual quality. Retrieval fluency is the ease with which information can be retrieved from memory.

In psychology, a first impression is the event when one person first encounters another person and forms a mental image of that person. Impression accuracy varies depending on the observer and the target being observed. First impressions are based on a wide range of characteristics: age, race, culture, language, gender, physical appearance, accent, posture, voice, number of people present, economic status, and time allowed to process. The first impressions individuals give to others could greatly influence how they are treated and viewed in many contexts of everyday life.

The rhyme-as-reason effect, or Eaton–Rosen phenomenon, is a cognitive bias whereupon a saying or aphorism is judged as more accurate or truthful when it is rewritten to rhyme.

Affiliative conflict theory (ACT) is a social psychological approach that encompasses interpersonal communication and has a background in nonverbal communication. This theory postulates that "people have competing needs or desires for intimacy and autonomy". In any relationship, people will negotiate and try to rationalize why they are acting the way they are in order to maintain a comfortable level of intimacy.

Mark G. Frank is a communication professor and department chair, and an internationally recognized expert on human nonverbal communication, emotion, and deception. He conducts research and does training on micro expressions of emotion and of the face. His research studies include other nonverbal indicators of deception throughout the rest of the body. He is the Director of the Communication Science Center research laboratory that is located on the North Campus of the University at Buffalo. Under his guidance, a team of graduate researchers conduct experiments and studies for private and government entities. Frank uses his expertise in communication and psychology to assist law enforcement agencies in monitoring both verbal and nonverbal communication.

James Arthur Bayton was an American psychologist. He conducted research in areas of personality, race, social issues, and consumer psychology.

Social vision is a sub-topic of social psychology that investigates the ways from which individuals extract information and perceive others using their vision alone. The field of social vision is highly interdisciplinary and located at the nexus of social psychology, communication studies, and vision science.

<span class="mw-page-title-main">Nalini Ambady</span> American social psychologist of Indian descent

Nalini Ambady was an Indian-American social psychologist and a leading expert on nonverbal behavior and interpersonal perception. She was born in Calcutta, India and earned her bachelor’s degree at Lady Shri Ram College for women, Delhi University. She furthered her education by moving to the United States for her master’s degree in psychology, from the College of William and Mary, and later received her PhD in social psychology from Harvard. While completing her research at Harvard, she met her husband Raj Marphatia, who was studying at Harvard Law school.

References

  1. 1 2 3 Naftulin, DH; Ware, JE Jr; Donnelly, FA (1973). "The Doctor Fox Lecture: a paradigm of educational seduction". Journal of Medical Education. 48 (7): 630–635. doi: 10.1097/00001888-197307000-00003 . ISSN   0022-2577. PMID   4708420. Archived from the original on February 9, 2008.
  2. ↑ Williams, Reed G.; Ware, John E. (1976). "Validity of student ratings of instruction under different incentive conditions: A further study of the Dr. Fox effect". Journal of Educational Psychology . American Psychological Association (APA). 68 (1): 48–56. doi:10.1037/0022-0663.68.1.48. ISSN   0022-0663.
  3. ↑ Ware Jr, J. E; Williams, R. G (1975). "The Dr. Fox effect: a study of lecturer effectiveness and ratings of instruction". Journal of Medical Education. 50 (2): 149–56. doi: 10.1097/00001888-197502000-00006 . PMID   1120118.
  4. ↑ Merritt, Deborah J. (2008). "Bias, the Brain, and Student Evaluations of Teaching". St. John's Law Review . 82 (1): 235–287.
  5. ↑ Armstrong, J. Scott (1980). "Unintelligible Management Research and Academic Prestige". INFORMS Journal on Applied Analytics . Institute for Operations Research and the Management Sciences. 10 (2): 80–86. doi:10.1287/inte.10.2.80. ISSN   0092-2102.
  6. ↑ Hakes, David R. (2009). "Confession of an Economist: Writing to Impress Rather than Inform". Econ Journal Watch . 6 (3): 349–351. Retrieved October 13, 2015.
  7. ↑ Kornell, Nate (May 31, 2013). "Do the Best Professors Get the Worst Ratings?". Psychology Today . Sussex Publishers, LLC.
  8. ↑ Peer, Eyal; Babad, Elisha (2014). "The Doctor Fox research (1973) rerevisited: 'Educational seduction' ruled out". Journal of Educational Psychology. American Psychological Association. 106 (1): 36–45. doi:10.1037/a0033827. ISSN   1939-2176. SSRN   2174409.
  9. ↑ Vitelli, Romeo (May 5, 2014). "The Return of Dr. Fox". Psychology Today . Sussex Publishers, LLC.
  10. 1 2 Hugh Feeley, Thomas (2002). "Evidence of Halo Effects in Student Evaluations of Communication Instruction". Communication Education . 51 (3): 225–236. doi:10.1080/03634520216519. S2CID   218577612.
  11. ↑ Isaacson, R. L.; McKeachie, W. J.; Milholland, J. E. (1963). "Correlation of teacher personality variables and student ratings". Journal of Educational Psychology . 54 (2): 110–117. doi:10.1037/h0048797.
  12. ↑ Patrick, C. L. (2011). "Student evaluations of teaching: Effects of the Big Five personality traits, grades and the validity hypothesis". Assessment & Evaluation in Higher Education. 36 (2): 239–249. doi:10.1080/02602930903308258. S2CID   45478591.
  13. 1 2 Murray, H. G.; Rushton, J. P.; Paunonen, S. V. (1990). "Teacher personality traits and student instructional ratings in six types of university courses". Journal of Educational Psychology . 82 (2): 250–261. doi:10.1037/0022-0663.82.2.250.
  14. 1 2 3 4 Huang, Y.-C., & Lin, S.-H. (2014). Assessment of Charisma as a Factor in Effective Teaching. Educational Technology & Society, 17 (2), 284–295.
  15. 1 2 3 Carpenter, S. K.; Wilford, M. M.; Kornell, N.; Mullaney, K. M. (2013). "Appearances can be deceiving: Instructor fluency increases perceptions of learning without increasing actual learning". Psychonomic Bulletin & Review. 20 (6): 1350–1356. doi: 10.3758/s13423-013-0442-z . PMID   23645413.
  16. 1 2 3 4 5 Virginia P. Richmond. "Chapter 6: Teacher Nonverbal Immediacy". West Virginia University. Retrieved 2014-11-6.
  17. 1 2 3 Ambady, Nalini; Rosenthal, Robert(1993). "Half a minute: Predicting teacher evaluations from thin slices of nonverbal behavior and physical attractiveness". Journal of Personality and Social Psychology, 64(3), 431–441. doi : 10.1037/0022-3514.64.3.431
  18. ↑ Vitelli, Romeo (May 5, 2014). "The Return of Dr. Fox". Psychology Today. Media Spotlight. Retrieved November 19, 2014.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.