Multimethodology

Last updated

Multimethodology or multimethod research includes the use of more than one method of data collection or research in a research study or set of related studies. Mixed methods research is more specific in that it includes the mixing of qualitative and quantitative data, methods, methodologies, and/or paradigms in a research study or set of related studies. One could argue that mixed methods research is a special case of multimethod research. Another applicable, but less often used label, for multi or mixed research is methodological pluralism. All of these approaches to professional and academic research emphasize that monomethod research can be improved through the use of multiple data sources, methods, research methodologies, perspectives, standpoints, and paradigms. [1] [2] [3]

Contents

The term multimethodology was used starting in the 1980s and in the 1989 book Multimethod Research: A Synthesis of Styles by John Brewer and Albert Hunter. During the 1990s and currently, the term mixed methods research has become more popular for this research movement in the behavioral, social, business, and health sciences. This pluralistic research approach has been gaining in popularity since the 1980s. [4]

Multi and mixed methods research designs

There are four broad classes of research studies that are currently being labeled "mixed methods research": [5]

  1. Quantitatively driven approaches/designs in which the research study is, at its core, a quantitative study with qualitative data/method added to supplement and improve the quantitative study by providing an added value and deeper, wider, and fuller or more complex answers to research questions; quantitative quality criteria are emphasized but high quality qualitative data also must be collected and analyzed;
  2. Qualitatively driven approaches/designs in which the research study is, at its core, a qualitative study with quantitative data/method added to supplement and improve the qualitative study by providing an added value and deeper, wider, and fuller or more complex answers to research questions; qualitative quality criteria are emphasized but high quality quantitative data also must be collected and analyzed; [6]
  3. Interactive or equal status designs in which the research study equally emphasizes (interactively and through integration) quantitative and qualitative data, methods, methodologies, and paradigms. This third design is often done through the use of a team composed of an expert in quantitative research, an expert in qualitative research, and an expert in mixed methods research to help with dialogue and continual integration. In this type of mixed study, quantitative and qualitative and mixed methods quality criteria are emphasized. This use of multiple quality criteria is seen in the concept of multiple validities legitimation. [7] [8] Here is a definition of this important type of validity or legitimation: Multiple validities legitimation "refers to the extent to which the mixed methods researcher successfully addresses and resolves all relevant validity types, including the quantitative and qualitative validity types discussed earlier in this chapter as well as the mixed validity dimensions. In other words, the researcher must identify and address all of the relevant validity issues facing a particular research study. Successfully addressing the pertinent validity issues will help researchers produce the kinds of inferences and meta-inferences that should be made in mixed research"(Johnson & Johnson, 2014; page 311).
  4. Mixed priority designs in which the principal study results derive from the integration of qualitative and quantitative data during analysis. [9]

Desirability

The case for multimethodology or mixed methods research as a strategy for intervention and/or research is based on four observations:

  1. Narrow views of the world are often misleading, so approaching a subject from different perspectives or paradigms may help to gain a holistic or more truthful worldview.
  2. There are different levels of social research (i.e.: biological, cognitive, social, etc.), and different methodologies may have particular strengths with respect to one of these levels. Using more than one should help to get a clearer picture of the social world and make for more adequate explanations.
  3. Many existing practices already combine methodologies to solve particular problems, yet they have not been theorised sufficiently.
  4. Multimethodology fits well with pragmatism.

Feasibility

There are also some hazards to multimethodological or mixed methods research approaches. Some of these problems include:

  1. Many paradigms are at odds with each other. However, once the understanding of the difference is present, it can be an advantage to see many sides, and possible solutions may present themselves.
  2. Multimethod and mixed method research can be undertaken from many paradigmatic perspectives, including pragmatism, dialectical pluralism, critical realism, and constructivism.
  3. Cultural issues affect world views and analyzability. Knowledge of a new paradigm is not enough to overcome potential biases; it must be learned through practice and experience.
  4. People have cognitive abilities that predispose them to particular paradigms. Quantitative research requires skills of data-analysis and several techniques of statistic reasoning, while qualitative research is rooted in in-depth observation, comparative thinking, interpretative skills and interpersonal ability. None of the approaches is easier to master than the other, and both require specific expertise, ability and skills.

Pragmatism and mixed methods

Pragmatism allows for the integration of qualitative and quantitative methods as loosely coupled systems to support mixed methods research. [10] On the one hand, quantitative research is characterized by randomized controlled trials, research questions inspired by literature review gap, generalizability, validity, and reliability. On the other, qualitative research is characterized by socially constructed realities and lived experiences. Pragmatism reconciles these differences an integrates quantitative and qualitative research as loosely coupled systems, where "open systems interact with each other at the point of their boundaries." [10] :281

History of Pragmatism in Multi/Mixed Methods Research

Developed as a philosophical method to solve problems towards the end of the nineteenth century, pragmatism is attributed to the work of philosopher Charles Sanders Peirce. For Peirce, research is conducted and interpreted from the eye of the beholder, as a practical approach to investigating social affairs. He sees science as a communal affair leading to single truths that are arrived at from multiple perspectives. For Peirce, the research conclusions are not as important as how these conclusions are reached. Focus is on answering the research question while allowing the methods to emerge in the process. [11] Peirce pragmatism and its approach to research support qualitatively driven mixed methods studies. [11]

John Dewey extends both, "Peirce pragmatic method and (William) James' radical empiricism (and approach to experience) by application to social and political problems." [11] :70 His philosophical pragmatism takes an interdisciplinary approach, where the divide between quantitative and qualitative research represents an obstacle to solving a problem. In Dewey's pragmatism, success is measured by the outcome, where the outcome is the reason to engage in research. Live experiences constitute reality, were individual lived experiences form a continuum by the interaction of subjective (internal) and objective (external) conditions. In Dewey's continuum of experiences, no experience lives on its own, it is influenced by the experiences that preceded it, and influences those that will follow it. His approach to knowledge is open-minded, and inquire is central to his epistemology.

Following Dewey, quantitatively driven research methods dominated until 1979, when Richard Rorty revived pragmatism. Rorty introduces his own ideas into pragmatism which includes the importance of culture, beliefs, and context. He shifts from understanding how things are to how they could be, and introduces the idea that "justification is audience dependent, and pretty much any justification finds a receptive audience" [11] :76 As Rorty explains, research success is peer dependent, not peer group neutral. From his perspective, MMR is not simply the merging of quantitative and qualitative research, but a third camp with its own peers and supporters.

Pragmatic philosophical positions

Multiple pragmatic philosophical stands may be used to justify pragmatism as a paradigm when conducting mixed methods research (MMR). A research paradigm provides a framework based on what constitutes and how knowledge is formed. Pragmatism as a philosophy may aid researchers in positioning themselves somewhere in the spectrum between qualitatively driven and quantitatively driven methods. The following philosophical stands can help address the debate between the use of qualitative and quantitative methods, and to ground quantitatively, qualitatively, or equal-status driven MMR.

Radical empiricism

Radical empiricism, as articulated by William James, takes reality as a function of our ongoing experiences, constantly changing at the individual level. James emphasizes that reality is not predetermined, and individual free will and chance matter. These ideas fit well with qualitative research emphasizing lived experiences. James also finds the truth in empirical and objectives facts, merging the divide between qualitative and quantitative research. However, James points out that no truth is independent of the thinker. [11] James' brand of pragmatism may be used by researchers conducting qualitatively and equal-status driven MMR.

Dialectical Pluralism

Dialectical pluralism is a form of pragmatism that emphasizes intentionally drawing from multiple approaches to conducting research and developing knowledge. [9] The multiple approaches being taken need not agree or converge with one another. Instead, the researcher using dialectical pluralism in the conduct of a mixed-method study may tack back and forth between models and perspectives in order to develop insight.

Realism and Critical Realism

Realists and critical realists take the perspective that the world exists independently of our observation and interpretation of it; critical realism goes beyond this to assert that multiple interpretations of the world are likely. [9] Like dialectical pluralism, realist paradigms in the context of pragmatic multi/mixed-methods research emphasize the idea that multiple approaches to knowledge are expected and can be treated as complementary. In contrast to a more strict positivist approach, critical realism sees causality as embedded in the details of a situation and social processes that surround an event.

Transformative-Emancipatory

Transformative and emancipatory paradigms emphasize a commitment on the part of the researcher to social justice, as in critical race theory. Researchers conducting multi-method or mixed-methods research within this paradigm tend to orient to issues of "power, privilege, and inequity." [9] :49

In contrast to quantitative and qualitative methodologies

One major similarity between mixed methodologies and qualitative and quantitative taken separately is that researchers need to maintain focus on the original purpose behind their methodological choices. A major difference between the two, however, is the way some authors differentiate the two, proposing that there is logic inherent in one that is different from the other. Creswell (2009) points out that in a quantitative study the researcher starts with a problem statement, moving on to the hypothesis and null hypothesis, through the instrumentation into a discussion of data collection, population, and data analysis. Creswell proposes that for a qualitative study the flow of logic begins with the purpose for the study, moves through the research questions discussed as data collected from a smaller group and then voices how they will be analysed.

A research strategy is a procedure for achieving a particular intermediary research objective — such as sampling, data collection, or data analysis. We may therefore speak of sampling strategies or data analysis strategies. The use of multiple strategies to enhance construct validity (a form of methodological triangulation) is now routinely advocated by methodologists. In short, mixing or integrating research strategies (qualitative and/or quantitative) in any and all research undertaking is now considered a common feature of good research.

A research approach refers to an integrated set of research principles and general procedural guidelines. Approaches are broad, holistic (but general) methodological guides or roadmaps that are associated with particular research motives or analytic interests. Two examples of analytic interests are population frequency distributions and prediction. Examples of research approaches include experiments, surveys, correlational studies, ethnographic research, and phenomenological inquiry. Each approach is ideally suited to addressing a particular analytic interest. For instance, experiments are ideally suited to addressing nomothetic explanations or probable cause; surveys — population frequency descriptions, correlations studies — predictions; ethnography — descriptions and interpretations of cultural processes; and phenomenology — descriptions of the essence of phenomena or lived experiences.

In a single approach design (SAD)(also called a "monomethod design") only one analytic interest is pursued. In a mixed or multiple approach design (MAD) two or more analytic interests are pursued. Note: a multiple approach design may include entirely "quantitative" approaches such as combining a survey and an experiment; or entirely "qualitative" approaches such as combining an ethnographic and a phenomenological inquiry, and a mixed approach design includes a mixture of the above (e.g., a mixture of quantitative and qualitative data, methods, methodologies, and/or paradigms).

A word of caution about the term "multimethodology". It has become quite common place to use the terms "method" and "methodology" as synonyms (as is the case with the above entry). However, there are convincing philosophical reasons for distinguishing the two. "Method" connotes a way of doing something — a procedure (such as a method of data collection). "Methodology" connotes a discourse about methods — i.e., a discourse about the adequacy and appropriateness of particular combination of research principles and procedures. The terms methodology and biology share a common suffix "logy." Just as bio-logy is a discourse about life — all kinds of life; so too, methodo-logy is a discourse about methods — all kinds of methods. It seems unproductive, therefore, to speak of multi-biologies or of multi-methodologies. It is very productive, however, to speak of multiple biological perspectives or of multiple methodological perspectives.

See also

Related Research Articles

A case study is an in-depth, detailed examination of a particular case within a real-world context. For example, case studies in medicine may focus on an individual patient or ailment; case studies in business might cover a particular firm's strategy or a broader market; similarly, case studies in politics can range from a narrow happening over time like the operations of a specific political campaign, to an enormous undertaking like world war, or more often the policy analysis of real-world problems affecting multiple stakeholders.

Qualitative psychological research is psychological research that employs qualitative methods.

<span class="mw-page-title-main">Qualitative research</span> Form of research

Qualitative research is a type of research that aims to gather and analyse non-numerical (descriptive) data in order to gain an understanding of individuals' social reality, including understanding their attitudes, beliefs, and motivation. This type of research typically involves in-depth interviews, focus groups, or observations in order to collect data that is rich in detail and context. Qualitative research is often used to explore complex phenomena or to gain insight into people's experiences and perspectives on a particular topic. It is particularly useful when researchers want to understand the meaning that people attach to their experiences or when they want to uncover the underlying reasons for people's behavior. Qualitative methods include ethnography, grounded theory, discourse analysis, and interpretative phenomenological analysis. Qualitative research methods have been used in sociology, anthropology, political science, psychology, communication studies, social work, folklore, educational research, information science and software engineering research.

<span class="mw-page-title-main">Quantitative research</span> All procedures for the numerical representation of empirical facts

Quantitative research is a research strategy that focuses on quantifying the collection and analysis of data. It is formed from a deductive approach where emphasis is placed on the testing of theory, shaped by empiricist and positivist philosophies.

Educational research refers to the systematic collection and analysis of evidence and data related to the field of education. Research may involve a variety of methods and various aspects of education including student learning, interaction, teaching methods, teacher training, and classroom dynamics.

<span class="mw-page-title-main">Content analysis</span> Research method for studying documents and communication artifacts

Content analysis is the study of documents and communication artifacts, which might be texts of various formats, pictures, audio or video. Social scientists use content analysis to examine patterns in communication in a replicable and systematic manner. One of the key advantages of using content analysis to analyse social phenomena is their non-invasive nature, in contrast to simulating social experiences or collecting survey answers.

<span class="mw-page-title-main">Methodology</span> Study of research methods

In its most common sense, methodology is the study of research methods. However, the term can also refer to the methods themselves or to the philosophical discussion of associated background assumptions. A method is a structured procedure for bringing about a certain goal, like acquiring knowledge or verifying knowledge claims. This normally involves various steps, like choosing a sample, collecting data from this sample, and interpreting the data. The study of methods concerns a detailed description and analysis of these processes. It includes evaluative aspects by comparing different methods. This way, it is assessed what advantages and disadvantages they have and for what research goals they may be used. These descriptions and evaluations depend on philosophical background assumptions. Examples are how to conceptualize the studied phenomena and what constitutes evidence for or against them. When understood in the widest sense, methodology also includes the discussion of these more abstract issues.

<span class="mw-page-title-main">Autoethnography</span> Research method using personal experience

Autoethnography is a form of ethnographic research in which a researcher connects personal experiences to wider cultural, political, and social meanings and understandings. It is considered a form of qualitative and/or arts-based research.

<span class="mw-page-title-main">Postpositivism</span> Metatheoretical stance on scientific inquiry

Postpositivism or postempiricism is a metatheoretical stance that critiques and amends positivism and has impacted theories and practices across philosophy, social sciences, and various models of scientific inquiry. While positivists emphasize independence between the researcher and the researched person, postpositivists argue that theories, hypotheses, background knowledge and values of the researcher can influence what is observed. Postpositivists pursue objectivity by recognizing the possible effects of biases. While positivists emphasize quantitative methods, postpositivists consider both quantitative and qualitative methods to be valid approaches.

<span class="mw-page-title-main">Grounded theory</span> Qualitative research methodology

Grounded theory is a systematic methodology that has been largely applied to qualitative research conducted by social scientists. The methodology involves the construction of hypotheses and theories through the collecting and analysis of data. Grounded theory involves the application of inductive reasoning. The methodology contrasts with the hypothetico-deductive model used in traditional scientific research.

<span class="mw-page-title-main">Narrative inquiry</span> Discipline within qualitative research

Narrative inquiry or narrative analysis emerged as a discipline from within the broader field of qualitative research in the early 20th century, as evidence exists that this method was used in psychology and sociology. Narrative inquiry uses field texts, such as stories, autobiography, journals, field notes, letters, conversations, interviews, family stories, photos, and life experience, as the units of analysis to research and understand the way people create meaning in their lives as narratives.

<span class="mw-page-title-main">Literature review</span> Review of the current knowledge of a particular topic

A literature review is an overview of the previously published works on a topic. The term can refer to a full scholarly paper or a section of a scholarly work such as a book, or an article. Either way, a literature review is supposed to provide the researcher/author and the audiences with a general image of the existing knowledge on the topic under question. A good literature review can ensure that a proper research question has been asked and a proper theoretical framework and/or research methodology have been chosen. To be precise, a literature review serves to situate the current study within the body of the relevant literature and to provide context for the reader. In such case, the review usually precedes the methodology and results sections of the work.

An embedded case study is a case study containing more than one sub-unit of analysis. Similar to a case study, an embedded case study methodology provides a means of integrating quantitative and qualitative methods into a single research study. However, the identification of sub-units allows for a more detailed level of inquiry. The embedded case study design is an empirical form of inquiry appropriate for descriptive studies, where the goal is to describe the features, context, and process of a phenomenon. Roland W. Scholz suggests that “case is faceted or embedded in a conceptual grid” which allows to identify key components of human and environmental systems.

Incompatibility thesis is an argument in research methodology about incompatibility of quantitative research and qualitative research paradigms in the same research. This thesis is based on philosophies of post-structuralism and post-modernism. Arguments from those philosophies support exclusive superiority of one orientation are oppose mixing it with quantitative research.

<span class="mw-page-title-main">Unstructured interview</span> Interview in which questions are not prearranged.

An unstructured interview or non-directive interview is an interview in which questions are not prearranged. These non-directive interviews are considered to be the opposite of a structured interview which offers a set amount of standardized questions. The form of the unstructured interview varies widely, with some questions being prepared in advance in relation to a topic that the researcher or interviewer wishes to cover. They tend to be more informal and free flowing than a structured interview, much like an everyday conversation. Probing is seen to be the part of the research process that differentiates the in-depth, unstructured interview from an everyday conversation. This nature of conversation allows for spontaneity and for questions to develop during the course of the interview, which are based on the interviewees' responses. The chief feature of the unstructured interview is the idea of probe questions that are designed to be as open as possible. It is a qualitative research method and accordingly prioritizes validity and the depth of the interviewees' answers. One of the potential drawbacks is the loss of reliability, thereby making it more difficult to draw patterns among interviewees' responses in comparison to structured interviews. Unstructured interviews are used in a variety of fields and circumstances, ranging from research in social sciences, such as sociology, to college and job interviews. Fontana and Frey have identified three types of in depth, ethnographic, unstructured interviews - oral history, creative interviews, and post-modern interviews.

In qualitative research, a member check, also known as informant feedback or respondent validation, is a technique used by researchers to help improve the accuracy, credibility, validity, and transferability of a study. There are many subcategories of members checks, including: narrative accuracy checks, interpretive validity, descriptive validity, theoretical validity, and evaluative validity. In many member checks, the interpretation and report is given to members of the sample (informants) in order to check the authenticity of the work. Their comments serve as a check on the viability of the interpretation.

Dedoose is a web application for mixed methods research developed by academics from UCLA, with support from the William T. Grant Foundation, and is the successor to EthnoNotes.

Thematic analysis is one of the most common forms of analysis within qualitative research. It emphasizes identifying, analysing and interpreting patterns of meaning within qualitative data. Thematic analysis is often understood as a method or technique in contrast to most other qualitative analytic approaches – such as grounded theory, discourse analysis, narrative analysis and interpretative phenomenological analysis – which can be described as methodologies or theoretically informed frameworks for research. Thematic analysis is best thought of as an umbrella term for a variety of different approaches, rather than a singular method. Different versions of thematic analysis are underpinned by different philosophical and conceptual assumptions and are divergent in terms of procedure. Leading thematic analysis proponents, psychologists Virginia Braun and Victoria Clarke distinguish between three main types of thematic analysis: coding reliability approaches, code book approaches and reflexive approaches. They describe their own widely used approach first outlined in 2006 in the journal Qualitative Research in Psychology as reflexive thematic analysis. Their 2006 paper has over 120,000 Google Scholar citations and according to Google Scholar is the most cited academic paper published in 2006. The popularity of this paper exemplifies the growing interest in thematic analysis as a distinct method.

<span class="mw-page-title-main">Norman K. Denzin</span> American sociologist (1941–2023)

Norman Kent Denzin was an American professor of sociology. He was an emeritus professor in the Department of Sociology at the University of Illinois at Urbana–Champaign, where he was research professor of communications, College of Communications scholar, professor of sociology, professor of cinema studies, professor in the Unit for Criticism and Interpretive Theory. Denzin's academic interests included interpretive theory, performance studies, qualitative research methodology, and the study of media, culture and society.

<span class="mw-page-title-main">Qualitative geography</span> Subfield of geographic methods

Qualitative geography is a subfield and methodological approach to geography focusing on nominal data, descriptive information, and the subjective and interpretive aspects of how humans experience and perceive the world. Often, it is concerned with understanding the lived experiences of individuals and groups and the social, cultural, and political contexts in which those experiences occur. Thus, qualitative geography is traditionally placed under the branch of human geography; however, technical geographers are increasingly directing their methods toward interpreting, visualizing, and understanding qualitative datasets, and physical geographers employ nominal qualitative data as well as quanitative. Furthermore, there is increased interest in applying approaches and methods that are generally viewed as more qualitative in nature to physical geography, such as in critical physical geography. While qualitative geography is often viewed as the opposite of quantitative geography, the two sets of techniques are increasingly used to complement each other. Qualitative research can be employed in the scientific process to start the observation process, determine variables to include in research, validate results, and contextualize the results of quantitative research through mixed-methods approaches.

References

  1. Creswell, J. W. 2004
  2. Johnson, R. B. & Christensen, J. B., 2014
  3. Tashakkori, Abbas; Teddlie, Charles (2010). Mixed Methods in Social & Behavioral Research. Sage. ISBN   978-1412972666.
  4. Onwuegbuzie, Anthony and Leech, 2005.
  5. Johnson, R. Burke; Onwuegbuzie, Anthony J.; Turner, Lisa A. (April 2007). "Toward a Definition of Mixed Methods Research". Journal of Mixed Methods Research. 1 (2): 112–133. doi:10.1177/1558689806298224. S2CID   146145591.
  6. Hesse-Biber, Sharlene Nagy; Johnson, R. Burke (2015). The Oxford handbook of multimethod and mixed methods research inquiry. Oxford. ISBN   9780199933624.{{cite book}}: CS1 maint: location missing publisher (link)
  7. Johnson, R. B.; Christensen, L. B. (2014). Educational Research: Quantitative, Qualitative, and Mixed Approaches (5 ed.). Los Angeles, CA: SAGE.
  8. Onwuegbuzie, A. J.; Johnson, R. B. (2006). "The "Validity" Issue in Mixed Methods Research". Research in the Schools. 13 (1): 48–63.
  9. 1 2 3 4 Creamer, Elizabeth G. (2018). An introduction to fully integrated mixed methods research. Los Angeles, CA: SAGE. ISBN   978-1-4833-5093-6.
  10. 1 2 Florczak, K. L. (2014). "Purists Need Not Apply: The Case for Pragmatism in Mixed Methods Research". Nursing Science Quarterly. 27 (4): 278–282. doi:10.1177/0894318414546419. PMID   25248767. S2CID   45881896.
  11. 1 2 3 4 5 Johnson, R. B.; de Waal, C.; Stefurak, T.; Hildebrand, D.L. (2007). "Understanding the Philosophical Positions of Classical and Neopragmatists for Mixed Methods Research". Koln Z Soziol.

Further reading