Last updated An example of operationally defining "personal space".
In research design, especially in psychology, social sciences, life sciences and physics, operationalization or operationalisation is a process of defining the measurement of a phenomenon which is not directly measurable, though its existence is inferred from other phenomena. Operationalization thus defines a fuzzy concept so as to make it clearly distinguishable, measurable, and understandable by empirical observation. In a broader sense, it defines the extension of a concept—describing what is and is not an instance of that concept. For example, in medicine, the phenomenon of health might be operationalized by one or more indicators like body mass index or tobacco smoking. As another example, in visual processing the presence of a certain object in the environment could be inferred by measuring specific features of the light it reflects. In these examples, the phenomena are difficult to directly observe and measure because they are general/abstract (as in the example of health) or they are latent (as in the example of the object). Operationalization helps infer the existence, and some elements of the extension, of the phenomena of interest by means of some observable and measurable effects they have.
Sometimes multiple or competing alternative operationalizations for the same phenomenon are available. Repeating the analysis with one operationalization after the other can determine whether the results are affected by different operationalizations. This is called checking robustness. If the results are (substantially) unchanged, the results are said to be robust against certain alternative operationalizations of the checked variables.
The concept of operationalization was first presented by the British physicist N. R. Campbell in his 'Physics: The Elements' (Cambridge, 1920). This concept spread to humanities and social sciences. It remains in use in physics.[2][3][4][5][6][7]
Bridgman wrote that in the theory of relativity a concept like "duration" can split into multiple different concepts. In refining a physical theory, it may be discovered that what was thought to be one concept is actually two or more distinct concepts. Bridgman proposed that if only operationally defined concepts are used, this will never happen.
Bridgman's theory was criticized because "length" is measured in various ways (e.g. it is impossible to use a measuring rod to measure the distance to the Moon), so "length" logically is not one concept but many, with some concepts requiring knowledge of geometry.[citation needed] Each concept is to be defined by the measuring operation used. So the criticism is that there are potentially infinite concepts, each defined by the methods that measured it, such as angle of sighting, day of the solar year, angular subtense of the moon, etc. which were gathered together, some astronomical observations taken over a period of thousands of years.
In the 1930s, Harvard experimental psychologist Edwin Boring and students Stanley Smith Stevens and Douglas McGregor, struggling with the methodological and epistemological problems of defining measurement of psychological phenomena, found a solution in reformulating psychological concepts operationally, as it had been proposed in the field of physics by Bridgman, their Harvard colleague. This resulted in a series of articles that were published by Stevens and McGregor from 1935, that were widely discussed in the field of psychology and led to the Symposium on operationism in 1945, to which Bridgman also contributed.[8]
Operationalization
The practical 'operational definition' is generally understood as relating to the theoretical definitions that describe reality through the use of theory.
The importance of careful operationalization can perhaps be more clearly seen in the development of General Relativity. Einstein discovered that there were two operational definitions of "mass" being used by scientists: inertial, defined by applying a force and observing the acceleration, from Newton's Second Law of Motion; and gravitational, defined by putting the object on a scale or balance. Previously, no one had paid any attention to the different operations used because they always produced the same results,[10] but the key insight of Einstein was to posit the Principle of Equivalence that the two operations would always produce the same result because they were equivalent at a deep level, and work out the implications of that assumption, which is the General Theory of Relativity. Thus, a breakthrough in science was achieved by disregarding different operational definitions of scientific measurements and realizing that they both described a single theoretical concept. Einstein's disagreement with the operationalist approach was criticized by Bridgman[11] as follows: "Einstein did not carry over into his general relativity theory the lessons and insights he himself has taught us in his special theory." (p.335).
In the social sciences
An operationalization diagram, used to illustrate obscure or ambiguous concepts in an academic paper. This particular example is tailored to use in the field of Political Science.
Operationalization is often used in the social sciences as part of the scientific method and psychometrics. Particular concerns about operationalization arise in cases that deal with complex concepts and complex stimuli (e.g., business research, software engineering) where unique threats to validity of operationalization are believed to exist.[12]
Anger example
For example, a researcher may wish to measure the concept "anger." Its presence, and the depth of the emotion, cannot be directly measured by an outside observer because anger is intangible. Rather, other measures are used by outside observers, such as facial expression, choice of vocabulary, loudness and tone of voice.
If a researcher wants to measure the depth of "anger" in various persons, the most direct operation would be to ask them a question, such as "are you angry", or "how angry are you?". This operation is problematic, however, because it depends upon the definition of the individual. Some people might be subjected to a mild annoyance, and become slightly angry, but describe themselves as "extremely angry," whereas others might be subjected to a severe provocation, and become very angry, but describe themselves as "slightly angry." In addition, in many circumstances it is impractical to ask subjects whether they are angry.
Since one of the measures of anger is loudness, the researcher can operationalize the concept of anger by measuring how loudly the subject speaks compared to his normal tone. However, this must assume that loudness is a uniform measure. Some might respond verbally while others might respond physically.
Economics objections
One of the main critics of operationalism in social science argues that "the original goal was to eliminate the subjective mentalistic concepts that had dominated earlier psychological theory and to replace them with a more operationally meaningful account of human behavior. But, as in economics, the supporters ultimately ended up "turning operationalism inside out".[13] "Instead of replacing 'metaphysical' terms such as 'desire' and 'purpose'" they "used it to legitimize them by giving them operational definitions." Thus in psychology, as in economics, the initial, quite radical operationalist ideas eventually came to serve as little more than a "reassurance fetish"[14] for mainstream methodological practice."[15]
The above discussion links operationalization to measurement of concepts. Many scholars have worked to operationalize concepts like job satisfaction, prejudice, anger etc. Scale and index construction are forms of operationalization. There is not one perfect way to operationalize. For example, in the United States the concept distance driven would be operationalized as miles, whereas kilometers would be used in Europe.[16]
Operationalization is part of the empirical research process.[17] An example is the empirical research question of if job satisfaction influences job turnover. Both job satisfaction and job turnover need to be measured. The concepts and their relationship are important — operationalization occurs within a larger framework of concepts. When there is a large empirical research question or purpose the conceptual framework that organizes the response to the question must be operationalized before the data collection can begin. If a scholar constructs a questionnaire based on a conceptual framework, they have operationalized the framework. Most serious empirical research should involve operationalization that is transparent and linked to a conceptual framework.
Another example, the hypothesisJob satisfaction reduces job turnover is one way to connect (or frame) two concepts – job satisfaction and job turnover. The process of moving from the idea job satisfaction to the set of questionnaire items that form a job satisfaction scale is operationalization. For example, it is possible to measure job satisfaction using only two simple questions: "All in all, I am satisfied with my job", and, "In general, I like my job."[18]
Operationalization uses a different logic when testing a formal (quantitative) hypothesis and testing working hypothesis (qualitative). For formal hypotheses the concepts are represented empirically (or operationalized) as numeric variables and tested using inferential statistics. Working hypotheses (particularly in the social and administrative sciences), however, are tested through evidence collection and the assessment of the evidence.[19] The evidence is generally collected within the context of a case study. The researcher asks if the evidence is sufficient to "support" the working hypothesis. Formal operationalization would specify the kinds of evidence needed to support the hypothesis as well as evidence which would "fail" to support it.[20] Robert Yin recommends developing a case study protocol as a way to specify the kinds of evidence needed during the data collection phases. He identifies six sources of evidence: documentation; archival records; interviews; direct observations; participant observation and physical or cultural artifacts.[21]
In the field of public administration, Shields and Tajalli (2006) have identified five kinds of conceptual frameworks (working hypothesis, descriptive categories, practical ideal type, operations research, and formal hypothesis). They explain and illustrate how each of these conceptual frameworks can be operationalized. They also show how to make conceptualization and operationalization more concrete by demonstrating how to form conceptual framework tables that are tied to the literature and operationalization tables that lay out the specifics of how to operationalize the conceptual framework (measure the concepts).[22][23]
↑ Inguane, R., Gallego-Ayala, J., & Juízo, D. (2013). Decentralized water resources management in Mozambique: challenges of implementation at river basin level. Physics and Chemistry of the Earth, Parts A/B/C.
↑ Wright, R. (2007). Statistical structures underlying quantum mechanics and social science. International Journal of Theoretical Physics, 46(8), 2026-2045.
↑ Atmanspacher, H. (1994). Is the ontic/epistemic distinction sufficient to describe quantum systems exhaustively?. In Symposium on the Foundations of Modern Physics (pp. 15-32).
↑ Svozil, K. (1990). The quantum coin toss-testing microphysical undecidability. Physics Letters A, 143(9), 433-437.
↑ Downing, K. L. (1992). A qualitative teleological approach to cardiovascular physiology. Recent advances in qualitative physics, 329.
↑ Martens, H., & de Muynck, W. M. (1990). The inaccuracy principle. Foundations of physics, 20(4), 357-380.
↑ The operationalist thesis—which can be considered a variation on the positivist theme—was that all theoretical terms must be defined via the operations by which one measured them; see Crowther-Heyck, Hunter (2005), Herbert A. Simon: The Bounds of Reason in Modern America, JHU Press, p. 65.
↑ P.W. Bridgman, Einstein's Theories and the Operational Point of View, in: P.A. Schilpp, ed., Albert Einstein: Philosopher-Scientist, Open Court, La Salle, Ill., Cambridge University Press, 1982, Vol. 2, p. 335–354.
↑ Lukyanenko, Roman; Evermann, Joerg; Parsons, Jeffrey (2014). "Instantiation Validity in IS Design Research". In Tremblay, Monica Chiarini; VanderMeer, Debra E.; Rothenberger, Marcus A.; Gupta, Ashish; Yoon, Victoria Y. (eds.). Advancing the Impact of Design Science: Moving from Theory to Practice - 9th International Conference, DESRIST 2014, Miami, FL, USA, May 22-24, 2014. Proceedings. Lecture Notes in Computer Science. Vol.8463. Springer. pp.321–328. doi:10.1007/978-3-319-06701-8_22.
↑ Green 2001 Operationism Again: What Did Bridgman Say? What Did Bridgman Need? in Theory and Psychology 11 (2001) p.49
↑ Koch, Sigmund (1992) Psychology’s Bridgman vs. Bridgman’s Bridgman: An Essay in Reconstruction., in Theory and Psychology vol. 2 no. 3 (1992) p.275
Falsifiability is a deductive standard of evaluation of scientific theories and hypotheses, introduced by the philosopher of science Karl Popper in his book The Logic of Scientific Discovery (1934). A theory or hypothesis is falsifiable if it can be logically contradicted by an empirical test.
Mass is an intrinsic property of a body. It was traditionally believed to be related to the quantity of matter in a physical body, until the discovery of the atom and particle physics. It was found that different atoms and different elementary particles, theoretically with the same amount of matter, have nonetheless different masses. Mass in modern physics has multiple definitions which are conceptually distinct, but physically equivalent. Mass can be experimentally defined as a measure of the body's inertia, meaning the resistance to acceleration when a net force is applied. The object's mass also determines the strength of its gravitational attraction to other bodies.
Research is "creative and systematic work undertaken to increase the stock of knowledge". It involves the collection, organization and analysis of evidence to increase understanding of a topic, characterized by a particular attentiveness to controlling sources of bias and error. These activities are characterized by accounting and controlling for biases. A research project may be an expansion on past work in the field. To test the validity of instruments, procedures, or experiments, research may replicate elements of prior projects or the project as a whole.
Space is a three-dimensional continuum containing positions and directions. In classical physics, physical space is often conceived in three linear dimensions. Modern physicists usually consider it, with time, to be part of a boundless four-dimensional continuum known as spacetime. The concept of space is considered to be of fundamental importance to an understanding of the physical universe. However, disagreement continues between philosophers over whether it is itself an entity, a relationship between entities, or part of a conceptual framework.
An operational definition specifies concrete, replicable procedures designed to represent a construct. In the words of American psychologist S.S. Stevens (1935), "An operation is the performance which we execute in order to make known a concept." For example, an operational definition of "fear" often includes measurable physiologic responses that occur in response to a perceived threat. Thus, "fear" might be operationally defined as specified changes in heart rate, galvanic skin response, pupil dilation, and blood pressure.
Empirical evidence for a proposition is evidence, i.e. what supports or counters this proposition, that is constituted by or accessible to sense experience or experimental procedure. Empirical evidence is of central importance to the sciences and plays a role in various other fields, like epistemology and law.
A conceptual framework is an analytical tool with several variations and contexts. It can be applied in different categories of work where an overall picture is needed. It is used to make conceptual distinctions and organize ideas. Strong conceptual frameworks capture something real and do this in a way that is easy to remember and apply.
Construct validity concerns how well a set of indicators represent or reflect a concept that is not directly measurable. Construct validation is the accumulation of evidence to support the interpretation of what a measure reflects. Modern validity theory defines construct validity as the overarching concern of validity research, subsuming all other types of validity evidence such as content validity and criterion validity.
A theoretical definition defines a term in an academic discipline, functioning as a proposal to see a phenomenon in a certain way. A theoretical definition is a proposed way of thinking about potentially related events. Theoretical definitions contain built-in theories; they cannot be simply reduced to describing a set of observations. The definition may contain implicit inductions and deductive consequences that are part of the theory. A theoretical definition of a term can change, over time, based on the methods in the field that created it.
Level of measurement or scale of measure is a classification that describes the nature of information within the values assigned to variables. Psychologist Stanley Smith Stevens developed the best-known classification with four levels, or scales, of measurement: nominal, ordinal, interval, and ratio. This framework of distinguishing levels of measurement originated in psychology and has since had a complex history, being adopted and extended in some disciplines and by some scholars, and criticized or rejected by others. Other classifications include those by Mosteller and Tukey, and by Chrisman.
Exploratory research is "the preliminary research to clarify the exact nature of the problem to be solved." It is used to ensure additional research is taken into consideration during an experiment as well as determining research priorities, collecting data and honing in on certain subjects which may be difficult to take note of without exploratory research. It can include techniques, such as:
A literature review is an overview of the previously published works on a topic. The term can refer to a full scholarly paper or a section of a scholarly work such as a book, or an article. Either way, a literature review is supposed to provide the researcher/author and the audiences with a general image of the existing knowledge on the topic under question. A good literature review can ensure that a proper research question has been asked and a proper theoretical framework and/or research methodology have been chosen. To be precise, a literature review serves to situate the current study within the body of the relevant literature and to provide context for the reader. In such case, the review usually precedes the methodology and results sections of the work.
Descriptive research is used to describe characteristics of a population or phenomenon being studied. It does not answer questions about how/when/why the characteristics occurred. Rather it addresses the "what" question. The characteristics used to describe the situation or population are usually some kind of categorical scheme also known as descriptive categories. For example, the periodic table categorizes the elements. Scientists use knowledge about the nature of electrons, protons and neutrons to devise this categorical scheme. We now take for granted the periodic table, yet it took descriptive research to devise it. Descriptive research generally precedes explanatory research. For example, over time the periodic table's description of the elements allowed scientists to explain chemical reaction and make sound prediction when elements were combined.
A system is a group of interacting or interrelated elements that act according to a set of rules to form a unified whole. A system, surrounded and influenced by its environment, is described by its boundaries, structure and purpose and is expressed in its functioning. Systems are the subjects of study of systems theory and other systems sciences.
In philosophy, a construct is an object which is ideal, that is, an object of the mind or of thought, meaning that its existence may be said to depend upon a subject's mind. This contrasts with any possibly mind-independent objects, the existence of which purportedly does not depend on the existence of a conscious observing subject. Thus, the distinction between these two terms may be compared to that between phenomenon and noumenon in other philosophical contexts and to many of the typical definitions of the terms realism and idealism also. In the correspondence theory of truth, ideas, such as constructs, are to be judged and checked according to how well they correspond with their referents, often conceived as part of a mind-independent reality.
Theoretical physics is a branch of physics that employs mathematical models and abstractions of physical objects and systems to rationalize, explain and predict natural phenomena. This is in contrast to experimental physics, which uses experimental tools to probe these phenomena.
A hypothesis is a proposed explanation for a phenomenon. For a hypothesis to be a scientific hypothesis, the scientific method requires that one can test it. Scientists generally base scientific hypotheses on previous observations that cannot satisfactorily be explained with the available scientific theories. Even though the words "hypothesis" and "theory" are often used interchangeably, a scientific hypothesis is not the same as a scientific theory. A working hypothesis is a provisionally accepted hypothesis proposed for further research in a process beginning with an educated guess or thought.
A working hypothesis is a hypothesis that is provisionally accepted as a basis for further ongoing research in the hope that a tenable theory will be produced, even if the hypothesis ultimately fails. Like all hypotheses, a working hypothesis is constructed as a statement of expectations, which can be linked to deductive, exploratory research in empirical investigation and is often used as a conceptual framework in qualitative research. The term "working" indicates that the hypothesis is subject to change.
Patricia M. Shields is a Regents' Professor in the Political Science Department at Texas State University. Since 2001 she has been Editor-in-Chief of the international and interdisciplinary journal Armed Forces & Society. She is also a Contributing Editor to Parameters: The US Army War College Quarterly and the Section Editor of the Military and Society section to the Handbook of Military Sciences. Shields is notable for her publications focusing on research methods, civil military relations, gender issues, pragmatism in public administration, peace studies, and the contributions of Jane Addams to public administration and peace theory. She received a BA in Economics from the University of Maryland - College Park, an MA in Economics and a PhD in Public Administration from The Ohio State University.
The Logic of Modern Physics is a 1927 philosophy of science book by American physicist and Nobel laureate Percy Williams Bridgman. The book is notable for explicitly identifying, analyzing, and explaining operationalism for the first time, and coining the term operational definition. Widely read by scholars in the social sciences, it had a huge influence in the 1930s and 1940s, and its major influence on the field of psychology in particular surpassed even that on methodology in physics, for which it was originally intended.
This page is based on this Wikipedia article Text is available under the CC BY-SA 4.0 license; additional terms may apply. Images, videos and audio are available under their respective licenses.
