Metric fixation

Last updated

Metric fixation refers to a tendency for decision-makers to place excessively large emphases on selected metrics.

In management (and many other social science fields), decision makers typically use metrics to measure how well a person or an organization attain desired goal(s). E.g., a company might use "the number of new customers gained" as a metric to evaluate the success of a marketing campaign. The issue of metric fixation is said to arise if the decision maker(s) focus excessively on the metrics, often to the point that they treat "attaining desired values on the metrics" as a core goal (instead of simply an indicator of successes). For example, a school may want to improve the number of students who pass a certain test (metric = "number of students who pass"). This is based on the assumption that the said test truly can evaluate students' ability to succeed in the real world (assuming there already is a good definition of what "success" means). If the said test fails to evaluate the students' ability to function in the working world, focusing solely on increasing their scores on this test might cause the school to ignore other learning goals also crucial for real world functioning. As a result, the students' developments might be impaired. [1] [2]

Although related to several similar, older concepts, the term "metric fixation" was first mentioned in the 2018 book The Tyranny of Metrics . [3] and has since drawn the attention of some management researchers and data scientists. [2] [4]

See also

Related Research Articles

In common usage, evaluation is a systematic determination and assessment of a subject's merit, worth and significance, using criteria governed by a set of standards. It can assist an organization, program, design, project or any other intervention or initiative to assess any aim, realisable concept/proposal, or any alternative, to help in decision-making; or to generate the degree of achievement or value in regard to the aim and objectives and results of any such action that has been completed.

<span class="mw-page-title-main">Goodhart's law</span> Adage about statistical measures

Goodhart's law is an adage often stated as, "When a measure becomes a target, it ceases to be a good measure". It is named after British economist Charles Goodhart, who is credited with expressing the core idea of the adage in a 1975 article on monetary policy in the United Kingdom:

Any observed statistical regularity will tend to collapse once pressure is placed upon it for control purposes.

<span class="mw-page-title-main">Decision tree</span> Decision support tool

A decision tree is a decision support hierarchical model that uses a tree-like model of decisions and their possible consequences, including chance event outcomes, resource costs, and utility. It is one way to display an algorithm that only contains conditional control statements.

Disciplinarians believe that self control is of the utmost importance and enforce a set of rules that aim to develop such behaviour. Such enforcement is often based on punishment.

<span class="mw-page-title-main">Usability</span> Capacity of a system for its users to perform tasks

Usability can be described as the capacity of a system to provide a condition for its users to perform the tasks safely, effectively, and efficiently while enjoying the experience. In software engineering, usability is the degree to which a software can be used by specified consumers to achieve quantified objectives with effectiveness, efficiency, and satisfaction in a quantified context of use.

Planning is the process of thinking regarding the activities required to achieve a desired goal. Planning is based on foresight, the fundamental capacity for mental time travel. Some researchers regard the evolution of forethought - the capacity to think ahead - as a prime mover in human evolution. Planning is a fundamental property of intelligent behavior. It involves the use of logic and imagination to visualize not only a desired result, but the steps necessary to achieve that result.

<span class="mw-page-title-main">Choice</span> Deciding between multiple options

A choice is the range of different things from which a being can choose. The arrival at a choice may incorporate motivators and models.

<span class="mw-page-title-main">Performance indicator</span> Measurement that evaluates the success of an organization

A performance indicator or key performance indicator (KPI) is a type of performance measurement. KPIs evaluate the success of an organization or of a particular activity in which it engages. KPIs provide a focus for strategic and operational improvement, create an analytical basis for decision making and help focus attention on what matters most.

A business case captures the reasoning for initiating a project or task. Many projects, but not all, are initiated by using a business case. It is often presented in a well-structured written document, but may also come in the form of a short verbal agreement or presentation. The logic of the business case is that, whenever resources such as money or effort are consumed, they should be in support of a specific business need. An example could be that a software upgrade might improve system performance, but the "business case" is that better performance would improve customer satisfaction, require less task processing time, or reduce system maintenance costs. A compelling business case adequately captures both the quantifiable and non-quantifiable characteristics of a proposed project. According to the Project Management Institute, a business case is a "value proposition for a proposed project that may include financial and nonfinancial benefit."

<span class="mw-page-title-main">Benchmark (computing)</span> Comparing the relative performance of computers by running the same program on all of them

In computing, a benchmark is the act of running a computer program, a set of programs, or other operations, in order to assess the relative performance of an object, normally by running a number of standard tests and trials against it.

Neuroergonomics is the application of neuroscience to ergonomics. Traditional ergonomic studies rely predominantly on psychological explanations to address human factors issues such as: work performance, operational safety, and workplace-related risks. Neuroergonomics, in contrast, addresses the biological substrates of ergonomic concerns, with an emphasis on the role of the human nervous system.

Supply Chain Operations Reference (SCOR) model is a process reference model developed and endorsed by the Supply Chain Council as the cross-industry, standard diagnostic tool for supply chain management. The SCOR model describes the business activities associated with satisfying a customer's demand, which include plan, source, make, deliver, return and enable. Use of the model includes analyzing the current state of a company's processes and goals, quantifying operational performance, and comparing company performance to benchmark data. SCOR has developed a set of metrics for supply chain performance, and Supply Chain Council members have formed industry groups to collect best practices information that companies can use to elevate their supply chain models.

Control is a function of management that helps to check errors and take corrective actions. This is done to minimize deviation from standards and ensure that the stated goals of the organization are achieved in a desired manner.

Brand awareness is the extent to which customers are able to recall or recognize a brand under different conditions. Brand awareness is one of two dimensions from brand knowledge, an associative network memory model. Brand awareness is a key consideration in consumer behavior, advertising management, and brand management. The consumer's ability to recognize or recall a brand is central to purchasing decision-making. Purchasing cannot proceed unless a consumer is first aware of a product category and a brand within that category. Awareness does not necessarily mean that the consumer must be able to recall a specific brand name, but they must be able to recall enough distinguishing features for purchasing to proceed. Creating brand awareness is the main step in advertising a new product or bringing back the older brand in light.

The McNamara fallacy, named for Robert McNamara, the US Secretary of Defense from 1961 to 1968, involves making a decision based solely on quantitative observations and ignoring all others. The reason given is often that these other observations cannot be proven.

But when the McNamara discipline is applied too literally, the first step is to measure whatever can be easily measured. The second step is to disregard that which can't easily be measured or given a quantitative value. The third step is to presume that what can't be measured easily really isn't important. The fo[u]rth step is to say that what can't be easily measured really doesn't exist. This is suicide.

Public budgeting is a field of public administration and a discipline in the academic study of public administration. Budgeting is characterized by its approaches, functions, formation, and type.

Human Resource (HR) metrics are measurements used to determine the value and effectiveness of HR initiatives, typically including such areas as turnover, training, return on human capital, costs of labor, and expenses per employee.

Test and evaluation master plan (TEMP) is a critical aspect of project management involving complex systems that must satisfy specification requirements. The TEMP is used to support programmatic events called milestone decisions that separate the individual phases of a project. For military systems, the level of funding determines the Acquisition Category and the organization responsible for the milestone decision.

The performance paradox is a theory set forth by Marshall W. Meyer and Vipin Gupta in 1994, which posits that organizations are able to maintain control by not knowing what exactly performance is. This theory is based on several facts of performance, namely that the number and type of performance measurements that exist are increasing at a rapid rate and that these new metrics tend to be weakly correlated with old ones.

A chief revenue officer (CRO) is a corporate officer (executive) responsible for all revenue generation processes in an organization. In this role, a CRO is accountable for driving better integration and alignment between all revenue-related functions, including marketing, sales, customer support, pricing, and revenue management.

References

  1. Muller, Jerry Z. (3 June 2021). "The perils of metric fixation". Medical Teacher. 43 (6): 622–624. doi:10.1080/0142159X.2020.1840745.
  2. 1 2 Lewinson, Eryk (2020-06-02). "On the tyranny of metrics and metric fixation". Medium. Retrieved 2024-03-11. In a world full of metrics, we need to clearly recognize those that do more harm than good
  3. Passmore, David L. (2019). "Review of The Tyranny of Metrics by JZ Muller". Performance Improvement. 58 (1): 34–36. doi:10.1002/pfi.2183.
  4. Lemieux, P. (2018). "Government Fixation Is the Problem". Regulation. 41: 74.