Copy testing

Last updated

Copy testing is a specialized field of marketing research, that determines an advertisement's effectiveness based on consumer responses, feedback, and behavior. Also known as pre-testing, it might address all media channels including television, print, radio, outdoor signage, internet, and social media.

Contents

Automated Copy Testing is a specialized type of digital marketing specifically related to digital advertising. This involves using software to deploy copy variations of digital advertisements to a live environment and collecting data from real users. These automated copy tests will generally use a Z-test to determine the statistical significance of results. If a specific ad variation out performs the baseline in the copy test, to a desired level of statistical significance, this new copy variation should be used by the marketer.

Features

In 1982, a consortium of 21 leading advertising agencies — including N. W. Ayer, D’Arcy, Grey, McCann Erickson, Needham Harper & Steers, Ogilvy & Mather, J. Walter Thompson, and Young & Rubicam — released a public document laying out the PACT (Positioning Advertising Copy Testing) Principles that constitute a good copy testing system. PACT states a good copy testing system must meet the following criteria:

  1. Provides measurements which are relevant to the objectives of the advertising.
  2. Requires agreement about how the results will be used in advance of each specific test.
  3. Provides multiple measurements, because single measurements are generally inadequate to assess the performance of an advertisement.
  4. Based on a model of human response to communications – the reception of a stimulus, the comprehension of the stimulus, and the response to the stimulus.
  5. Allows for consideration of whether the advertising stimulus should be exposed more than once.
  6. Recognizes that the more finished a piece of copy is, the more soundly it can be evaluated and requires, as a minimum, that alternative executions be tested in the same degree of finish.
  7. Provides controls to avoid the biasing effects of the exposure context.
  8. Takes into account basic considerations of sample definition.
  9. Demonstrates reliability and validity.

Types of copy testing measurements

Recall

The predominant copy testing measure of the 1950s and 1960s, Burke's Day-After Recall (DAR) was interpreted to measure an ad's ability to “break through” into the mind of the consumer and register a message from the brand in long-term memory (Honomichl). Once this measure was adopted by Procter and Gamble, it became a research staple (Honomichl).

In the 70s, 80s, and 90s, validation efforts found no link between recall scores and actual sales (Adams & Blair; Blair; Blair & Kuse; Blair & Rabuck; Jones; Jones & Blair; MASB; Mondello; Stewart). For example, Procter and Gamble reviewed 10 year's worth of split-cable tests (100 total) and found no significant relationship between recall scores and sales (Young, pp. 3–30). In addition, Wharton University's Leonard Lodish conducted an even more extensive review of test market results and also failed to find a relationship between recall and sales (Lodish pp. 125–139).

The 1970s also saw a re-examination of the “breakthrough” measure. As a result, an important distinction was made between the attention-getting power of the creative execution and how well “branded” the ad was. Thus, the separate measures of attention and branding were born (Young, p. 12).

Persuasion

In the 1970s and 1980s, after DAR was determined to be a poor predictor of sales, the research industry began to depend on a measure of persuasion as an accurate predictor of sales. This shift was led, in part, by researcher Horace Schwerin who pointed out, “the obvious truth is that a claim can be well remembered but completely unimportant to the prospective buyer of the product – the solution the marketer offers is addressed to the wrong need” (Honomichl). As with DAR, it was Procter and Gamble's acceptance of the ARS Persuasion measure (also known as brand preference ) that made it an industry standard. Recall scores were still provided in copy testing reports with the understanding that persuasion was the measure that mattered (Honomichl).

Harold Ross of Mapes & Ross found that persuasion was a better predictor of sales than recall (Ross), and the predictive validity of ARS Persuasion to sales has been reported in several refereed publications (Adams & Blair; Jones & Blair; MASB; Mondello ).

Diagnostic

The main purpose of diagnostic measures is optimization. Understanding diagnostic measures can help advertisers identify creative opportunities to improve executions (Young, p. 7).

Non-Verbal

Non-verbal measures were developed in response to the belief that much of a commercial's effects – e.g. the emotional impact – may be difficult for respondents to put into words or scale on verbal rating statements. In fact, many believe the commercial's effects may be operating below the level of consciousness (Young, p. 7). According to researcher Chuck Young, “There is something in the lovely sounds of our favorite music that we cannot verbalize – and it moves us in ways we cannot express” (Young, p. 22).

In the 1970s, researchers sought to measure these non-verbal measures biologically by tracking brain wave activities as respondents watched commercials (Krugman). Others experimented with galvanic skin response, voice pitch analysis, and eye-tracking (Young, p. 22). These efforts were not popularly adopted, in part because of the limitations of the technology as well as the poor cost-effectiveness of what was widely perceived as academic, not actionable research.

In the early 1980s the shift in analytical perspective from thinking of a commercial as the fundamental unit of measurement to be rated in its entirety, to thinking of it as a structured flow of experience, gave rise to experimentation with moment-by-moment systems. The most popular of these was the dial-a-meter response which required respondents to turn a meter, in degrees, toward one end of a scale or another to reflect their opinion of what was on screen at that moment.

More recently, research companies have started to use psychological tests, such as the Stroop effect, to measure the emotional impact of copy. These techniques exploit the notion that viewers do not know why they react to a product, image, or ad in a certain way (or that they reacted at all) because such reactions occur outside of awareness, through changes in networks of thoughts, ideas, and images.

Moderated and Unmoderated

Researcher-moderated empirical testing and unmoderated testing platforms evaluate implicit and unconscious bias in survey question design for market research. [1]

Copy testing in political elections

Copy testing is utilized in an array of fields ranging from commercial development to presidential elections. In 2007, CNN employed this form of market testing throughout the primary and general election. Rita Kirk and Dan Schill from Southern Methodist University worked with CNN to gauge voters reaction to debates between presidential hopefuls. (http://www.cnn.com/2011/POLITICS/06/14/dial.testing/index.html)

Relevant Terms

See also

Related Research Articles

<span class="mw-page-title-main">Advertising</span> Form of communication for marketing

Advertising is the practice and techniques employed to bring attention to a product or service. Advertising aims to put a product or service in the spotlight in hopes of drawing it attention from consumers. It is typically used to promote a specific good or service, but there are wide range of uses, the most common being the commercial advertisement.

Marketing research is the systematic gathering, recording, and analysis of qualitative and quantitative data about issues relating to marketing products and services. The goal is to identify and assess how changing elements of the marketing mix impacts customer behavior.

Brand equity, in marketing, is the worth of a brand in and of itself – i.e., the social value of a well-known brand name. The owner of a well-known brand name can generate more revenue simply from brand recognition, as consumers perceive the products of well-known brands as better than those of lesser-known brands.

<span class="mw-page-title-main">Banner blindness</span> Tendency to ignore banner-size notices

Banner blindness is a phenomenon in web usability where visitors to a website consciously or unconsciously ignore banner-like information. A broader term covering all forms of advertising is ad blindness, and the mass of banners that people ignore is called banner noise.

<span class="mw-page-title-main">Advertising management</span> Part of the advertising industry

Advertising management is a planned managerial process designed to oversee and control the various advertising activities involved in a program to communicate with a firm's target market and which is ultimately designed to influence the consumer's purchase decisions. Advertising is just one element in a company's promotional mix and as such, must be integrated with the overall marketing communications program. Advertising is, however, the most expensive of all the promotional elements and therefore must be managed with care and accountability. Advertising management process also helps in defining the outline of the media campaign and in deciding which type of advertising would be used before the launch of a product.

In advertising, a gross rating point (GRP) measures the size of an audience that an advertisement impacts. GRPs help answer how often "must someone see it before they can readily recall it" and "how many times" does it take before the desired outcome occurs.

Salience is the state or condition of being prominent. The Oxford English Dictionary defines salience as "most noticeable or important." The concept is discussed in communication, semiotics, linguistics, sociology, psychology, and political science. It has been studied with respect to interpersonal communication, persuasion, politics, and its influence on mass media.

Advertising adstock or advertising carry-over is the prolonged or lagged effect of advertising on consumer purchase behavior. Adstock is an important component of marketing-mix models. The term "adstock" was coined by Simon Broadbent. Adstock is a model of how the response to advertising builds and decays in consumer markets. Advertising tries to expand consumption in two ways; it both reminds and teaches. It reminds in-the-market consumers in order to influence their immediate brand choice and teaches them to increase brand awareness and salience, which makes it easier for future advertising to influence brand choice. Adstock is the mathematical manifestation of this behavioral process.

Top-of-mind awareness (TOMA) is a measure of how aware is a consumer of a brand. It is part of consumer behaviour, and is a key aspect of marketing research and marketing communications.

The brand development index or BDI quantifies how well a brand performs in a market, compared with its average performance among all markets. That is, it measures the relative sales strength of a brand within a specific market.

Advertising research is a systematic process of marketing research conducted to improve the efficiency of advertising. Advertising research is a detailed study conducted to know how customers respond to a particular ad or advertising campaign.

The following outline is provided as an overview of and topical guide to marketing:

Return on marketing investment (ROMI) is the contribution to profit attributable to marketing, divided by the marketing 'invested' or risked. ROMI is not like the other 'return-on-investment' (ROI) metrics because marketing is not the same kind of investment. Instead of money that is 'tied' up in plants and inventories, marketing funds are typically 'risked'. Marketing spending is typically expensed in the current period.

Ameritest is an international advertising research firm, headquartered in Albuquerque, New Mexico, which provides its clients with worldwide market research on their advertising concepts, and executions.

Brand awareness is the extent to which customers are able to recall or recognize a brand under different conditions. Brand awareness is one of two dimensions from brand knowledge, an associative network memory model. Brand awareness is a key consideration in consumer behavior, advertising management, and brand management. The consumer's ability to recognize or recall a brand is central to purchasing decision-making. Purchasing cannot proceed unless a consumer is first aware of a product category and a brand within that category. Awareness does not necessarily mean that the consumer must be able to recall a specific brand name, but they must be able to recall enough distinguishing features for purchasing to proceed. Creating brand awareness is the main step in advertising a new product or bringing back the older brand in light.

Marketing buzz or simply buzz—a term used in viral marketing—is the interaction of consumers and users with a product or service which amplifies or alters the original marketing message. This emotion, energy, excitement, or anticipation about a product or service can be positive or negative. Buzz can be generated by intentional marketing activities by the brand owner or it can be the result of an independent event that enters public awareness through social or traditional media such as newspapers. Marketing buzz originally referred to oral communication but in the age of Web 2.0, social media such as Facebook, Twitter, Instagram and YouTube are now the dominant communication channels for marketing buzz.

The Marketing Accountability Standards Board (MASB), authorized by the Marketing Accountability Foundation, is an independent, private sector, self-governing group of academics and practitioners that establishes marketing measurement and accountability standards intended for continuous improvement in financial performance, and for the guidance and education of users of performance and financial information.

NAXION previously known as National Analysts Worldwide, is an American marketing research company that originally worked as a division of the Curtis Publishing Company. It was founded by Charles Coolidge Parlin in 1911. Donald M. Hobart, future head of the division, joined in 1923, though he ended up resigning from the company in 1928 because he desired to work on the selling side of the concept. He was asked to rejoin the company and become the head of the division in 1938 after Parlin had decided to retire. It is considered to be the "first commercial research company" ever formed. It became an independent organization in 1943 in order to "provide research services to industry and government."

One of the indicators of the strength of a brand in the hearts and minds of customers, brand preference represents which brands are preferred under assumptions of equality in price and availability.

Media context studies refers to the group of studies investigating “how and which media context variables influence the effects of the advertisements embedded in the context“. Media researchers found that media context affects ad recall, ad recognition, level and nature of ad processing, ad attitude and ad cognitions, brand attitude, and purchase intention.

References

  1. Geisen, Emily; Sha, Mandy; Roper, Farren (2024). Bias testing in market research: A framework to enable inclusive research design (published January 3, 2024). p. 31. ISBN   979-8862902785.

    References