Concept testing

Last updated

Concept testing (to be distinguished from pre-test markets and test markets which may be used at a later stage of product development research) [1] is the process of using surveys (and sometimes qualitative methods) to evaluate consumer acceptance of a new product idea prior to the introduction of a product to the market. [2] It is important not to confuse concept testing with advertising testing, brand testing and packaging testing, as is sometimes done. Concept testing focuses on the basic product idea, without the embellishments and puffery inherent in advertising.

Contents

Questionnaires

It is important that the instruments (questionnaires) to test the product have a high quality themselves. Otherwise, results from data gathered surveys may be biased by measurement error. That makes the design of the testing procedure more complex. Empirical tests provide insight into the quality of the questionnaire. This can be done by:

Concept testing

Concept testing in the new product development (NPD) process is the concept generation stage. The concept generation stage of concept testing can take on many forms. Sometimes concepts are generated incidentally, as the result of technological advances. At other times concept generation is deliberate: examples include brain-storming sessions, problem detection surveys and qualitative research. While qualitative research can provide insights into the range of reactions consumers may have, it cannot provide an indication of the likely success of the new concept; this is better left to quantitative concept-test surveys.

In the early stages of concept testing, a large field of alternative concepts might exist, requiring concept-screening surveys. Concept-screening surveys provide a quick means to narrow the field of options; however they provide little depth of insight and cannot be compared to a normative database due to interactions between concepts. For greater insight and to reach decisions on whether or not pursue further product development, monadic concept-testing surveys must be conducted.

Presentation modes

Frequently concept testing surveys are described as either monadic, sequential monadic, comparative, or proto-monadic. The terms mainly refer to how the concepts are displayed:

"Monadic testing is the recommended method for most concept testing. Interaction effects and biases are avoided. Results from one test can be compared to results from previous monadic tests. A normative database can be constructed." [7] However, each has its specific uses and it depends on the research objectives. The decision as to which method to use is best left to experience research professionals to decide, as there are numerous implications in terms of how the results are interpreted.

Evaluating concept-test scores

Traditionally concept-test survey results are compared to 'norms databases'. [8] These are databases of previous new-product concept tests. These must be 'monadic' concept tests, to prevent interaction effects. To be fair, it is important that these databases contain 'new' concept test results, not ratings of old products that consumers are already familiar with; since once consumers become familiar with a product the ratings often drop. Comparing new concept ratings to the ratings for an existing product already on the market would result in an invalid comparison, unless special precautions are taken by researchers to reduce or adjust for this effect quantitatively. Additionally, the concept is usually only compared to norms from the same product category, and the same country.

Companies that specialize in this area, tend to have developed their own unique systems, each with its own standards. Keeping to these standards consistently is important to preventing contamination of the results.

Perhaps one of the famous concept-test systems is the Nielsen Bases system, which comes in different versions. Other well-known products include Decision Analyst's 'Concept Check', Acupoll's 'Concept Optimizer', Ipsos Innoquest and GFK. Examples of smaller players include Skuuber and Acentric Express Test.

Determining the importance of concept attributes as purchase drivers

The simplest approach to determining attribute importance is to ask direct open-ended questions. Alternatively checklists or ratings of the importance of each product attribute may be used.

However, various debates have existed over whether or not consumers could be trusted to directly indicate the level of importance of each product attribute. As a result, correlation analysis and various forms of multiple regression have often been used for identifying importance - as an alternative to direct questions.

A complementary technique to concept testing, is conjoint analysis (also referred to as discrete choice modelling). Various forms of conjoint analysis and discrete choice modelling exist. While academics stress the differences between the two, in practice there is often little difference. These techniques estimate the importance of product attributes indirectly, by creating alternative products according to an experimental design, and then using consumer responses to these alternatives (usually ratings of purchase likelihood or choices made between alternatives) to estimate importance. The results are often expressed in the form of a 'simulator' tool which allows clients to test alternative product configurations and pricing.

Volumetric concept testing

Volumetric concept testing falls somewhere between traditional concept testing and pre-test market models (simulated test market models are similar but emphasize greater realism) in terms of the level of complexity. The aim is to provide 'approximate' sales volume forecasts for the new concept prior to launch. They incorporate other variables beyond just input from the concept test survey itself, such as the distribution strategy.

Examples of volumetric forecasting methodologies include 'Acupoll Foresight' [9] and Decision Analyst's 'Conceptor'. [10]

Some models (more properly referred to as 'pre-test market models' or 'simulated test markets') [11] gather additional data from a follow-up product testing survey (especially in the case of consumer packaged goods as repeat purchase rates need to be estimated). They may also include advertisement testing component that aims to assess advertising quality. Some such as Decision Analyst, include discrete choice models / conjoint analysis.

See also

Related Research Articles

Marketing research is the systematic gathering, recording, and analysis of qualitative and quantitative data about issues relating to marketing products and services. The goal is to identify and assess how changing elements of the marketing mix impacts customer behavior.

Market research is an organized effort to gather information about target markets and customers: know about them, starting with who they are. It is an important component of business strategy and a major factor in maintaining competitiveness. Market research helps to identify and analyze the needs of the market, the market size and the competition. Its techniques encompass both qualitative techniques such as focus groups, in-depth interviews, and ethnography, as well as quantitative techniques such as customer surveys, and analysis of secondary data.

Questionnaire construction refers to the design of a questionnaire to gather statistically useful information about a given topic. When properly constructed and responsibly administered, questionnaires can provide valuable data about any given subject.

<span class="mw-page-title-main">Conjoint analysis</span> Survey-based statistical technique

Conjoint analysis is a survey-based statistical technique used in market research that helps determine how people value different attributes that make up an individual product or service.

<span class="mw-page-title-main">Likert scale</span> Psychometric measurement scale

A Likert scale is a psychometric scale named after its inventor, American social psychologist Rensis Likert, which is commonly used in research questionnaires. It is the most widely used approach to scaling responses in survey research, such that the term is often used interchangeably with rating scale, although there are other types of rating scales.

<span class="mw-page-title-main">Consumer behaviour</span> Study of individuals, groups, or organisations and all the activities associated with consuming

Consumer behaviour is the study of individuals, groups, or organisations and all the activities associated with the purchase, use and disposal of goods and services. Consumer behaviour consists of how the consumer's emotions, attitudes, and preferences affect buying behaviour. Consumer behaviour emerged in the 1940–1950s as a distinct sub-discipline of marketing, but has become an interdisciplinary social science that blends elements from psychology, sociology, social anthropology, anthropology, ethnography, ethnology, marketing, and economics.

Kansei engineering aims at the development or improvement of products and services by translating the customer's psychological feelings and needs into the domain of product design. It was founded by Mitsuo Nagamachi, Professor Emeritus of Hiroshima University. Kansei engineering parametrically links the customer's emotional responses to the properties and characteristics of a product or service. In consequence, products can be designed to bring forward the intended feeling.

The Kano model is a theory for product development and customer satisfaction developed in the 1980s by Noriaki Kano, which classifies customer preferences into five categories.

SERVQUAL is a multi-dimensional research instrument designed to capture consumer expectations and perceptions of a service along five dimensions that are believed to represent service quality. SERVQUAL is built on the expectancy-disconfirmation paradigm, which, in simple terms, means that service quality is understood as the extent to which consumers' pre-consumption expectations of quality are confirmed or disconfirmed by their actual perceptions of the service experience. When the SERVQUAL questionnaire was first published in 1985 by a team of academic researchers, A. Parasuraman, Valarie Zeithaml and Leonard L. Berry to measure quality in the service sector, it represented a breakthrough in the measurement methods used for service quality research. The diagnostic value of the instrument is supported by the model of service quality which forms the conceptual framework for the development of the scale. The instrument has been widely applied in a variety of contexts and cultural settings and found to be relatively robust. It has become the dominant measurement scale in the area of service quality. In spite of the long-standing interest in SERVQUAL and its myriad of context-specific applications, it has attracted some criticism from researchers.

Decision Analyst is an American marketing research and consulting firm based in Arlington, Texas. The firm provides global research and analytical consulting services to major corporations, advertising agencies, and marketing consultancies in the Americas, Europe, Asia, the Middle East, and Africa. It is wholly owned by its employees and is headquartered in the Dallas-Fort Worth area of Texas.

A market analysis studies the attractiveness and the dynamics of a special market within a special industry. It is part of the industry analysis and thus in turn of the global environmental analysis. Through all of these analyses the strengths, weaknesses, opportunities and threats (SWOT) of a company can be identified. Finally, with the help of a SWOT analysis, adequate business strategies of a company will be defined. The market analysis is also known as a documented investigation of a market that is used to inform a firm's planning activities, particularly around decisions of inventory, purchase, work force expansion/contraction, facility expansion, purchases of capital equipment, promotional activities, and many other aspects of a company.

The following outline is provided as an overview of and topical guide to marketing:

Rule-developing experimentation or RDE is a systematized solution-oriented business process of experimentation that designs, tests, and modifies alternative ideas, packages, products, or services in a disciplined way using experimental design, so that the developer and marketer discover what appeals to the customer, even if the customer can't articulate the need, much less the solution.

Choice modelling attempts to model the decision process of an individual or segment via revealed preferences or stated preferences made in a particular context or contexts. Typically, it attempts to use discrete choices in order to infer positions of the items on some relevant latent scale. Indeed many alternative models exist in econometrics, marketing, sociometrics and other fields, including utility maximization, optimization applied to consumer theory, and a plethora of other identification strategies which may be more or less accurate depending on the data, sample, hypothesis and the particular decision being modelled. In addition, choice modelling is regarded as the most suitable method for estimating consumers' willingness to pay for quality improvements in multiple dimensions.

Demand forecasting refers to the process of predicting the quantity of goods and services that will be demanded by consumers at a future point in time. More specifically, the methods of demand forecasting entail using predictive analytics to estimate customer demand in consideration of key economic conditions. This is an important tool in optimizing business profitability through efficient supply chain management. Demand forecasting methods are divided into two major categories, qualitative and quantitative methods. Qualitative methods are based on expert opinion and information gathered from the field. This method is mostly used in situations when there is minimal data available for analysis such as when a business or product has recently been introduced to the market. Quantitative methods, however, use available data, and analytical tools in order to produce predictions. Demand forecasting may be used in resource allocation, inventory management, assessing future capacity requirements, or making decisions on whether to enter a new market.

Multivariate landing page optimization (MVLPO) is a specific form of landing page optimization where multiple variations of visual elements on a webpage are evaluated. For example, a given page may have k choices for the title, m choices for the featured image or graphic, and n choices for the company logo. This example yields k×m×n landing page configurations.

Product Planning, or product discovery, is the ongoing process of identifying and articulating market requirements that define a product's feature set. It serves as the basis for decision-making about price, distribution and promotion. Product planning is also the means by which companies and businesses can respond to long-term challenges within the business environment, often achieved by managing the product throughout its life cycle using various marketing strategies, including product extensions or improvements, increased distribution, price changes and promotions. It involves understanding the needs and wants of core customer groups so products can target key customer desires and allows a firm to predict how a product will be received within a market upon launch.

Willem Egbert (Wim) Saris is a Dutch sociologist and Emeritus Professor of Statistics and Methodology, especially known for his work on "Causal modelling in non-experimental research" and measurement errors.

Marketing engineering is currently defined as "a systematic approach to harness data and knowledge to drive effective marketing decision making and implementation through a technology-enabled and model-supported decision process".

SIMALTO – SImultaneous Multi-Attribute Trade Off – is a survey based statistical technique used in market research that helps determine how people prioritise and value alternative product and/or service options of the attributes that make up individual products or services.

References

  1. ↑ Wind, Yoram (1984). NEW-PRODUCT FORECASTING MODELS AND APPLICATIONS . Lexington Books. ISBN   978-0-669-04102-6.
  2. ↑ Schwartz, David (1987). Concept Testing: How to Test New Product Ideas Before You Go to Market (1st ed.). American Management Association. ISBN   978-0814459058.
  3. ↑ Lord, F. and Novick, M. R.(1968). Statistical theories of mental test scores. Addison – Wesley.
  4. ↑ Heise, D. R.(1969). Separating reliability and stability in test-retest correlation. American Sociological Review, 34, 93-101.
  5. ↑ Andrews, F. M. (1984). Construct validity and error components of survey measures: a structural modelling approach. Public Opinion Quarterly, 48, 409-442.
  6. ↑ Saris, W. E. and Gallhofer, I. N. (2014). Design, evaluation and analysis of questionnaires for survey research. Second Edition. Hoboken, Wiley.
  7. ↑ Thomas, Jerry (2016-01-11). "Concept Testing (And The "Uniqueness" Paradox)". Decision Analyst. Decision Analyst. Retrieved 21 April 2017.
  8. ↑ Thomas, Jerry (2016-01-11). "Concept Testing (And The "Uniqueness" Paradox)". Decision Analyst. Decision Analyst. Retrieved 21 April 2017.
  9. ↑ "ForeSIGHT™ Going-Year Volume Estimates". Acupoll. Archived from the original on 31 March 2017. Retrieved 21 April 2017.
  10. ↑ "Conceptor® Volumetric Forecasting". Decision Analyst. 2015-12-28. Retrieved 21 April 2017.
  11. ↑ Wind, Yoram (1984). NEW-PRODUCT FORECASTING MODELS AND APPLICATIONS . Lexington Books. ISBN   978-0-669-04102-6.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.