Market intelligence

Last updated

Market intelligence (MI) is gathering and analyzing information relevant to a company's market - trends, competitor and customer (existing, lost and targeted) monitoring. [1] It is a subtype of competitive intelligence (CI), which is data and information gathered by companies that provide continuous insight into market trends such as competitors' and customers' values and preferences. [1]

Contents

MI along with the marketing capabilities of an organization provides a guideline into the allocation and implementation of resources and processes. [2] It is used for the purpose of continuously supplying strategic marketing planning for organizations to gauge marketing positions in order for companies to gain competitive advantage and best meet objectives. [3] [1]

Organizations can develop MI frameworks and models that are suited to financial capabilities and desired market sectors but are mainly based on the four-step process of collection, validation, processing and communication of MI. [4] The gathering of MI data is sorted into many different categories, including, but not limited to, qualitative, quantitative, formal, informal, published, and unpublished. [5] MI data is gathered both internally and externally. [5]

Benefits that MI can bring are that it provides customer, competitor and market insights allowing organizations to gain a competitive advantage in their marketing strategies. [1] Issues that MI can bring is through acquiring data and information through illegal or unethical ways, it can lead to financial loss and government regulatory failures. [6]

Background and Development

MI and its broader term, marketing intelligence, was first introduced in “Marketing Intelligence for Top Management” by Kelley, [7] to provide information that was analyzed, reliable and consistent for an organization to better create policies and make business decisions. [7]

Following Kelley, in “How to Develop a Marketing Intelligence System”, R. Pinkerton shows the proactiveness of organizations as marketing intelligence systems is applied whilst the technological revolution arises. [8] Contributions to MI include professional organizations such as “Global Intelligence Alliance” and “the Society of Competitive Intelligence Professionals” (SCIP). [9] These organizations have contributed both empirical and theoretical research in an attempt to further define and understand MI. [9]

As research into MI comes from scholars and non-scholars of different backgrounds it has resulted in a fragmented state of research. This has led to MI being used interchangeably with other market terms such as competitive intelligence, business intelligence and strategic intelligence. [9] MI to this current date continues to change to meet organizational requirements. [7]

Framework

The implementation of MI varies depending on how organizations perceive it. [3] MI is defined as being composed of three main activities, these activities are Information Acquisition, the gathering of marketing information that is required for current and future customer needs, Information Analysis which is the intelligence gained from the information collected and Information Activation, which is using the intelligence to implement and develop marketing plans. [5]

Frameworks can be flexible, however the basis that organizations use to model the MI surrounds a four-step process, which are, collection, validation, processing and communication. [4] Data mining techniques are used throughout the processes to aid in the gathering and analyzing of data and information retrieved.[ citation needed ] MI is a continuous process that organizations need to keep track of to improve their strategic and tactical marketing planning. [10] These processes target the three activities that MI is defined by. [5] The model can be adjusted and adapted when required and can be implemented all at once or by sections. [3]

Collection

Collection is the first step in the MI model, it involves the gathering of data and information of a particular market sector. [3] Such data and information can be gathered from external sources, such as other organisations and their market strategies, research institutes and business reports. [3]

Internal factors can include looking into current strategy processes and personal customer trends. [3] It is estimated that 70% to 80% of intelligence resides within organizations employees or, internal MI network, as they are the team who gains information's when interacting with suppliers, customers and other industry contacts. [11] To involve employees into an intelligence program to gain data and information the following considerations can be noted: developing a rewards program to promote participation, providing MI goals, requirements and a timeframe for information to be given in and creating a proper communication method to promote the intelligence program with employees such as using an e-mail system. [12] [13]

A challenge that arises in the collection of data and information is the identification of relevant information, this is a result of organizations not clearly defining a market sector.[ citation needed ]

Validation

Shows the duplication of data which reduces data quality Duplicate Data Entries in Data Editing.png
Shows the duplication of data which reduces data quality

Validation is the second step in the MI model, this which can be referred to as data cleansing. [3] [15] The maintenance of good data quality is important as data and information is being retrieved from many different sources. [15] Data and information obtained from sources can be dirty, meaning that it is incomplete, wrong, inappropriate, duplicated. [3] This step will allow data and information to be adjusted and understandable to the organization, furthermore it allows for consistency and compliance to be present. [3] If data quality is not maintained correctly it can lead to organizational losses with revenue and governmental regulation failures. [6]

Method of Validation

Data cleansing is a complex process that involves several stages in order to get good data quality for MI strategy use. [15] Stages include defining the organization's level of data quality, detecting error from the data collected and then repairing the errors. [16] The five stages of data cleansing are data analysis to identify errors, eliminating the errors, checking to ensure elimination of error are done appropriately, refreshing the data in the data warehouse and finally replacing the dirty data with clean data. [17]

Processing

Processing is the third step in the MI model. [4] It involves the use of translating the clean data using organizational rules, modelling, logic and analysis to produce readable information, reports and spreadsheets that allows the organization to gain specified knowledge. [3] The interpretation of data into readable information is difficult as it is complex, it requires proper technology and heavy commitment from a top organizational level to match data and information gained and align it to a marketing strategy. [18]

Communication

Communication is the last step in the MI model. It involves the sharing, delivering and transmission of information gained from the processing step to figures in the organization who will apply it accordingly to the market strategy. [19]  As MI is a continuously changing, the communication of the MI strategy requires managers whom have expertise in the given market industry in order to determine the ongoing validity of the MI strategy and its implementation. [20] In order to make the communication of the MI strategy as successful as possible, this process must be performed by every level of an organization, also known as the intelligence organization. [8]

Intelligence Organization

Intelligence organization refers to the “people and information resources who make the market intelligence process happen”. [1] The five elements of an intelligence organization are, MI leadership who manages and leads the MI process, a MI team, a portfolio of external information sources that is set up by the MI team, internal MI network made up of MI users and the MI user's personal information source network. [1] An intelligence organization element is made up of external and internal factors that allows for a continuous MI process. [1] [8]

Gathering market intelligence data

Use of search engines in gathering MI A screenshot of suggestions by Google Search when "wikip" is typed.png
Use of search engines in gathering MI

The gathering of MI data is different dependent on an organization's financial capabilities. Sources of data and information is separated into qualitative, quantitative, formal, informal, published and unpublished. With such sources being retrieved both internally and externally from the organization. [8] It involves using search engines and corporate web sites to see competitor's strategies, identifying business trends through reputable publications and existing customer clientele. [21] Organizations use different systems to gather MI, one system is that is used is Open-source Intelligence system. [22]

Internal intelligence gathering

Sources of internal intelligence gathering include but are not limited to, gathering data from customers, manufacturers, through research and development (R&D), employees, also known as salesforce, physical evidence, sales quotes, sales records, trade shows and new hires. [23] These data sources were ranked by organizations on a scale measuring five for being very important to one being not important. It was founded that customers and manufacturers and R&D are the most important to organizations with one hundred percent of organizations ranking these data sources with the number four or higher [24] ,. It shows that in the process of collection and gathering MI data and information, these data sources brought the most value to organizations.

External intelligence gathering

Sources of external intelligence gathering is included but is not limited to, gathering data from client meetings, dealers/distributors, customers, business associates, market research projects, suppliers, online services, periodicals and government publications. [23] These data sources were compared on the same scale as internal intelligence gathering sources, with results showing that intelligence gathered through client meetings being the most important to organizations, with one hundred percent of organizations ranking this data source with the number four or higher. [24]

Information systems intelligence gathering

Marketing information systems allow for organizations to continuously acquire, generate, and maintain external and internal information. [25] They are systems that make use of artificial intelligence (AI) technology to aid in the planning of strategic and tactical marketing strategy of MI but also share marketing expertise. [25]

Open-source Intelligence (OSINT)

Open-source intelligence is a predominant form of MI gathering that organizations employ. OSINT is defined as the scanning, finding, gathering, exploitation, validation, analysis, and sharing with intelligence-seeking clients of publicly available print and digital/electronic data from unclassified, non-secret, and grey literature. [26] It is frequently used as its system is user friendly, its inexpensive and that it processes an abundant amount of raw materials that can be further processed. [22]

Impacts of market intelligence

Using MI can bring to organizations both benefits and issues depending on how MI is acquired, maintained, and implemented. Benefits that MI can bring includes but is not limited to gaining competitive advantage in their marketing strategies. [1] Issues that MI can bring can include but is not limited to, financial losses and government regulatory failures. [3]

Issues

There are issues that arises in the process of acquiring MI data and information and the implementation of an organizations marketing strategy. Issues such as the acquiring intelligence unethically and illegally can lead to failures with government regulations, also, if dirty data is not properly cleansed and problems aren't mitigated or resolved can lead to a range of negative impacts that can result in financial and reputational losses to the organization. [3] [6]

Legality and ethics

British Airways aeroplane Boeing 777-236ER - British Airways (G-VIIV).JPG
British Airways aeroplane

An issue that can arise is the unethical and illegal collection of data and information. Organizations can collect data for MI illegally or unethically to try to gain competitive advantages; this is known as industrial espionage. [28] An example of illegal MI collection practice is when British Airways breached the Data Protect Act 1984 through accessing Virgin's confidential flight details. [29] [3]

A standard of conduct was developed by the non-for-profit organization Society of Competitive Intelligence Professionals, creating a code of ethics that can be adhered to by organizations when collecting market intelligence, to prevent the illegal and unethical collection of data and information. [3]

Dirty Data

Dirty data that is collected needs to be cleansed to maintain good data quality. Challenges that arise in data cleansing is that there is a large volume of data being received leading to organizations being faced with many risks of failure to detect dirty data being processed through. [30] If data quality is not managed properly, it can result in financial losses, inefficient implementation of MI strategies and failure to comply with government regulations. [31] A reason for financial loss is due operational costs, as there is an increase in resources and time spent to identify and fix the dirty data. [6]

Benefits

MI processes have been used in many organization's strategic market planning, however, there are still difficulties in what the hard and soft benefits in using a MI process for an organization. [1] The benefits of a successful MI process can be sectioned into three categories, better and faster decisions, time and cost savings and organizational learning and new ideas, however, overall, it can improve profitability and the competitiveness of an organization. [1] The competitiveness of an organization increases as with more MI gathered it'll provide a way for organizations to innovate through improving current methods and increasing the ability to find and create new products. [32]

Related Research Articles

Customer relationship management (CRM) is a process in which a business or other organization administers its interactions with customers, typically using data analysis to study large amounts of information.

<span class="mw-page-title-main">Business model</span> Rationale of how an organization operates

A business model describes how an organization creates, delivers, and captures value, in economic, social, cultural or other contexts. The process of business model construction and modification is also called business model innovation and forms a part of business strategy.

Business intelligence comprises the strategies and technologies used by enterprises for the data analysis and management of business information. Common functions of business intelligence technologies include reporting, online analytical processing, analytics, dashboard development, data mining, process mining, complex event processing, business performance management, benchmarking, text mining, predictive analytics, and prescriptive analytics.

Consumer privacy is information privacy as it relates to the consumers of products and services.

In the field of management, strategic management involves the formulation and implementation of the major goals and initiatives taken by an organization's managers on behalf of stakeholders, based on consideration of resources and an assessment of the internal and external environments in which the organization operates. Strategic management provides overall direction to an enterprise and involves specifying the organization's objectives, developing policies and plans to achieve those objectives, and then allocating resources to implement the plans. Academics and practicing managers have developed numerous models and frameworks to assist in strategic decision-making in the context of complex environments and competitive dynamics. Strategic management is not static in nature; the models can include a feedback loop to monitor execution and to inform the next round of planning.

Marketing management is the organizational discipline which focuses on the practical application of marketing orientation, techniques and methods inside enterprises and organizations and on the management of a firm's marketing resources and activities.

In business, a competitive advantage is an attribute that allows an organization to outperform its competitors.

Marketing strategy is an organization's promotional efforts to allocate its resources across a wide range of platforms and channels to increase its sales and achieve sustainable competitive advantage within its corresponding market.

Marketing communications refers to the use of different marketing channels and tools in combination. Marketing communication channels focus on how businesses communicate a message to its desired market, or the market in general. It is also in charge of the internal communications of the organization. Marketing communication tools include advertising, personal selling, direct marketing, sponsorship, communication, public relations, social media, customer journey and promotion.

<span class="mw-page-title-main">Customer service</span> Provision of service to customers

Customer service is the assistance and advice provided by a company to those people who buy or use its products or services. Each industry requires different levels of customer service, but towards the end, the idea of a well-performed service is that of increasing revenues. The perception of success of the customer service interactions is dependent on employees "who can adjust themselves to the personality of the customer". Customer service is often practiced in a way that reflects the strategies and values of a firm. Good quality customer service is usually measured through customer retention. Customer service for some firms is part of the firm’s intangible assets and can differentiate it from others in the industry. One good customer service experience can change the entire perception a customer holds towards the organization.

<span class="mw-page-title-main">Business analyst</span> Person who analyses and documents a business

A business analyst (BA) is a person who processes, interprets and documents business processes, products, services and software through analysis of data. The role of a business analyst is to ensure business efficiency increases through their knowledge of both IT and business function.

Competitive intelligence (CI) is the process and forward-looking practices used in producing knowledge about the competitive environment to improve organizational performance. It involves the systematic collection and analysis of information from multiple sources, and a coordinated CI program. It is the action of defining, gathering, analyzing, and distributing intelligence about products, customers, competitors, and any aspect of the environment needed to support executives and managers in strategic decision making for an organization.

In marketing, segmenting, targeting and positioning (STP) is a framework that implements market segmentation. Market segmentation is a process, in which groups of buyers within a market are divided and profiled according to a range of variables, which determine the market characteristics and tendencies. The S-T-P framework implements market segmentation in three steps:

The target audience is the intended audience or readership of a publication, advertisement, or other message catered specifically to the previously intended audience. In marketing and advertising, the target audience is a particular group of consumer within the predetermined target market, identified as the targets or recipients for a particular advertisement or message.

Strategic communication can mean either communicating a concept, a process, or data that satisfies a long-term strategic goal of an organization by allowing facilitation of advanced planning, or communicating over long distances usually using international telecommunications or dedicated global network assets to coordinate actions and activities of operationally significant commercial, non-commercial and military business or combat and logistic subunits. It can also mean the related function within an organization, which handles internal and external communication processes. Strategic communication can also be used for political warfare.

<span class="mw-page-title-main">Digital marketing</span> Marketing of products or services using digital technologies or digital tools

Digital marketing is the component of marketing that uses the Internet and online-based digital technologies such as desktop computers, mobile phones, and other digital media and platforms to promote products and services. Its development during the 1990s and 2000s changed the way brands and businesses use technology for marketing. As digital platforms became increasingly incorporated into marketing plans and everyday life, and as people increasingly used digital devices instead of visiting physical shops, digital marketing campaigns have become prevalent, employing combinations of search engine optimization (SEO), search engine marketing (SEM), content marketing, influencer marketing, content automation, campaign marketing, data-driven marketing, e-commerce marketing, social media marketing, social media optimization, e-mail direct marketing, display advertising, e-books, and optical disks and games have become commonplace. Digital marketing extends to non-Internet channels that provide digital media, such as television, mobile phones, callbacks, and on-hold mobile ringtones. The extension to non-Internet channels differentiates digital marketing from online marketing.

Market environment and business environment are marketing terms that refer to factors and forces that affect a firm's ability to build and maintain successful customer relationships. The business environment has been defined as "the totality of physical and social factors that are taken directly into consideration in the decision-making behaviour of individuals in the organisation."


Customer experience is the totality of cognitive, affective, sensory, and behavioral customer responses during all stages of the consumption process including pre-purchase, consumption, and post-purchase stages.

Market orientation is the extent to which an organisation behaves in response to a given market. Kohli and Jaworski define market orientation as "the organization-wide generation of market intelligence, dissemination of the intelligence across departments and organization-wide responsiveness to it". Narver and Slater define market orientation as "the organization culture that most effectively and efficiently creates the necessary behaviours for the creation of superior value for buyers and, thus, continuous superior performance for the business".

Product marketing is a sub-field of marketing that is responsible for crafting the messaging, go-to-market flow, and promotion of a product. Product marketing managers can also be involved in defining and sizing target markets. They collaborate with other stakeholders including business development, sales, and technical functions such as product management and engineering. Other critical responsibilities include positioning and sales enablement.

References

  1. 1 2 3 4 5 6 7 8 9 10 Hedin, Hans; Hirvensalo, Irmeli; Vaarnas, Markko, eds. (2012-01-02). The Handbook of Market Intelligence. doi:10.1002/9781119208082. ISBN   9781119208082.
  2. Carson, Grace; O'Connor, Christina; Simmons, Geoff (2020-01-01). "The crucial role of market intelligence in the development of small business marketing capabilities". Journal of Small Business and Enterprise Development. 27 (5): 797–816. doi:10.1108/JSBED-12-2019-0394. ISSN   1462-6004. S2CID   225735797.
  3. 1 2 3 4 5 6 7 8 9 10 11 12 13 14 Jamil, George Leal (2013-01-01). "Approaching Market Intelligence Concept through a Case Analysis: Continuous Knowledge for Marketing Strategic Management and its Complementarity to Competitive Intelligence". Procedia Technology. 9: 463–472. doi: 10.1016/j.protcy.2013.12.051 . ISSN   2212-0173.
  4. 1 2 3 Jamil, George Leal (2013). "Approaching Market Intelligence Concept through a Case Analysis: Continuous Knowledge for Marketing Strategic Management and its Complementarity to Competitive Intelligence". Procedia Technology. 9: 466. doi: 10.1016/j.protcy.2013.12.051 . ISSN   2212-0173.
  5. 1 2 3 4 Kumar Vishnoi, Sushant; Bagga, Teena (2020). "Marketing Intelligence: Antecedents and Consequences". SSRN Electronic Journal: 2. doi:10.2139/ssrn.3563107. ISSN   1556-5068. S2CID   229598952.
  6. 1 2 3 4 Redman, Thomas C. (1998). "The impact of poor data quality on the typical enterprise". Communications of the ACM. 41 (2): 81. doi: 10.1145/269012.269025 . ISSN   0001-0782. S2CID   17205136.
  7. 1 2 3 Kelley, William T. (1965-10-01). "Marketing Intelligence for Top Management". Journal of Marketing. 29 (4): 19–24. doi:10.1177/002224296502900405. ISSN   0022-2429. S2CID   168050731.
  8. 1 2 3 4 Kumar Vishnoi, Sushant; Bagga, Teena (2020-03-28). "Marketing Intelligence: Antecedents and Consequences". Rochester, NY. doi:10.2139/ssrn.3563107. S2CID   229598952. SSRN   3563107.{{cite journal}}: Cite journal requires |journal= (help)
  9. 1 2 3 Egan, Michelle P. (2001-06-14), "Conclusion: Governance and Market-Building", Constructing a European Market, Oxford University Press, pp. 260–272, doi:10.1093/0199244057.003.0011, ISBN   978-0-19-924405-8 , retrieved 2021-05-31
  10. Fuller, Connie J. (6 January 2023). "What is Tactical Marketing?". Marketing . Retrieved 6 January 2023.
  11. Tsu Wee Tan, Thomas; Ahmed, Zafar U. (1999). "Managing market intelligence: an Asian marketing research perspective". Marketing Intelligence & Planning. 17 (6): 39. doi:10.1108/02634509910293124. ISSN   0263-4503.
  12. Tsu Wee Tan, Thomas; Ahmed, Zafar U. (1999). "Managing market intelligence: an Asian marketing research perspective". Marketing Intelligence & Planning. 17 (6): 302. doi:10.1108/02634509910293124. ISSN   0263-4503.
  13. Gordon, Ian, June 19- (1989). Beat the competition : how to use competitive intelligence to develop winning business strategies. Oxford, UK: B. Blackwell. ISBN   0-631-15991-6. OCLC   19125425.{{cite book}}: CS1 maint: multiple names: authors list (link) CS1 maint: numeric names: authors list (link)
  14. 1 2 "Creative Commons — Attribution-ShareAlike 4.0 International — CC BY-SA 4.0". creativecommons.org. Retrieved 2021-05-31.
  15. 1 2 3 Ridzuan, Fakhitah; Wan Zainon, Wan Mohd Nazmee (2019-01-01). "A Review on Data Cleansing Methods for Big Data". Procedia Computer Science. 161: 731–738. doi: 10.1016/j.procs.2019.11.177 . ISSN   1877-0509.
  16. Ridzuan, Fakhitah; Wan Zainon, Wan Mohd Nazmee (2019-01-01). "A Review on Data Cleansing Methods for Big Data". Procedia Computer Science. 161: 732. doi: 10.1016/j.procs.2019.11.177 . ISSN   1877-0509.
  17. Ridzuan, Fakhitah; Wan Zainon, Wan Mohd Nazmee (2019-01-01). "A Review on Data Cleansing Methods for Big Data". Procedia Computer Science. 161: 734. doi: 10.1016/j.procs.2019.11.177 . ISSN   1877-0509.
  18. Fleisher, Craig (1990). "The competitive analysis of non-market intelligence". Competitive Intelligence Review. 1 (2): 11–13. doi:10.1002/cir.3880010206. ISSN   1058-0247.
  19. Heang, Rasmey (2017). BOOK REVIEW: THE USE OF MARKET INTELLIGENCEIN COMPETITIVE ANALYSIS. Digitala Vetenskapliga Arkivet. p. 8.
  20. Heang, Rasmey (2017). BOOK REVIEW: THE USE OF MARKET INTELLIGENCEIN COMPETITIVE ANALYSIS. Digitala Vetenskapliga Arkivet. p. 48.
  21. "SCIP Europe established". Competitive Intelligence Review. 2 (1): 51–52. 1991. doi:10.1002/cir.3880020129. ISSN   1058-0247.
  22. 1 2 Sharma, Arun (2020-07-17). "The organization of customer support services". European Journal of Marketing. 54 (7): 1813–1814. doi: 10.1108/ejm-07-2020-974 . ISSN   0309-0566.
  23. 1 2 Lackman, Conway; Saban, Kenneth; Lanasa, John (2000-02-01). "The contribution of market intelligence to tactical and strategic business decisions". Marketing Intelligence & Planning. 18 (1): 8. doi:10.1108/02634500010308530. ISSN   0263-4503.
  24. 1 2 Lackman, Conway; Saban, Kenneth; Lanasa, John (2000-02-01). "The contribution of market intelligence to tactical and strategic business decisions". Marketing Intelligence & Planning. 18 (1): 7. doi:10.1108/02634500010308530. ISSN   0263-4503.
  25. 1 2 Kumar Vishnoi, Sushant; Bagga, Teena (2020). "Marketing Intelligence: Antecedents and Consequences". SSRN Electronic Journal: 4. doi:10.2139/ssrn.3563107. ISSN   1556-5068. S2CID   229598952.
  26. Fleisher, Craig S. (2008-07-25). Calof, Jonathan L. (ed.). "Using open source data in developing competitive and marketing intelligence". European Journal of Marketing. 42 (7/8): 853. doi:10.1108/03090560810877196. ISSN   0309-0566.
  27. "Creative Commons — Attribution-ShareAlike 3.0 Unported — CC BY-SA 3.0". creativecommons.org. Retrieved 2021-05-31.
  28. Button, Mark (2020-03-01). "Editorial: economic and industrial espionage". Security Journal. 33 (1): 2. doi: 10.1057/s41284-019-00195-5 . ISSN   1743-4645.
  29. "Battle of the Airlines: Computer hacking of flight details 'was". The Independent. 2011-10-22. Retrieved 2021-05-19.
  30. Amaravadi, Chandra S.; Samaddar, Subhashish; Dutta, Siddhartha (1995). "Intelligent marketing information systems:: computerized intelligence for marketing decision making". Marketing Intelligence & Planning. 13 (2): 734. doi:10.1108/02634509510083464. ISSN   0263-4503.
  31. Redman, Thomas C. (1998). "The impact of poor data quality on the typical enterprise". Communications of the ACM. 41 (2): 80. doi: 10.1145/269012.269025 . ISSN   0001-0782. S2CID   17205136.
  32. "[EBOOK] Market Intelligence: Stand out with Data Monitoring". resources.rockcontent.com. Retrieved 2021-06-02.