Online panel

Last updated

An online panel (formerly called a discontinuous access panel) is a group of selected research participants who have agreed to provide information at specified intervals over an extended period of time. [1]

Contents

History and terminology

Online panels are a form of access panel. [2] The ISO standard ISO 20252 defines it as "a sample database of potential respondents who declare that they will cooperate for future data collection if selected". [2] Panel members are typically recruited through an agency campaign, often with some kind of incentive, or appealing to those who simply wish to share their opinion. [1] Online panel data (OPD) is widely used in market research. [3] [2] Other fields that contain prominent usage of online panel data include psychological, social, and medical research, as well as electoral studies. [2]

Online panels were first utilized in academic journals in the late 1990s, though similar ideas had been proposed in the 1980s. Usage has steadily increased since this time, with one analysis putting their prevalence at 14.3% of their dataset of the empirical articles published in 2017. [3] [2] They were formerly called discontinuous access panels; the usage of the word "panel" in this context is a non-standard meaning relative to its typical survey usage (which aim to measure the same variables using the same group of people at different times). [2]

Types

There are several types of online panels:

An example is the German Internet Panel, which studies the economic and political attitudes of its participants. This panel is unusual in its inclusion of people who previously had little internet access. [4] Another is Amazon's MTurk, which includes as one of the tasks assigned to its crowdsourced workers OP participation. [3]

Advantages and concerns

Online panels are a useful way to keep costs down but to also reach a high number of people, which makes them ideal for either pilot studies or scale development. [3] They are also used to solve a sample frame problem in surveys where e-mails would otherwise be used, where there is no otherwise complete e-mail list of the target study population. [1] The speed of data collection and sampling efficiency are also common reasons for their usage. [2]

While popular, their usage has attracted criticism. Data quality issues are a concern with online panels, including "panel conditioning" of the respondents. [5] Many studies are also ambiguous and do not clearly report if they used panel data. [3] There are also ethical concerns due to the usage of incentives in attracting the respondents, and the fact that though many OP respondents are paid workers many studies do not report their pay, or if paid far under the minimum wage. [3]

One problem with online panels is that they are not well suited for evaluating services that are offline alternatives, as the users of these services would be unlikely to be selected for an online panel. [6] One analysis found that an online panel was biased in a way that reflected Internet demographics, with women, the elderly, and the uneducated being less represented in the sample; the analysis found that this sample was biased and statistical weighting could not overcome the issue. [1]

See also

Related Research Articles

<span class="mw-page-title-main">Sampling (statistics)</span> Selection of data points in statistics.

In statistics, quality assurance, and survey methodology, sampling is the selection of a subset or a statistical sample of individuals from within a statistical population to estimate characteristics of the whole population. The subset is meant to reflect the whole population and statisticians attempt to collect samples that are representative of the population. Sampling has lower costs and faster data collection compared to recording data from the entire population, and thus, it can provide insights in cases where it is infeasible to measure an entire population.

Survey methodology is "the study of survey methods". As a field of applied statistics concentrating on human-research surveys, survey methodology studies the sampling of individual units from a population and associated techniques of survey data collection, such as questionnaire construction and methods for improving the number and accuracy of responses to surveys. Survey methodology targets instruments or procedures that ask one or more questions that may or may not be answered.

Qualitative marketing research involves a natural or observational examination of the philosophies that govern consumer behavior. The direction and framework of the research is often revised as new information is gained, allowing the researcher to evaluate issues and subjects in an in-depth manner. The quality of the research produced is heavily dependent on the skills of the researcher and is influenced by researcher bias.

Quantitative marketing research is the application of quantitative research techniques to the field of marketing research. It has roots in both the positivist view of the world, and the modern marketing viewpoint that marketing is an interactive process in which both the buyer and seller reach a satisfying agreement on the "four Ps" of marketing: Product, Price, Place (location) and Promotion.

<span class="mw-page-title-main">American Community Survey</span> Demographic survey in the United States

The American Community Survey (ACS) is an annual demographics survey program conducted by the U.S. Census Bureau. It regularly gathers information previously contained only in the long form of the decennial census, including ancestry, US citizenship status, educational attainment, income, language proficiency, migration, disability, employment, and housing characteristics. These data are used by many public-sector, private-sector, and not-for-profit stakeholders to allocate funding, track shifting demographics, plan for emergencies, and learn about local communities.

In sociology and statistics research, snowball sampling is a nonprobability sampling technique where existing study subjects recruit future subjects from among their acquaintances. Thus the sample group is said to grow like a rolling snowball. As the sample builds up, enough data are gathered to be useful for research. This sampling technique is often used in hidden populations, such as drug users or sex workers, which are difficult for researchers to access. As sample members are not selected from a sampling frame, snowball samples are subject to numerous biases. For example, people who have many friends are more likely to be recruited into the sample. When virtual social networks are used, then this technique is called virtual snowball sampling.

The General Social Survey (GSS) is a sociological survey created in 1972 by the National Opinion Research Center (NORC) at the University of Chicago and funded by the National Science Foundation. The GSS collects information biannually and keeps a historical record of the concerns, experiences, attitudes, and practices of residents of the United States.

Amazon Mechanical Turk (MTurk) is a crowdsourcing website with which businesses can hire remotely located "crowdworkers" to perform discrete on-demand tasks that computers are currently unable to do as economically. It is operated under Amazon Web Services, and is owned by Amazon. Employers, known as requesters, post jobs known as Human Intelligence Tasks (HITs), such as identifying specific content in an image or video, writing product descriptions, or answering survey questions. Workers, colloquially known as Turkers or crowdworkers, browse among existing jobs and complete them in exchange for a fee set by the requester. To place jobs, requesters use an open application programming interface (API), or the more limited MTurk Requester site. As of April 2019, requesters could register from 49 approved countries.

An open-access poll is a type of opinion poll in which a nonprobability sample of participants self-select into participation. The term includes call-in, mail-in, and some online polls.

A custom online panel or Internet access panel is a group of pre-screened respondents who have expressed a willingness to participate in surveys and/or customer feedback sessions. The custom online panel is also known as a customer advisory panel, proprietary panel or an online research panel. Respondents become "panelists" by completing a profiling questionnaire. The data collected includes demographics, lifestyle characteristics and media habits, which provides a basis for future survey participation.

Computer-assisted web interviewing (CAWI) is an Internet surveying technique in which the interviewee follows a script provided in a website. The questionnaires are made in a program for creating web interviews. The program allows for the questionnaire to contain pictures, audio and video clips, links to different web pages, etc. The website is able to customize the flow of the questionnaire based on the answers provided, as well as information already known about the participant. It is considered to be a cheaper way of surveying since one doesn't need to use people to hold surveys unlike computer-assisted telephone interviewing. With the increasing use of the Internet, online questionnaires have become a popular way of collecting information. The design of an online questionnaire has a dramatic effect on the quality of data gathered. There are many factors in designing an online questionnaire; guidelines, available question formats, administration, quality and ethic issues should be reviewed. Online questionnaires should be seen as a sub-set of a wider-range of online research methods.

<span class="mw-page-title-main">Survey (human research)</span> List of questions aimed at obtaining data from a group of people

In research of human subjects, a survey is a list of questions aimed for extracting specific data from a particular group of people. Surveys may be conducted by phone, mail, via the internet, and also in person in public spaces. Surveys are used to gather or gain knowledge in fields such as social research and demography.

The Health Information National Trends Survey (HINTS) is a cross-sectional, nationally representative survey of American adults sponsored by the National Cancer Institute. HINTS provides publicly available data on American adults' knowledge of, attitudes toward, and behaviors related to cancer prevention, control and communication. Researchers use the data to identify trends in health communication, including how people find cancer information, which sources they use, their feelings about the search process, and how they perceive cancer overall.

DIY Research (DIY Market Research) means marketing, customer or personnel research using online research methods that any individual or organization, whether they be a professional researcher or not, carries out via special online research software, or online survey tool. These survey software products allow users to connect and perform one-on-one online interviews, create online questionnaires, distribute them to an email list or internet access panels, and analyze the data in real time without outsourcing to a specialised research agency or data processing company.

Mobile marketing research is a method of data collection using the functions of mobile devices, like mobile phones, smartphones, and PDAs. With increasing members of the public having access to personal mobile devices in the 21st century, mobile marketing research developed as a way to utilize mobile communication for research purposes.

With the application of probability sampling in the 1930s, surveys became a standard tool for empirical research in social sciences, marketing, and official statistics. The methods involved in survey data collection are any of a number of ways in which data can be collected for a statistical survey. These are methods that are used to collect information from a sample of individuals in a systematic way. First there was the change from traditional paper-and-pencil interviewing (PAPI) to computer-assisted interviewing (CAI). Now, face-to-face surveys (CAPI), telephone surveys (CATI), and mail surveys are increasingly replaced by web surveys. In addition, remote interviewers could possibly keep the respondent engaged while reducing cost as compared to in-person interviewers.

The National Health Interview Survey (NHIS) is an annual, cross-sectional survey intended to provide nationally representative estimates on a wide range of health status and utilization measures among the nonmilitary, noninstitutionalized population of the United States. Each annual data set can be used to examine the disease burden and access to care that individuals and families are currently experiencing in the United States.

<span class="mw-page-title-main">Media Technology Monitor</span>

The Media Technology Monitor (MTM) is research product designed to monitor Canadians' use and adoption of new and existing technologies. The first MTM 18+ questionnaire, which focuses on Canadian adults, was distributed in 2005 and now consists of two annual telephone and web surveys conducted once during spring and fall each year. MTM 18+ surveys Canadians from all Provinces and Territories of Canada.

<span class="mw-page-title-main">Computer-assisted survey information collection</span>

Computer-assisted survey information collection (CASIC) refers to a variety of survey modes that were enabled by the introduction of computer technology. The first CASIC modes were interviewer-administered, while later on computerized self-administered questionnaires (CSAQ) appeared. It was coined in 1990 as a catch-all term for survey technologies that have expanded over time.

<span class="mw-page-title-main">Google Opinion Rewards</span> Mobile survey app

Google Opinion Rewards is a loyality program developed by Google. It was initially launched as a survey mobile app for Android and iOS developed by Google. The app allows users to answer surveys and earn rewards. On Android, users earn Google Play credits which can be redeemed by buying paid apps from Google Play. On iOS, users are paid via PayPal. Users in the available countries who are over 18 years old are eligible. Google Opinion Rewards works with Google Surveys, market researchers make the survey through Google Surveys and answers are received through Google Opinion Rewards by app users. This process provides surveyors with a large pool of surveyees quickly. This "fast and easy" surveying process has been criticized due to contention over the validity of results as well as concern over the privacy and security of the app users' data.

References

  1. 1 2 3 4 5 6 7 8 Gideon 2012, E-Mail Surveys.
  2. 1 2 3 4 5 6 7 8 9 10 Callegaro, Manfreda & Vehovar 2015, Online panel research: history, concepts, applications and a look at the future.
  3. 1 2 3 4 5 6 Porter, Christopher O. L. H.; Outlaw, Ryan; Gale, Jake P.; Cho, Thomas S. (January 2019). "The Use of Online Panel Data in Management Research: A Review and Recommendations". Journal of Management . 45 (1): 319–344. doi:10.1177/0149206318811569. hdl: 1805/20617 . ISSN   0149-2063.
  4. Blom, Annelies G.; Gathmann, Christina; Krieger, Ulrich (November 2015). "Setting Up an Online Panel Representative of the General Population: The German Internet Panel". Field Methods . 27 (4): 391–408. doi:10.1177/1525822X15574494. ISSN   1525-822X.
  5. Callegaro, Manfreda & Vehovar 2015, Online Panel Data Quality.
  6. Poynter 2010.

Sources