Open-access poll

Last updated

An open-access poll is a type of opinion poll in which a nonprobability sample of participants self-select into participation. The term includes call-in, mail-in, and some online polls.

Contents

The most common examples of open-access polls ask people to phone a number, click a voting option on a website, or return a coupon cut from a newspaper. By contrast, professional polling companies use a variety of techniques to attempt to ensure that the polls they conduct are representative, reliable and scientific. The most glaring difference between an open-access poll and a scientific poll is that scientific polls typically randomly select their samples and sometimes use statistical weights to make them representative of the target population.

Advantages and disadvantages

Since participants in an open-access poll are volunteers rather than a random sample, such polls represent the most interested individuals, just as in voting. In the case of political polls, such participants might be more likely voters.

Because no sampling frame is used to draw the sample of participants, open-access polls may not have participants that represent the larger population. Indeed, they may be composed simply of individuals who happen to hear about the poll. As a consequence, the results of the poll cannot be generalized, but are only representative of the participants of the poll.

One example of an error produced by an open access-poll was one taken by The Literary Digest to predict the 1936 United States presidential election. Similar polls by the magazine had correctly predicted the outcome of the four earlier presidential elections. The magazine's 1936 poll suggested that Alfred Landon would defeat Franklin D. Roosevelt by an overwhelming margin. In fact, the opposite happened. Later studies suggested that the main reason for the error was that Roosevelt's opponents were more vocal and thus more willing to respond to the magazine, compared to the silent majority who supported Roosevelt. [1] [2] By contrast, scientific opinion polls taken by George Gallup correctly showed a clear lead for Roosevelt, albeit still noticeably lower than what he achieved.

A way to minimize that bias is to weigh the results in order to make them more representative of the overall population. This does not make the results of the poll completely representative of the population but it does help increase the chances of the results representing the overall population.

Online poll

An online poll is a survey in which participants communicate responses via the Internet, typically by completing a questionnaire in a web page. Online polls may allow anyone to participate, or they may be restricted to a sample drawn from a larger panel. The use of online panels has become increasingly popular and is now the single biggest research method in Australia. [3]

Proponents of scientific online polling state that in practice their results are no less reliable than traditional polls, and that the problems faced by traditional polling, such as inadequate data for quota design and poor response rates for phone polls, can also lead to systemic bias. [4] [5] Some others express the hope that careful choice of a panel of possible respondents may allow online polling to become a useful tool of analysis, but feel that this is rarely the case. [6]

Voodoo poll

A voodoo poll (or pseudo-poll) is a pejorative description of an opinion poll with no statistical or scientific reliability, which is therefore not a good indicator of opinion on an issue. A voodoo poll will tend to involve self-selection, will be unrepresentative of the target population, and is often very easy to rig by those with a partisan interest in the results of the poll. [7] [8]

The term was coined by Sir Robert Worcester, founder of legitimate polling company MORI, which he chaired for 36 years to June 2005, with special reference to "phone-in" polls. He used the term in British newspaper The Independent on July 23, 1995 to show how easy it was to rig a phone-in poll by voting nine times. The term is still used to refer to unscientific, unrepresentative and unreliable polls. [9]

See also

Related Research Articles

In statistics, sampling bias is a bias in which a sample is collected in such a way that some members of the intended population have a lower or higher sampling probability than others. It results in a biased sample of a population in which all individuals, or instances, were not equally likely to have been selected. If this is not accounted for, results can be erroneously attributed to the phenomenon under study rather than to the method of sampling.

<span class="mw-page-title-main">1936 United States presidential election</span> 38th quadrennial U.S. presidential election

The 1936 United States presidential election was the 38th quadrennial presidential election, held on Tuesday, November 3, 1936. In the midst of the Great Depression, incumbent Democratic President Franklin D. Roosevelt defeated Republican Governor Alf Landon of Kansas. Roosevelt won the highest share of the popular vote (60.3%) and the electoral vote since the largely uncontested 1820 election. The sweeping victory consolidated the New Deal Coalition in control of the Fifth Party System.

<span class="mw-page-title-main">Sampling (statistics)</span> Selection of data points in statistics.

In statistics, quality assurance, and survey methodology, sampling is the selection of a subset or a statistical sample of individuals from within a statistical population to estimate characteristics of the whole population. Statisticians attempt to collect samples that are representative of the population. Sampling has lower costs and faster data collection compared to recording data from the entire population, and thus, it can provide insights in cases where it is infeasible to measure an entire population.

An opinion poll, often simply referred to as a survey or a poll, is a human research survey of public opinion from a particular sample. Opinion polls are usually designed to represent the opinions of a population by conducting a series of questions and then extrapolating generalities in ratio or within confidence intervals. A person who conducts polls is referred to as a pollster.

A straw poll, straw vote, or straw ballot is an ad hoc or unofficial vote. It is used to show the popular opinion on a certain matter, and can be used to help politicians know the majority opinion and help them decide what to say in order to gain votes.

An election exit poll is a poll of voters taken immediately after they have exited the polling stations. A similar poll conducted before actual voters have voted is called an entrance poll. Pollsters – usually private companies working for newspapers or broadcasters – conduct exit polls to gain an early indication as to how an election has turned out, as in many elections the actual result may take many hours to count.

<i>The Literary Digest</i> American general interest magazine

The Literary Digest was an American general interest weekly magazine published by Funk & Wagnalls. Founded by Isaac Kaufmann Funk in 1890, it eventually merged with two similar weekly magazines, Public Opinion and Current Opinion.

A deliberative opinion poll, sometimes called a deliberative poll, is a form of opinion poll taken before and after significant deliberation. Professor James S. Fishkin of Stanford University first described the concept in 1988. The typical deliberative opinion poll takes a random, representative sample of citizens and engages them in deliberation on current issues or proposed policy changes through small-group discussions and conversations with competing experts to create more informed and reflective public opinion. Deliberative polls have been run around the world, including recent experiments to conduct discussions virtually in the United States, Hong Kong, Chile, Canada and Japan.

<span class="mw-page-title-main">Shy Tory factor</span> Phenomenon observed in opinion polling

"Shy Tory factor" is a name given by British opinion polling companies to a phenomenon first observed by psephologists in the early 1990s. They observed that the share of the electoral vote won by the Conservative Party was significantly higher than the equivalent share in opinion polls. The accepted explanation was that so-called "shy Tories" were voting Conservative after telling pollsters they would not. The general elections held in 1992 and 2015 are examples where it has allegedly affected the overall results, but has also been discussed in other elections where the Conservatives did unexpectedly well. It has also been applied to the success of the Republican Party in the United States or the continued electoral victories of the People's Action Party in Singapore.

Televoting is a method of decision making and opinion polling conducted by telephone. Televoting can also extend to voting by SMS text message via a mobile cell phone.

<span class="mw-page-title-main">Gallup, Inc.</span> American analytics and advisory company

Gallup, Inc. is an American analytics and advisory company based in Washington, D.C. Founded by George Gallup in 1935, the company became known for its public opinion polls conducted worldwide. Starting in the 1980s, Gallup transitioned its business to focus on providing analytics and management consulting to organizations globally. In addition to its analytics, management consulting, and Gallup Poll, the company also offers educational consulting, the CliftonStrengths assessment and associated products, and business and management books published by its Gallup Press unit.

Rasmussen Reports is an American polling company founded in 2003. The company engages in political commentary and the collection, publication, and distribution of public opinion polling information. Rasmussen Reports conducts nightly tracking, at national and state levels, of elections, politics, current events, consumer confidence, business topics, and the United States president's job approval ratings. Surveys by the company are conducted using a combination of automated public opinion polling involving pre-recorded telephone inquiries and an online survey. The company generates revenue by selling advertising and subscriptions to its polling survey data.

Quick count is a method for verification of election results by projecting them from a sample of the polling stations.

Participation bias or non-response bias is a phenomenon in which the results of elections, studies, polls, etc. become non-representative because the participants disproportionately possess certain traits which affect the outcome. These traits mean the sample is systematically different from the target population, potentially resulting in biased estimates.

<span class="mw-page-title-main">Opinion polling for the 2015 United Kingdom general election</span>

In the run up to the general election on 7 May 2015, various organisations carried out opinion polling to gauge voting intention. Results of such polls are displayed in this article. Most of the polling companies listed are members of the British Polling Council (BPC) and abide by its disclosure rules.

A citizens' assembly is a group of people selected by lottery from the general population to deliberate on important public questions so as to exert an influence. Other names and variations include citizens' jury, citizens' panel, people's panel, mini-publics,people's jury, policy jury, citizens' initiative review, consensus conference and citizens' convention.

<span class="mw-page-title-main">Polling for United States presidential elections</span>

Gallup was the first polling organization to conduct accurate opinion polling for United States presidential elections. Gallup polling has often been accurate in predicting the outcome of presidential elections and the margin of victory for the winner. However, it missed some close elections: 1948, 1976 and 2004, the popular vote in 2000, and the likely-voter numbers in 2012. The month section in the tables represents the month in which the opinion poll was conducted. D represents the Democratic Party, and R represents the Republican Party. Third parties, such as the Dixiecrats and the Reform Party, were included in some polls.

Survation is a polling and market research agency based in London, England. Survation have been conducting research surveys since 2010. Surveys are conducted via telephone, online panel and face to face as well as omnibus research for a broad range of clients including television, newspapers, charities, lobby groups, trade unions, law firms and political parties. Damian Lyons Lowe is the company founder and Chief Executive.

During the years of increasing awareness of the Washington Redskins name controversy, public opinion polls were part of the discussion about whether Native Americans found the term redskin insulting. Other polls gauged how the general public viewed the controversy.

In the run-up to the 2021 Scottish Parliament election, various organisations conducted opinion polls to gauge voting intentions. Results of such polls are displayed in this list. Most of the pollsters listed were members of the British Polling Council (BPC) and abided by its disclosure rules.

References

  1. Bryson, Maurice C. ‘The Literary Digest Poll: Making of a Statistical Myth’ The American Statistician, 30(4):November 1976
  2. Squire, Peverill “Why the 1936 Literary Digest Poll Failed” Public Opinion Quarterly, 52:125–133 1988
  3. Kerry Sunderland (October 2007). "Push for online poll-arises opinions... or does it?". Research News. Australian Market and Social Research Society. Retrieved 2007-12-12.
  4. Peter Kellner, "Can online polls produce accurate findings?", International Journal of Market Research, Volume 46, Issue 1, Pages 3 - 22, 2004
  5. Humphrey Taylor (2007-01-15). "The Case For Publishing (Some) Online Polls". The Polling Report. Retrieved 2007-12-12.
  6. Dennis W. Johnson (2002). "Elections and public polling: Will the media get online polling right?". Psychology and Marketing. 19 (12): 1009–1023. doi:10.1002/mar.10050. Archived from the original on 2012-12-11.
  7. Watt, Nicholas (2006-01-05). "Eurosceptic party admits rigging BBC poll". The Guardian. Retrieved 2007-12-30.
  8. "Hunting ban tops 'unpopular' poll". BBC News. 2007-01-01. Retrieved 2007-12-30.
  9. Anthony Wells (May 24, 2009). Voodoo polling corner. UK Polling Report blog. Retrieved 2009-08-10.