John Philippe Rushton was a Canadian psychologist and author. He taught at the University of Western Ontario until the early 1990s, and became known to the general public during the 1980s and 1990s for research on race and intelligence, race and crime, and other purported racial correlations.
Discussions of race and intelligence – specifically regarding claims of differences in intelligence along racial lines – have appeared in both popular science and academic research since the modern concept of race was first introduced. With the inception of IQ testing in the early 20th century, differences in average test performance between racial groups were observed, though these differences have fluctuated and in many cases steadily decreased over time. Complicating the issue, modern science has concluded that race is a socially constructed phenomenon rather than a biological reality, and there exist various conflicting definitions of intelligence. In particular, the validity of IQ testing as a metric for human intelligence is disputed. Today, the scientific consensus is that genetics does not explain differences in IQ test performance between groups, and that observed differences are environmental in origin.
In statistical hypothesis testing, a result has statistical significance when a result at least as "extreme" would be very infrequent if the null hypothesis were true. More precisely, a study's defined significance level, denoted by , is the probability of the study rejecting the null hypothesis, given that the null hypothesis is true; and the p-value of a result, , is the probability of obtaining a result at least as extreme, given that the null hypothesis is true. The result is statistically significant, by the standards of the study, when . The significance level for a study is chosen before data collection, and is typically set to 5% or much lower—depending on the field of study.
In published academic research, publication bias occurs when the outcome of an experiment or research study biases the decision to publish or otherwise distribute it. Publishing only results that show a significant finding disturbs the balance of findings in favor of positive results. The study of publication bias is an important topic in metascience.
Stereotype threat is a situational predicament in which people are or feel themselves to be at risk of conforming to stereotypes about their social group. It is theorized to be a contributing factor to long-standing racial and gender gaps in academic performance. Since its introduction into the academic literature, stereotype threat has become one of the most widely studied topics in the field of social psychology.
Evidence-based practice is the idea that occupational practices ought to be based on scientific evidence. While seemingly obviously desirable, the proposal has been controversial, with some arguing that results may not specialize to individuals as well as traditional practices. Evidence-based practices have been gaining ground since the formal introduction of evidence-based medicine in 1992 and have spread to the allied health professions, education, management, law, public policy, architecture, and other fields. In light of studies showing problems in scientific research, there is also a movement to apply evidence-based practices in scientific research itself. Research into the evidence-based practice of science is called metascience.
A metatheory or meta-theory is a theory on a subject matter that is a theory in itself. Analyses or descriptions of an existing theory would be considered meta-theories. If the subject matter of a theoretical statement consists of one or multiple theories, it would also be called a meta-theory. For mathematics and mathematical logic, a metatheory is a mathematical theory about another mathematical theory. Meta-theoretical investigations are part of the philosophy of science. The topic of metascience is an attempt to use scientific knowledge to improve the practice of science itself.
Type D personality, a concept used in the field of medical psychology, is defined as the joint tendency towards negative affectivity and social inhibition. The letter D stands for "distressed".
IQ and Global Inequality is a 2006 book by psychologist Richard Lynn and political scientist Tatu Vanhanen. IQ and Global Inequality is follow-up to their 2002 book IQ and the Wealth of Nations, an expansion of the argument that international differences in current economic development are due in part to differences in average national intelligence as indicated by national IQ estimates, and a response to critics. The book was published by Washington Summit Publishers, a white nationalist and eugenicist publishing group.
Diederik Alexander Stapel is a Dutch former professor of social psychology at Tilburg University. In 2011 Tilburg University suspended Stapel for fabricating and manipulating data for his research publications. This scientific misconduct took place over a number of years and affected dozens of his publications. By 2015, fifty-eight of Stapel's publications had been retracted. He has been described in coverage by the New York Times as "the biggest con man in academic science".
Sex differences in human intelligence have long been a topic of debate among researchers and scholars. It is now recognized that there are no significant sex differences in average IQ, though particular subtypes of intelligence vary somewhat between sexes.
The replication crisis is an ongoing methodological crisis in which the results of many scientific studies are difficult or impossible to reproduce. Because the reproducibility of empirical results is an essential part of the scientific method, such failures undermine the credibility of theories building on them and potentially call into question substantial parts of scientific knowledge.
Metascience is the use of scientific methodology to study science itself. Metascience seeks to increase the quality of scientific research while reducing inefficiency. It is also known as "research on research" and "the science of science", as it uses research methods to study how research is done and find where improvements can be made. Metascience concerns itself with all fields of research and has been described as "a bird's eye view of science". In the words of John Ioannidis, "Science is the best thing that has happened to human beings ... but we can do it better."
Jelte Michiel "J.M." Wicherts is a Dutch psychologist and a professor in the Tilburg School of Social and Behavioral Sciences at Tilburg University. His research interests include biases in decision-making, as well as scientific misconduct and reproducibility. He has also studied group differences in IQ scores and the Flynn effect.
Statcheck is an R package designed to detect statistical errors in peer-reviewed psychology articles by searching papers for statistical results, redoing the calculations described in each paper, and comparing the two values to see if they match. It takes advantage of the fact that psychological research papers tend to report their results in accordance with the guidelines published by the American Psychological Association (APA). This leads to several disadvantages: it can only detect results reported completely and in exact accordance with the APA's guidelines, and it cannot detect statistics that are only included in tables in the paper. Another limitation is that Statcheck cannot deal with statistical corrections to test statistics, like Greenhouse–Geisser or Bonferroni corrections, which actually make tests more conservative. Some journals have begun piloting Statcheck as part of their peer review process. Statcheck is free software published under the GNU GPL v3.
Preregistration is the practice of registering the hypotheses, methods, and/or analyses of a scientific study before it is conducted. Clinical trial registration is similar, although it may not require the registration of a study's analysis protocol. Finally, registered reports include the peer review and in principle acceptance of a study protocol prior to data collection.
Researcher degrees of freedom is a concept referring to the inherent flexibility involved in the process of designing and conducting a scientific experiment, and in analyzing its results. The term reflects the fact that researchers can choose between multiple ways of collecting and analyzing data, and these decisions can be made either arbitrarily or because they, unlike other possible choices, produce a positive and statistically significant result. The researcher degrees of freedom has positives such as affording the ability to look at nature from different angles, allowing new discoveries and hypotheses to be generated. However, researcher degrees of freedom can lead to data dredging and other questionable research practices where the different interpretations and analyses are taken for granted Their widespread use represents an inherent methodological limitation in scientific research, and contributes to an inflated rate of false-positive findings. They can also lead to overestimated effect sizes.
Crowdsourced science refers to collaborative contributions of a large group of people to the different steps of the research process in science. In psychology, the nature and scope of the collaborations can vary in their application and in the benefits it offers.
Research transparency is a major aspect of scientific research. It covers a variety of scientific principles and practices: reproducibility, data and code sharing, citation standards or verifiability.
Multiverse analysis is a scientific method that specifies and then runs a set of plausible alternative models or statistical tests for a single hypothesis. It is a method to address the issue that the "scientific process confronts researchers with a multiplicity of seemingly minor, yet nontrivial, decision points, each of which may introduce variability in research outcomes". A problem also known as Researcher degrees of freedom or as the garden of forking paths. It is a method arising in response to the credibility and replication crisis taking place in science, because it can diagnose the fragility or robustness of a study's findings. Multiverse analyses have been used in the fields of psychology and neuroscience. It is also a form of meta-analysis allowing researchers to provide evidence on how different model specifications impact results for the same hypothesis, and thus can point scientists toward where they might need better theory or causal models.
