Stephen Ziliak

Last updated

Stephen T. Ziliak (born October 17, 1963) is an American professor of economics whose research and essays span disciplines from statistics and beer brewing to medicine and poetry. He is currently a faculty member of the Angiogenesis Foundation, conjoint professor of business and law at the University of Newcastle in Australia, and professor of economics at Roosevelt University in Chicago, IL. He previously taught for the Georgia Institute of Technology, Emory University, and Bowling Green State University. Much of his work has focused on welfare and poverty, rhetoric, public policy, and the history and philosophy of science and statistics. [1] Most known for his works in the field of statistical significance, Ziliak gained notoriety from his 1996 article, "The Standard Error of Regressions", [2] from a sequel study in 2004 called "Size Matters", [3] and for his University of Michigan Press best-selling and critically acclaimed book The Cult of Statistical Significance: How the Standard Error Costs Us Jobs, Justice, and Lives (2008) [4] all coauthored with Deirdre McCloskey. [5] [6] [7] [8] [9]

Contents

Career

Ziliak received a B.A. in Economics from Indiana University, a PhD in economics, and a PhD Certificate in the Rhetoric of the Human Sciences, both from the University of Iowa. While at Iowa, he served as resident scholar in the Project on Rhetoric of Inquiry, where he met among others Steve Fuller, Bruno Latour, and Wayne C. Booth, and co-authored the now-famous paper "The Standard Error of Regressions".

Following the completion of his PhD degrees, he has taught at Bowling Green, Emory, Georgia Tech, and (currently) Roosevelt University, and he has been a visiting professor at more than a dozen other leading universities, law schools, and medical centers across the United States and Europe. In 2002 he won the Helen Potter Award for Best Article in Social Economics ("Pauper Fiction in Economic Science: `Paupers in Almshouses' and the Odd Fit of Oliver Twist"). [10] In that same year at Georgia Tech he won the "Faculty Member of the Year" award and in 2003 he was voted "Most Intellectual Professor". [11]

After college, but prior to his academic career, Ziliak served as county welfare caseworker and, following that, labor market analyst for the Indiana Department of Workforce Development, both in Indianapolis.

Work on rhetoric and statistical significance

While at Iowa, Ziliak became friends with his dissertation adviser, Deirdre McCloskey. He and McCloskey shared an interest in the fields of rhetoric and statistical significance — namely how the two concepts merge in modern economics. Ziliak had discovered one big cost of the "significance mistake" early on in his job with Workforce Development, in 1987. By U.S. Department of Labor policy he learned he was not allowed to publish black youth unemployment rates for Indiana's labor markets: "not statistically significant," the Labor Department said, meaning the p-values exceeded 0.10 (p less than or equal to 0.10 was the Labor Department's bright line cut-off for publishing estimates). [12]

In their paper, "The Standard Error of Regressions," McCloskey and Ziliak argue that econometrics greatly over-values and vastly misuses statistical significance testing — Student's t-test. They claim econometricians rely too heavily on statistical significance, but too little on actual economic significance. Significance does not mean importance, and lack of significance does not mean unimportant. The paper also reviews and critiques over 40 years' worth of published papers in economic journals to see if and how ambiguity and misuse of statistical significance affect the author's article.

In a reply to critics, Ziliak and McCloskey did a follow-up study of the 1996 research and found that the significance problem had grown even larger, causing false inferences and decisions in from 70% in the 1980s to 80% of the 1990s articles published in the American Economic Review. "Size Matters: The Standard Error of Regressions in the American Economic Review" was presented by Ziliak at the 2004 meetings of the American Economic Association, in a standing-room only plenary session with over 350 economists and journalists, chaired by Nobel laureate Kenneth Arrow. [7] The article and a reply to critics ("Significance Redux") were published in a special issue of the Journal of Socio-Economics, with comments from Nobel laureate Clive Granger, Arnold Zellner, Edward Leamer, Gerd Gigerenzer, Jeffrey Wooldridge, Joel Horowitz and a half dozen others. [13] In 2004 "Size Matters" also inspired a comment from Nobel laureate Thomas Schelling. [14] Published cooperatively at the same time in Econ Journal Watch (2004), "Size Matters" maintains its rank as one of the top-most downloaded articles in that journal's history (over 25,000 complete downloads as of November 2015).

Ziliak was a lead author on the twenty-four statistician team which crafted in 2015-2016 the historic "American Statistical Association Statement on Statistical Significance and P-Values," edited by Ronald Wasserstein and Nicole Lazar. [15] [16] [17]

His article "How Large are Your G-values? Try Gosset's Guinnessometrics When a Little 'p' Is Not Enough" was published in a follow-up special issue of The American Statistician (2019 73 sup1), a major re-think of statistical testing, estimation, and reporting in "A world beyond p<0.05" for which Ziliak also served as associate editor.

The Cult of Statistical Significance

His book, The Cult of Statistical Significance: How the Standard Error Costs Us Jobs, Justice, and Lives (2008) challenges the history, philosophy, and practice of all the testing sciences, from economics to medicine, and has been widely reviewed in journals and the media. [18] [19] [20] [21] [22] [23] [24] [25] [26] It was the beer-brewing Gosset aka "Student", Ziliak discovered in the archives, not the biologist R. A. Fisher, who provided the firmer foundation for modern statistics, decisions, and experimental design. The book featured in a 2011 U.S. Supreme Court case, Matrixx Initiatives v. Siracusano et al., wherein the justices unanimously decided against using statistical significance as a standard for adverse event reporting in U.S. securities law. [27] Ziliak and McCloskey were invited to submit to the court a brief of amici curiae ("friends of the court") wherein they explain the most important differences between economic, legal, and human significance versus mere statistical significance. Ziliak wrote about the case for Significance magazine, inspiring published letters from A.W.F. Edwards and Dennis Lindley, who later befriended Ziliak in correspondence over W.S. Gosset and R.A. Fisher. [27] [28]

"Haiku Economics"

In 2001, while teaching at Georgia Tech, Ziliak rediscovered his appreciation for haiku poetry. Haiku are short lyric verse with a budget constraint, conventionally arranged in three lines of 17 sounds (5-7-and-5). He had learned about the medieval Japanese art form back in the 1980s, from a friend in Indianapolis who happened to be the eminent African American poet Etheridge Knight. Teaching large-section courses to hundreds of students, Ziliak was at the same time seeking a low-cost way to help students connect their own observations and feelings to the economics textbook and economy itself. Economics and haiku overlap at the level of principles, he discovered, yet give something more in combination, such as feelings. [29] Students reacted positively. "Haiku economics" was born, and first published in 2002. [30] Ziliak's most famous haiku is:

Invisible hand;

mother of inflated hope,

mistress of despair! [31]

His invisible hand haiku has been erroneously credited to Etheridge Knight and Matsuo Basho. [32] (For example, in Kalle Lasn's Meme Wars: The Creative Destruction of Neoclassical Economics.) In 2008 and 2009 Ziliak's work on haiku economics gained international attention following a series of articles published in the Wall Street Journal, The Economist, The Chronicle of Higher Education, and National Public Radio. [33] [34] [35] [36] [37] In 2011 he published an essay in Poetry magazine, "Haiku Economics: On Money, Metaphor, and the Invisible Hand," [38] which the editors of Poetry cite as the most-read essay in 2011 and in the history of their non-fiction "The View from Here" column, which has featured essays by Richard Rorty, Christopher Hitchens, and many others. [39]

Guinnessometrics

Ziliak's current projects include Guinnessometrics, [40] that is, a wholesale rethinking of experimental philosophy and econometric practice after William S. Gosset (1876-1937) aka "Student", [41] the inventor of "Student's" t and celebrated Head Brewer of Guinness. [42] [43] Ziliak's Guinnessometrics was twice featured on BBC Radio 4's "More or Less" program, hosted by Tim Harford, and later in many other media such as The Wall Street Journal Europe, Financial Times, Salon and The Washington Post. [44] Guinnessometrics argues that randomization plus statistical significance does not equal validity. Validity is proven by other means, including deliberately balanced and stratified experiments, small series of independent and repeated samples controlling for real not merely random error, and an economic approach to the logic of uncertainty.

His work showing the history and power of balanced over randomized controlled trials, [45] rival techniques which Ziliak traces back to the early 1900s and the Guinness Brewery in Dublin, has been noted by Tim Harford, Casey Mulligan, and others for its deep challenge to randomized field experiments after John List, Steve Levitt, Esther Duflo, and others. [46] [47] [48] [49] In July 2008 Ziliak was invited by the International Biometric Society and the Irish Statistical Association to present his work in Dublin on "Guinnessometrics: The Economic Foundation of Student's t," in celebration of the 100th anniversary of W.S. Gosset's aka "Student's" t-distribution and test. [50] Standing on stage with Sir David Cox and Stephen Senn, the biostatistician and president of the American Statistical Association Chicago Chapter Borko Jovanovic quipped that Ziliak "looked, at first, like a little kid walking around the British Museum. Then he began to speak, which he could probably do for two weeks straight". [51] In 2010 Ziliak and British statistician Stephen Senn exchanged views in The Lancet. [52] [53]

Renganomics and rap

Ziliak's other contributions include a competitive learning game he calls renganomics. [54] Renganomics is a combination of economic science with an ancient Japanese poetic form called renga. The idea is to create a spontaneous, collaboratively written poem about the economy and economic science in the form of linked classical haiku poems (5-7-5 sound counts) followed by two lines of 7 sounds (14 sounds for the couplet). The renga form, which gained the attention of Octavio Paz, is created by writing a verse and then passing the poem on to the next person in the circle, given a predetermined time constraint and stakes. The genre challenges notions of the spontaneous order and central planning alike, while allowing both policies to air ideas, desires, and complaints.

In May 2015 Ziliak produced with his students at Roosevelt University an economics rap video, "Fear the Economics Textbook (Story of the Next Crook)". [54] The video, featured in Inside Higher Ed, The National Review, Rethinking Economics [55] and elsewhere, is in part a statement of Ziliak's pluralist and dialogical teaching philosophy and view of history, and at the same time a reply to the popular Keynes-Hayek rap videos. [56] [57] [58]

Welfare reform

On the strength of his dissertation, "Essays on Self-Reliance: The United States in the Era of Scientific Charity," he was appointed associate editor for the millennial edition of Historical Statistics of the United States: Colonial Times to the Present (General Eds. S. Carter, R. Sutch, et al.) [59] [60] Ziliak argued in his dissertation and in a series of articles against the 1996 welfare reform act (PRWORA). He argued on the basis of novel econometric and social historical evidence he produced on previous, 19th century attempts to abolish welfare and to replace it with private charity ("scientific charity", so called). Economic theory of welfare is distorted, he argued, by a "Malthusian vice" and "Contradiction of compassion". Private charity expanded more than previous observers predicted. But labor market outcomes were about the same as one finds in late 20th century welfare programs. [61] [62] His comparative historical research has challenged left and right both, from Stephen Pimpare to the Cato Institute, and has featured in encyclopedias on social work. [63] [64] [65] [66] [67] [68] [69] [70] [71]

Ethics and economics

Ziliak's historical research on previous attempts to privatize welfare for the poor has questioned the virtue-ethical philosophies of Victorians, Old and New, from Herbert Spencer to Gertrude Himmelfarb. In The Bourgeois Virtues (2006, xviii) his former dissertation adviser and long-time coauthor Deirdre N. McCloskey thanks Ziliak (together with Arjo Klamer and Helen McCloskey, Deirdre's mother) for "disagreeing with me about the bourgeois virtues". The Cult of Statistical Significance drew attention to the ethics of statistical significance testing and the frequently large yet neglected consequences for human and other life when the test is misused and misinterpreted as Ziliak and McCloskey have documented it frequently is. Haiku economics is fundamentally an attempt to bring feelings and individual experience back inside the dismal science. In his 2011 essay on "Haiku Economics," published in Poetry magazine, Ziliak noted the influence of Adam Smith's The Theory of Moral Sentiments and John Stuart Mill's Autobiography. More recently, In a series of papers comparing Gosset's deliberately balanced experimental designs with Fisher's randomized, Ziliak argues that most randomized controlled trials lack both ethical and economic justification. His paper "The Unprincipled Randomization Principle in Economics and Medicine" (with Edward Teather-Posadas), published in the Oxford Handbook of Professional Economic Ethics (2015), argues that most randomized controlled trials (RCTs) fail every ethical code, from Smith's "impartial spectator" and Pareto efficiency to Rawls's difference principle, except possibly "vulgar utilitarianism" (p. 436), an "ethic" which even most economists reject.

Books

Selected articles

Related Research Articles

Econometrics is an application of statistical methods to economic data in order to give empirical content to economic relationships. More precisely, it is "the quantitative analysis of actual economic phenomena based on the concurrent development of theory and observation, related by appropriate methods of inference". An introductory economics textbook describes econometrics as allowing economists "to sift through mountains of data to extract simple relationships". Jan Tinbergen is one of the two founding fathers of econometrics. The other, Ragnar Frisch, also coined the term in the sense in which it is used today.

<span class="mw-page-title-main">Statistics</span> Study of the collection, analysis, interpretation, and presentation of data

Statistics is the discipline that concerns the collection, organization, analysis, interpretation, and presentation of data. In applying statistics to a scientific, industrial, or social problem, it is conventional to begin with a statistical population or a statistical model to be studied. Populations can be diverse groups of people or objects such as "all people living in a country" or "every atom composing a crystal". Statistics deals with every aspect of data, including the planning of data collection in terms of the design of surveys and experiments.

Students <i>t</i>-distribution Probability distribution

In probability and statistics, Student's t-distribution is a continuous probability distribution that generalizes the standard normal distribution. Like the latter, it is symmetric around zero and bell-shaped.

<span class="mw-page-title-main">William Sealy Gosset</span> British statistician

William Sealy Gosset was an English statistician, chemist and brewer who served as Head Brewer of Guinness and Head Experimental Brewer of Guinness and was a pioneer of modern statistics. He pioneered small sample experimental design and analysis with an economic approach to the logic of uncertainty. Gosset published under the pen name Student and developed most famously Student's t-distribution – originally called Student's "z" – and "Student's test of statistical significance".

In statistical hypothesis testing, a result has statistical significance when a result at least as "extreme" would be very infrequent if the null hypothesis were true. More precisely, a study's defined significance level, denoted by , is the probability of the study rejecting the null hypothesis, given that the null hypothesis is true; and the p-value of a result, , is the probability of obtaining a result at least as extreme, given that the null hypothesis is true. The result is statistically significant, by the standards of the study, when . The significance level for a study is chosen before data collection, and is typically set to 5% or much lower—depending on the field of study.

<span class="mw-page-title-main">Regression toward the mean</span> Statistical phenomenon

In statistics, regression toward the mean is the phenomenon where if one sample of a random variable is extreme, the next sampling of the same random variable is likely to be closer to its mean. Furthermore, when many random variables are sampled and the most extreme results are intentionally picked out, it refers to the fact that a second sampling of these picked-out variables will result in "less extreme" results, closer to the initial mean of all of the variables.

A t-test is a type of statistical analysis used to compare the averages of two groups and determine if the differences between them are more likely to arise from random chance. It is any statistical hypothesis test in which the test statistic follows a Student's t-distribution under the null hypothesis. It is most commonly applied when the test statistic would follow a normal distribution if the value of a scaling term in the test statistic were known. When the scaling term is estimated based on the data, the test statistic—under certain conditions—follows a Student's t distribution. The t-test's most common application is to test whether the means of two populations are different.

The McCloskey critique refers to a critique of post-1940s "official modernist" methodology in economics, inherited from logical positivism in philosophy. The critique maintains that the methodology neglects how economics can be done, is done, and should be done to advance the subject. Its recommendations include use of good rhetorical devices for "disciplined conversation."

<span class="mw-page-title-main">Deirdre McCloskey</span> American economist (born 1942)

Deirdre Nansen McCloskey is the distinguished professor of economics, history, English, and communication at the University of Illinois at Chicago (UIC). She is also adjunct professor of philosophy and classics there, and for five years was a visiting professor of philosophy at Erasmus University, Rotterdam. Since October 2007 she has received six honorary doctorates. In 2013, she received the Julian L. Simon Memorial Award from the Competitive Enterprise Institute for her work examining factors in history that led to advancement in human achievement and prosperity. Her main research interests include the origins of the modern world, the misuse of statistical significance in economics and other sciences, and the study of capitalism, among many others.

Economic methodology is the study of methods, especially the scientific method, in relation to economics, including principles underlying economic reasoning. In contemporary English, 'methodology' may reference theoretical or systematic aspects of a method. Philosophy and economics also takes up methodology at the intersection of the two subjects.

<span class="mw-page-title-main">Computational statistics</span> Interface between statistics and computer science

Computational statistics, or statistical computing, is the bond between statistics and computer science. It means statistical methods that are enabled by using computational methods. It is the area of computational science specific to the mathematical science of statistics. This area is also developing rapidly, leading to calls that a broader concept of computing should be taught as part of general statistical education.

Choice modelling attempts to model the decision process of an individual or segment via revealed preferences or stated preferences made in a particular context or contexts. Typically, it attempts to use discrete choices in order to infer positions of the items on some relevant latent scale. Indeed many alternative models exist in econometrics, marketing, sociometrics and other fields, including utility maximization, optimization applied to consumer theory, and a plethora of other identification strategies which may be more or less accurate depending on the data, sample, hypothesis and the particular decision being modelled. In addition, choice modelling is regarded as the most suitable method for estimating consumers' willingness to pay for quality improvements in multiple dimensions.

<span class="mw-page-title-main">Rule of three (statistics)</span>

In statistical analysis, the rule of three states that if a certain event did not occur in a sample with n subjects, the interval from 0 to 3/n is a 95% confidence interval for the rate of occurrences in the population. When n is greater than 30, this is a good approximation of results from more sensitive tests. For example, a pain-relief drug is tested on 1500 human subjects, and no adverse event is recorded. From the rule of three, it can be concluded with 95% confidence that fewer than 1 person in 500 will experience an adverse event. By symmetry, for only successes, the 95% confidence interval is [1−3/n,1].

In statistics, the t-statistic is the ratio of the departure of the estimated value of a parameter from its hypothesized value to its standard error. It is used in hypothesis testing via Student's t-test. The t-statistic is used in a t-test to determine whether to support or reject the null hypothesis. It is very similar to the z-score but with the difference that t-statistic is used when the sample size is small or the population standard deviation is unknown. For example, the t-statistic is used in estimating the population mean from a sampling distribution of sample means if the population standard deviation is unknown. It is also used along with p-value when running hypothesis tests where the p-value tells us what the odds are of the results to have happened.

Anil K. Bera is an Indian-American econometrician. He is Professor of Economics at University of Illinois at Urbana–Champaign's Department of Economics. He is most noted for his work with Carlos Jarque on the Jarque–Bera test.

Meta-regression is defined to be a meta-analysis that uses regression analysis to combine, compare, and synthesize research findings from multiple studies while adjusting for the effects of available covariates on a response variable. A meta-regression analysis aims to reconcile conflicting studies or corroborate consistent ones; a meta-regression analysis is therefore characterized by the collated studies and their corresponding data sets—whether the response variable is study-level data or individual participant data. A data set is aggregate when it consists of summary statistics such as the sample mean, effect size, or odds ratio. On the other hand, individual participant data are in a sense raw in that all observations are reported with no abridgment and therefore no information loss. Aggregate data are easily compiled through internet search engines and therefore not expensive. However, individual participant data are usually confidential and are only accessible within the group or organization that performed the studies.

There have been many criticisms of econometrics' usefulness as a discipline and perceived widespread methodological shortcomings in econometric modelling practices.

<span class="mw-page-title-main">JASP</span> Free and open-source statistical program

JASP is a free and open-source program for statistical analysis supported by the University of Amsterdam. It is designed to be easy to use, and familiar to users of SPSS. It offers standard analysis procedures in both their classical and Bayesian form. JASP generally produces APA style results tables and plots to ease publication. It promotes open science via integration with the Open Science Framework and reproducibility by integrating the analysis settings into the results. The development of JASP is financially supported by several universities and research funds. As JASP GUI is developed in C++ using Qt framework, some of the team left to make a notable fork which is Jamovi that its GUI is developed in Javascript and HTML5.

<span class="mw-page-title-main">Homoscedasticity and heteroscedasticity</span> Statistical property

In statistics, a sequence of random variables is homoscedastic if all its random variables have the same finite variance; this is also known as homogeneity of variance. The complementary notion is called heteroscedasticity, also known as heterogeneity of variance. The spellings homoskedasticity and heteroskedasticity are also frequently used. Assuming a variable is homoscedastic when in reality it is heteroscedastic results in unbiased but inefficient point estimates and in biased estimates of standard errors, and may result in overestimating the goodness of fit as measured by the Pearson coefficient.

References

  1. "Stephen T Ziliak's Library of Oomph and Precision". blogs.roosevelt.edu. Retrieved 2015-10-12.
  2. McCloskey, Deirdre N.; Ziliak, Stephen T. (1 January 1996). "The Standard Error of Regressions". Journal of Economic Literature. 34 (1): 97–114. JSTOR   2729411.
  3. "The Journal of Socio-Economics - Vol 33, Iss 5, Pgs 523-676, (November 2004) - ScienceDirect.com".
  4. Ziliak, S. T., & Mccloskey, D. N. (2008). The cult of statistical significance: How the standard error costs us jobs, justice and lives. University of Michigan Press.
  5. Ziliak, S T. and D N McCloskey (2004). "Size Matters: The Standard Error of Regressions in the American Economic Review". Journal of Socio-Economics. 33 (5): 427–456. doi:10.1016/j.socec.2004.09.024.
  6. Ziliak, Stephen T.; McCloskey, Deirdre N. (2004-11-01). "Significance redux". The Journal of Socio-Economics. Statistical Significance. 33 (5): 665–675. doi:10.1016/j.socec.2004.09.038.
  7. 1 2 "Signifying nothing?". The Economist. ISSN   0013-0613 . Retrieved 2015-10-12.
  8. Bialik, Carl (2011-04-01). "A Statistical Test Gets Its Closeup" . Retrieved 2015-10-12.
  9. Bialik, Carl. "Making a Stat Less Significant". Wall Street Journal. ISSN   0099-9660 . Retrieved 2015-10-12.
  10. Ziliak, Stephen T. (2002-06-01). "Pauper Fiction in Economic Science: "Paupers in Almshouses" and the Odd Fit of Oliver Twist". Review of Social Economy. 60 (2): 159–181. doi:10.1080/00346760210146622. ISSN   0034-6764. S2CID   145074998.
  11. "Stephen T. Ziliak's Library of Oomph & Precision | Ask me anything, I'm an economist". blogs.roosevelt.edu. Retrieved 2015-10-12.
  12. Ziliak, Stephen (2008). The Cult of Statistical Significance. University of Michigan Press. pp. xx.
  13. "The Journal of Socio-Economics | Vol 33, Iss 5, Pgs 523-676, (November 2004) | ScienceDirect.com". www.sciencedirect.com. Retrieved 2015-10-12.
  14. "Volume 1, Issue 3, December 2004 · Econ Journal Watch". econjwatch.org. Retrieved 2015-10-13.
  15. "Roosevelt economist who challenged use of statistics celebrates victory". www.roosevelt.edu. Retrieved 2017-01-14.
  16. Wasserstein, Ronald L.; Lazar, Nicole A. (2016-06-09). "The ASA's Statement onp-Values: Context, Process, and Purpose". The American Statistician. 70 (2): 129–133. doi: 10.1080/00031305.2016.1154108 .
  17. "Statisticians Found One Thing They Can Agree On: It's Time To Stop Misusing P-Values". FiveThirtyEight. 2016-03-07. Retrieved 2017-01-14.
  18. "The Cult of Statistical Significance | Stephen T. Ziliak's Library of Oomph & Precision". blogs.roosevelt.edu. Retrieved 2015-10-13.
  19. Porter, Theodore M. (June 6, 2008). "Signifying Little". Science. 320 (5881): 1292. doi:10.1126/science.1160305. S2CID   119872935.
  20. Hymans, Saul H. (2009-06-01). "Review". Journal of Economic Literature. 47 (2): 499–503. JSTOR   27739938.
  21. Ancker, Jessica S. (2009-02-01). "Praying to the power of P". Nature Medicine. 15 (2): 135. doi: 10.1038/nm0209-135 . ISSN   1078-8956. S2CID   26640480.
  22. Haggstrom, Olle (October 9, 2010). "Review of Ziliak's and McCloskey's The Cult of Statistical Significance" (PDF). Notices of the American Mathematical Society.
  23. Bergman, Bruce (February 2010). "Wallowing in Significance". Monthly Labor Review.
  24. Hoover, Kevin D.; Siegler, Mark V. (2008-03-01). "The rhetoric of 'Signifying nothing': a rejoinder to Ziliak and McCloskey". Journal of Economic Methodology. 15 (1): 57–68. doi:10.1080/13501780801913546. ISSN   1350-178X. S2CID   17253046.
  25. Lempert, Richard (2009). "The Significance of Statistical Significance". Law & Social Inquiry. 34 (1): 225–249. doi:10.1111/j.1747-4469.2009.01144.x. S2CID   145393229.
  26. "We Agree That Statistical Significance Proves Essentially Nothing: A Rejoinder to Thomas Mayer · Econ Journal Watch : Significance test, economic significance, Student's t, oomph, Gosset, Fisher". econjwatch.org. Retrieved 2015-10-15.
  27. 1 2 Ziliak, Stephen T. (2011-09-01). "Matrixx v. Siracusano and Student v. Fisher". Significance. 8 (3): 131–134. doi: 10.1111/j.1740-9713.2011.00511.x . ISSN   1740-9713.
  28. "Significance - December 2011 (Volume 8 Issue 4) | StatsLife". www.statslife.org.uk. Retrieved 2015-10-15.
  29. Ziliak, Stephen T. (2009-01-01). "Haiku economics: little teaching aids for big economic pluralists". International Journal of Pluralism and Economics Education. 1 (1–2): 108–129. doi: 10.1504/IJPEE.2009.028969 . ISSN   1757-5648.
  30. Ziliak, Stephen (2002-09-01). "Haiku Economics". Rethinking Marxism. 14 (3): 111–112. doi:10.1080/089356902101242323. ISSN   0893-5696. S2CID   219715145.
  31. "On haiku and the invisible hand". The Economist. ISSN   0013-0613 . Retrieved 2015-10-14.
  32. "Meme Wars by Adbusters". Penguin Books UK. Retrieved 2015-10-14.
  33. Pilon, Mary. "Fannie, Freddie, Bear & Hard Times: Wall Street's Collapse, Told in Rhymes". Wall Street Journal. ISSN   0099-9660 . Retrieved 2015-10-12.
  34. "On haiku and the invisible hand". The Economist. ISSN   0013-0613 . Retrieved 2015-10-12.
  35. "Challenge: Recession Haiku". NPR.org. Retrieved 2015-10-12.
  36. Ziliak, Stephen T. (2009-01-01). "Haiku economics: little teaching aids for big economic pluralists". International Journal of Pluralism and Economics Education. 1 (1/2): 108–129. doi: 10.1504/ijpee.2009.028969 .
  37. "Verses of Economy". The Chronicle of Higher Education. 2009-05-22. Retrieved 2015-10-14.
  38. "Haiku Economics by Stephen T. Ziliak - Poetry Magazine". 2019-01-26.
  39. "The Poetry Foundation's most-read articles of 2011". Harriet: The Blog. Retrieved 2015-10-12.
  40. Ziliak, Stephen T (1 December 2008). "Retrospectives: Guinnessometrics: The Economic Foundation of "Student's" t". Journal of Economic Perspectives. 22 (4): 199–216. doi: 10.1257/jep.22.4.199 .
  41. "Guinnessometrics: Saving Science and Statistics With Beer".
  42. Ziliak, Stephen T. (1 January 2008). "Retrospectives: Guinnessometrics: The Economic Foundation of "Student's" t". Journal of Economic Perspectives. 22 (4): 199–216. doi: 10.1257/jep.22.4.199 via RePEc - IDEAS.
  43. Kliff, Sarah (2012-02-08). "Guinness's big contribution to economics research". The Washington Post. ISSN   0190-8286 . Retrieved 2015-10-12.
  44. "The cult of statistical significance". Tim Harford. 2011-04-06. Retrieved 2015-10-12.
  45. Ziliak, Stephen T.; Teather-Posadas, Edward R. (1 April 2016). The Unprincipled Randomization Principle in Economics and Medicine. doi:10.1093/oxfordhb/9780199766635.001.0001. ISBN   9780199766635.
  46. Harford, Tim. "The random risks of randomised trials". Financial Times. ISSN   0307-1766 . Retrieved 2015-10-12.
  47. "The Economics of Randomized Experiments". Economix Blog. 2014-03-05. Retrieved 2015-10-12.
  48. Ziliak, Stephen T. (2014). "now publishers - Balanced versus Randomized Field Experiments in Economics: Why W. S. Gosset aka "Student" Matters". Review of Behavioral Economics. 1 (1–2): 167–208. doi:10.1561/105.00000008.
  49. Ziliak, Stephen T.; Teather-Posadas, Edward R. (2015). "Unprincipled Randomization Principle in Economics and Medicine - Oxford Handbooks". doi:10.1093/oxfordhb/9780199766635.013.44. S2CID   53543002.{{cite journal}}: Cite journal requires |journal= (help)
  50. Student (1908-03-01). "The Probable Error of a Mean". Biometrika. 6 (1): 1–25. doi:10.2307/2331554. JSTOR   2331554.
  51. "November - The Chicago Chapter of the American Statistical Association". community.amstat.org. Retrieved 2015-10-13.
  52. Senn, Stephen (October 2010). "Significant errors". The Lancet. 376 (9750): 1390–1391. doi:10.1016/s0140-6736(10)61954-x. PMID   20971360. S2CID   205960637.
  53. Ziliak, Stephen (October 2010). "Significant errors-Author's reply". The Lancet. 376 (9750): 1391. doi:10.1016/s0140-6736(10)61955-1. S2CID   53277177.
  54. 1 2 "Inderscience Publishers - linking academia, business and industry through research".
  55. "'Where moral sentiments replace demand and supply' – the RU Ready4Justice Collective's Fear the Economics Textbook video". 13 July 2015.
  56. "Roosevelt U class's rap video challenges George Mason's Hayek fan videos | Inside Higher Ed". www.insidehighered.com. 6 May 2015. Retrieved 2015-10-12.
  57. "A Professor Who Misunderstands What Economics is About". National Review Online. 2015-05-08. Retrieved 2015-10-12.
  58. "Fear the Economics Textbook: A Rap Video | Stephen T. Ziliak's Library of Oomph & Precision". blogs.roosevelt.edu. Retrieved 2015-10-12.
  59. Ziliak, Stephen Thomas (1996-01-01). "Essays on self-reliance: the United States in the era of "scientific charity"". OCLC   37581439.{{cite journal}}: Cite journal requires |journal= (help)
  60. "Historical Statistics of the United States - Cambridge University Press". www.cambridge.org. Retrieved 2015-10-15.
  61. "The End of Welfare and the Contradiction of Compassion". The Independent Institute. Retrieved 2015-10-15.
  62. Ziliak, Stephen T. (2004-06-01). "Self-Reliance Before the Welfare State: Evidence from the Charity Organization Movement in the United States". The Journal of Economic History. 64 (2): 433–461. doi:10.1017/S002205070400275X. ISSN   1471-6372. S2CID   154761638.
  63. "The New Victorians | The New Press". The New Press. Retrieved 2015-11-03.
  64. Ziliak, Stephen T. (Winter 2002). "Some Tendencies of Social Welfare and the Problem of Interpretation". The Cato Journal. 21 (3). Retrieved 2015-10-13.
  65. Herrick, John; Stuart, Paul (2005). Poor Law (United States) . doi:10.4135/9781412952521. ISBN   9780761925842.
  66. Pimpare, Stephen (2008-01-01). A People's History of Poverty in America. New Press. ISBN   9781565849341.
  67. Kelley, David (1998-01-01). A Life of One's Own: Individual Rights and the Welfare State. Cato Institute. ISBN   9781882577712.
  68. Government and the American Economy . Retrieved 2015-10-13.{{cite book}}: |website= ignored (help)
  69. Tabb, Professor of Sociology and Economics William K.; Tabb, William K. (2002-01-22). Reconstructing Political Economy: The Great Divide in Economic Thought. Routledge. ISBN   9781134621644.
  70. Beito, David T. (2000-01-01). From Mutual Aid to the Welfare State: Fraternal Societies and Social Services, 1890-1967 . Univ of North Carolina Press. ISBN   9780807848418.
  71. Greasley, David; Oxley, Les (2011-10-13). Economics and History: Surveys in Cliometrics. John Wiley & Sons. ISBN   9781444346701.