Audit study

Last updated

A type of study used in economics, sociology, political science, and psychology, an audit study is one in which trained employees of the researcher ("auditors") are matched on all characteristics except the one being tested for discrimination. [1] These auditors then apply for a service, be it a job, financial advice regarding their stock portfolio, [2] housing, [3] or a credit card, to test for discrimination. [4]

Contents

Applications

Audit studies have been conducted to test the existence of discrimination in numerous occupations and services and in regards to multiple characteristics. [5] For example, studies have been conducted to measure discrimination against racial minorities by real estate agents, [6] racial discrimination in professional networking on LinkedIn [7] and Twitter, [8] requests on Airbnb, [9] prices in online markets [10] , emails to early childcare facilities [11] as well as gender discrimination against women applying for restaurant jobs. [12] Most employment-related audit studies have focused on overqualified college students applying for low-paying jobs during the summer. [13] They have also been used to measure racial and gender discrimination in academia, [14] racial discrimination in the low [15] and high [16] ends of the labor market, discrimination in social integration, [17] and racial/ethnic discrimination in roommate selection. [18]

Criticism

Audit studies have been criticized because the auditors may look different to employers, and this may result in the appearance of discrimination when employers were really just making decisions based on appearance. [19] The other limitations of these studies, according to their critics, include that they are unable to audit jobs found through interactions with other people directly, only those found through newspapers. [13] Additionally, others have noted the lack of standardization of signals (primarily names) to indicate race through correspondence (e.g., resumes and emails). [20] [21] Aside from being a noisy signal, since not everybody may understand what, e.g., a "Black" name is, names have also been criticized for signalling additional information. [22] [23] For instance, in the USA, stereotypically Black names are associated with lower socioeconomic background within the Black community. [24] However, some recent studies have used AI-generated images, [7] [8] pictures of hands, [10] or pictures of actors [25] to signal race.

Other criticisms concern the ethics of running such experiments. Specifically, it has been pointed out that audit studies do typically not obtain informed consent of participants. Simultaneously, they generate some though usually low costs to participants and rarely provide benefits. Because of this, the literature has developed multiple guidlines to judge the ethics of an audit study on discrimination specifically. This includes judging (1) the potential harm to participants, (2) against the benefits of having a reliable measure of discrimination, (3) and taking into account whether there are other, less harmful ways to measure discrimination in the same setting. Finally, (4) deception should not strongly violate the norms of the setting the experiment is conducted in. [26]

See also

References

  1. Gaddis, S. Michael, ed. (2018). Audit Studies: Behind the Scenes with Theory, Method, and Nuance. Springer. doi:10.1007/978-3-319-71153-9. ISBN   978-3-319-71152-2.
  2. Mullainathan, Sendhil; Noeth, Markus; Schoar, Antoinette (March 2012). "The Market for Financial Advice: An Audit Study". NBER Working Paper No. 17929. doi: 10.3386/w17929 .
  3. Page, Marianne (1995). "Racial and ethnic discrimination in urban housing markets: Evidence from a recent audit study" . Journal of Urban Economics . 38 (2): 183–206. doi:10.1006/juec.1995.1028.
  4. Fix, Michael; Struyk, Raymond J., eds. (1993). Clear and Convincing Evidence: Measurement of Discrimination in America. Urban Institute Press.
  5. Bertrand, M.; Duflo, E. (2017-01-01), Banerjee, Abhijit Vinayak; Duflo, Esther (eds.), "Field Experiments on Discriminationa", Handbook of Economic Field Experiments, Handbook of Field Experiments, vol. 1, North-Holland, pp. 309–393, doi:10.1016/bs.hefe.2016.08.004 , retrieved 2025-10-08
  6. Page, Marianne (September 1995). "Racial and Ethnic Discrimination in Urban Housing Markets: Evidence from a Recent Audit Study". Journal of Urban Economics . 38 (2): 183–206. doi:10.1006/juec.1995.1028.
  7. 1 2 Evsyukova®, Yulia; Rusche®, Felix; Mill, Wladislaw (2025-01-11). "LinkedOut? A Field Experiment on Discrimination in Job Network Formation". The Quarterly Journal of Economics. 140 (1): 283–334. doi:10.1093/qje/qjae035. ISSN   0033-5533.
  8. 1 2 Ajzenman, Nicolás; Ferman, Bruno; Sant'Anna, Pedro C. (September 2025). "Discrimination in the Formation of Academic Networks: A Field Experiment on #EconTwitter". American Economic Review: Insights. 7 (3): 357–375. doi:10.1257/aeri.20240298. ISSN   2640-205X.
  9. Edelman, Benjamin; Luca, Michael; Svirsky, Dan (April 2017). "Racial Discrimination in the Sharing Economy: Evidence from a Field Experiment". American Economic Journal: Applied Economics. 9 (2): 1–22. doi:10.1257/app.20160213. ISSN   1945-7782.
  10. 1 2 Doleac, Jennifer L.; Stein, Luke C.D. (2013-11-01). "The Visible Hand: Race and Online Market Outcomes". The Economic Journal. 123 (572): F469 –F492. doi:10.1111/ecoj.12082. ISSN   0013-0133.
  11. Hermes, Henning; Lergetporer, Philipp; Peter, Frauke; Wiederhold, Simon (2025-06-16). "Application Barriers and the Socioeconomic Gap in Child Care Enrollment". Journal of the European Economic Association. 23 (3): 1133–1172. doi:10.1093/jeea/jvae054. ISSN   1542-4766.
  12. Neumark, D.; Bank, R. J.; Van Nort, K. D. (1 August 1996). "Sex Discrimination in Restaurant Hiring: An Audit Study" (PDF). The Quarterly Journal of Economics . 111 (3): 915–941. doi:10.2307/2946676. JSTOR   2946676. S2CID   150106209.
  13. 1 2 Heckman, James J. (Spring 1998). "Detecting Discrimination". The Journal of Economic Perspectives . 12 (2): 101–116. CiteSeerX   10.1.1.371.4425 . doi:10.1257/jep.12.2.101. JSTOR   2646964.
  14. Milkman, K. L.; Akinola, M.; Chugh, D. (21 May 2012). "Temporal Distance and Discrimination: An Audit Study in Academia". Psychological Science . 23 (7): 710–717. doi:10.1177/0956797611434539. PMID   22614463. S2CID   6706060.
  15. Pager, D. (March 2003). "The Mark of a Criminal Record". American Journal of Sociology . 108 (5): 937–975. doi:10.1086/374403. S2CID   11568703.
  16. Gaddis, S. M. (June 2015). "Discrimination in the Credential Society: An Audit Study of Race and College Selectivity in the Labor Market". Social Forces . 93 (4): 1451–1479. doi:10.1093/sf/sou111.
  17. Gomez-Gonzalez, Carlos; Nesseler, Cornel; Dietl, Helmut (2021). "Mapping discrimination in Europe through a field experiment in amateur sport" (PDF). Humanities and Social Sciences Communications. 8: 1–7. doi: 10.1057/s41599-021-00773-2 .
  18. Gaddis, S. Michael; Ghoshal, Raj (2020). "Searching for a Roommate: A Correspondence Audit Examining Racial/Ethnic and Immigrant Discrimination among Millennials". Socius: Sociological Research for a Dynamic World. 6. doi: 10.1177/2378023120972287 . PMC   8336603 . PMID   34355061. S2CID   213167707.
  19. Neumark, David (2012). "Detecting Discrimination in Audit and Correspondence Studies". Journal of Human Resources . 47 (4): 1128–1157. doi:10.3368/jhr.47.4.1128. hdl: 10419/46132 . S2CID   17645916.
  20. Gaddis, S. Michael (2017). "How Black Are Lakisha and Jamal? Racial Perceptions from Names Used in Correspondence Audit Studies". Sociological Science . 4: 469–489. doi: 10.15195/v4.a19 .
  21. Gaddis, S. Michael (2017). "Racial/Ethnic Perceptions from Hispanic Names: Selecting Names to Test for Discrimination". Socius: Sociological Research for a Dynamic World . 3: 237802311773719. doi: 10.1177/2378023117737193 .
  22. Webservices, Parker (2017-09-06). "How Black Are Lakisha and Jamal? Racial Perceptions from Names Used in Correspondence Audit Studies". Sociological Science. 4: 469–489. doi:10.15195/v4.a19. ISSN   2330-6696.
  23. Fryer, R. G.; Levitt, S. D. (2004-08-01). "The Causes and Consequences of Distinctively Black Names". The Quarterly Journal of Economics. 119 (3): 767–805. doi:10.1162/0033553041502180. ISSN   0033-5533.
  24. Kreisman, Daniel; Smith, Jonathan (April 2023). "Distinctively Black Names and Educational Outcomes". Journal of Political Economy. 131 (4): 877–897. doi:10.1086/722093. ISSN   0022-3808.
  25. Kaas, Leo; Manger, Christian (2012-02-01). "Ethnic Discrimination in Germany's Labour Market: A Field Experiment". German Economic Review. 13 (1): 1–20. doi:10.1111/j.1468-0475.2011.00538.x. ISSN   1468-0475.
  26. Salganik, Matthew J. (2019). Bit by bit: social research in the digital age (First paperback printing ed.). Princeton Oxford: Princeton University Press. ISBN   978-0-691-15864-8.