STAR METRICS

Last updated

STAR METRICS (Science and Technology for America's Reinvestment: Measuring the EffecT of Research on Innovation, Competitiveness and Science) was a partnership (STAR METRICS Consortium) between United States federal science agencies and research institutions to document the return on investment, research impact, and social outcomes of federally funded research and development. The federal consortium comprised the White House Office of Science and Technology Policy (OSTP), the National Institutes of Health (NIH), the National Science Foundation, (NSF), the US Department of Agriculture, (USDA), and the US Environmental Protection Agency,(EPA). NIH was the host agency for the consortium, which was governed by an Executive Committee and an advisory interagency working group.

Contents

It was announced by OSTP on 28 May 2010 in a press release titled "STAR METRICS: New Way to Measure the Impact of Federally Funded Research". [1]

Pilot

A pilot was undertaken by the following seven institutions in a Federal Demonstration Partnership: [2]

History

The imperative for the launch of STAR METRICS was the passing of the American Recovery and Reinvestment Act of 2009 (ARRA), which included a stimulus package for research and development because it was widely believed that investments in science and research would stimulate economic growth. Part of the bill required recipients to report quarterly on job creation. [3] [4] [5] [6] The ARRA reporting requirements are distinct from STAR METRICS. The latter was established to provide evidence that investment in research had a positive effect on the economy, because there is little thoroughly conclusive evidence that this is actually the case - even though it is a generally accepted assumption. [4]

In 2010 STAR METRICS was given a five-year commitment from agencies, and NIH and NSF committed $1 million (~$1.23 million in 2021) combined. [7] [8] Other federal funders that have joined are the United States Department of Energy, Environmental Protection Agency, and Department of Agriculture. Research institutions voluntarily join the consortium. Subsequent funding from federal agencies continued until 2022.

The formal governance was put in place in January 2012, with NIH hosting the project. [8]

The goal of the program was set to develop measures for the impact of federal investments on science, society, the workforce and the economy. To this end, a database was set up of all federally funded researchers and cleaned to ensure no confusions of people with the same or similar names etc. were made. This database was then used to match with other accessible databases such as public records of patents, institutional financial records, payroll data, as well as more traditional scientific output indicators such as scientific citations. [4] [9]

Outcomes

An attraction of STAR METRICS project was that it would scrape data from existing reports, databases, and the internet for the information it needed, much like the Lattes Platform in Brazil. [7] [10]

STAR METRICS quickly started tracking job creation from ARRA and non-ARRA research grants at 70 universities, and subsequently moved on to tracking other outcomes of investment in research. [5]

STAR METRICS also developed Federal RePORTER, a database that consolidated information from several extant databases--eRA databases, Medline, and PubMed Central -- using linkages among these disparate data sources. This centralized database allowed for research into science funding across federal agencies and linkages to subsequent downstream impacts and outcomes. The database was discontinued on March 1, 2022, but served as the inspiration for other efforts to track and link federal science investments to outcomes, such as the University of Michigan's Institute for Research On Innovation and Science (IRIS) program. The following agencies contributed data to Federal RePORTER:

See also

Related Research Articles

<span class="mw-page-title-main">National Institutes of Health</span> US government medical research agency

The National Institutes of Health, commonly referred to as NIH, is the primary agency of the United States government responsible for biomedical and public health research. It was founded in the late 1880s and is now part of the United States Department of Health and Human Services. Many NIH facilities are located in Bethesda, Maryland, and other nearby suburbs of the Washington metropolitan area, with other primary facilities in the Research Triangle Park in North Carolina and smaller satellite facilities located around the United States. The NIH conducts its own scientific research through the NIH Intramural Research Program (IRP) and provides major biomedical research funding to non-NIH research facilities through its Extramural Research Program.

<span class="mw-page-title-main">National Science Foundation</span> United States government agency

The National Science Foundation (NSF) is an independent agency of the United States federal government that supports fundamental research and education in all the non-medical fields of science and engineering. Its medical counterpart is the National Institutes of Health. With an annual budget of about $8.3 billion, the NSF funds approximately 25% of all federally supported basic research conducted by the United States' colleges and universities. In some fields, such as mathematics, computer science, economics, and the social sciences, the NSF is the major source of federal backing.

Scientometrics is the field of study which concerns itself with measuring and analysing scholarly literature. Scientometrics is a sub-field of informetrics. Major research issues include the measurement of the impact of research papers and academic journals, the understanding of scientific citations, and the use of such measurements in policy and management contexts. In practice there is a significant overlap between scientometrics and other scientific fields such as information systems, information science, science of science policy, sociology of science, and metascience. Critics have argued that over-reliance on scientometrics has created a system of perverse incentives, producing a publish or perish environment that leads to low-quality research.

Research funding is a term generally covering any funding for scientific research, in the areas of natural science, technology, and social science. Different methods can be used to disburse funding, but the term often connotes funding obtained through a competitive process, in which potential research projects are evaluated and only the most promising receive funding. It is often measured via Gross domestic expenditure on R&D (GERD).

<span class="mw-page-title-main">Medical research</span> Wide array of research

Medical research, also known as experimental medicine, encompasses a wide array of research, extending from "basic research", – involving fundamental scientific principles that may apply to a preclinical understanding – to clinical research, which involves studies of people who may be subjects in clinical trials. Within this spectrum is applied research, or translational research, conducted to expand knowledge in the field of medicine.

EcoHealth Alliance is a US-based non-governmental organization with a stated mission of protecting people, animals, and the environment from emerging infectious diseases. The nonprofit is focused on research that aims to prevent pandemics and promote conservation in hotspot regions worldwide.

<span class="mw-page-title-main">Neal Francis Lane</span>

Cornelius Francis "Neal" Lane, is an American physicist and senior fellow in science and technology policy at Rice University's Baker Institute for Public Policy and Malcolm Gillis University Professor Emeritus of Physics and Astronomy Emeritus at Rice University in Houston, Texas.

In many countries, the term principal investigator (PI) refers to the holder of an independent grant and the lead researcher for the grant project, usually in the sciences, such as a laboratory study or a clinical trial. The phrase is also often used as a synonym for "head of the laboratory" or "research group leader". While the expression is common in the sciences, it is used widely for the person or persons who make final decisions and supervise funding and expenditures on a given research project.

<span class="mw-page-title-main">Office of Science and Technology Policy</span> Department of the United States government

The Office of Science and Technology Policy (OSTP) is a department of the United States government, part of the Executive Office of the President (EOP), established by United States Congress on May 11, 1976, with a broad mandate to advise the President on the effects of science and technology on domestic and international affairs.

<span class="mw-page-title-main">Philip Rubin</span> American linguist

Philip E. Rubin is an American cognitive scientist, technologist, and science administrator known for raising the visibility of behavioral and cognitive science, neuroscience, and ethical issues related to science, technology, and medicine, at a national level. His research career is noted for his theoretical contributions and pioneering technological developments, starting in the 1970s, related to speech synthesis and speech production, including articulatory synthesis and sinewave synthesis, and their use in studying complex temporal events, particularly understanding the biological bases of speech and language.

<span class="mw-page-title-main">National Science and Technology Council</span> The NSTC establishes national goals for science and technology.

The National Science and Technology Council (NSTC) is a council in the Executive Branch of the United States. It is designed to coordinate science and technology policy across the branches of federal government.

<span class="mw-page-title-main">American Recovery and Reinvestment Act of 2009</span> Stimulus package

The American Recovery and Reinvestment Act of 2009 (ARRA), nicknamed the Recovery Act, was a stimulus package enacted by the 111th U.S. Congress and signed into law by President Barack Obama in February 2009. Developed in response to the Great Recession, the primary objective of this federal statute was to save existing jobs and create new ones as soon as possible. Other objectives were to provide temporary relief programs for those most affected by the recession and invest in infrastructure, education, health, and renewable energy.

The concept of team science is a field of scientific philosophy and methodology which advocates using cross-disciplinary collaboration from diverse scientific fields to solve present-day problems. The field encompasses conceptual and methodological strategies aimed at understanding and enhancing the processes and outcomes of collaborative, team-based research.

<span class="mw-page-title-main">Science policy of the United States</span> Government support and limits of scientific research

The science policy of the United States is the responsibility of many organizations throughout the federal government. Much of the large-scale policy is made through the legislative budget process of enacting the yearly federal budget, although there are other legislative issues that directly involve science, such as energy policy, climate change, and stem cell research. Further decisions are made by the various federal agencies which spend the funds allocated by Congress, either on in-house research or by granting funds to outside organizations and researchers.

The White House BRAIN Initiative is a collaborative, public-private research initiative announced by the Obama administration on April 2, 2013, with the goal of supporting the development and application of innovative technologies that can create a dynamic understanding of brain function.

<span class="mw-page-title-main">San Francisco Declaration on Research Assessment</span> 2012 manifesto against using the journal impact factor to assess a scientists work

The San Francisco Declaration on Research Assessment (DORA) intends to halt the practice of correlating the journal impact factor to the merits of a specific scientist's contributions. Also according to this statement, this practice creates biases and inaccuracies when appraising scientific research. It also states that the impact factor is not to be used as a substitute "measure of the quality of individual research articles, or in hiring, promotion, or funding decisions".

<span class="mw-page-title-main">Foundation for the National Institutes of Health</span>

The Foundation for the National Institutes of Health (FNIH) is a not-for-profit, 501(c)(3) charitable organization established by the US Congress in 1990. Located in North Bethesda, MD, the FNIH raises private-sector funds, and creates and manages alliances with public and private institutions in support of the mission of the National Institutes of Health (NIH).

The National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK) is part of the United States National Institutes of Health, which in turn is part of the Department of Health and Human Services. NIDDK is approximately the fifth-largest of the 27 NIH institutes. The institute's mission is to support research, training, and communication with the public in the topic areas of "diabetes and other endocrine and metabolic diseases; digestive diseases, nutritional disorders, and obesity; and kidney, urologic, and hematologic diseases". As of 2021, the Director of the institute is Griffin P. Rodgers, who assumed the position on an acting basis in 2006 and on a permanent basis in 2007.

The Science and Technology Policy Institute is a federally funded research and development center located in Washington, D.C. STPI provides objective research and analysis on science and technology policy issues in support of the White House Office of Science and Technology Policy (OSTP), as well as for its sponsor, the National Science Foundation, and other science-performing federal agencies. STPI is administered by the non-profit Institute for Defense Analyses, located in Alexandria, Virginia. As of May 2020, Kristen Kulinowski is the current director of STPI.

<span class="mw-page-title-main">National Center for Science and Engineering Statistics</span> Federal statistical agency of the United States

The National Center for Science and Engineering Statistics (NCSES) is one of the thirteen principal statistical agencies of the United States and is tasked with providing objective data on the status of the science and engineering enterprise in the U.S. and other countries. NCSES sponsors or co-sponsors data collection on 15 surveys and produces two key publications: Science and Engineering Indicators, and Women, Minorities, and Persons with Disabilities in Science and Engineering. Though policy-neutral, the data and reports produced by NCSES are used by policymakers when making policy decisions regarding STEM education and research funding in the U.S.

References

  1. ↑ STAR METRICS: New Way to Measure the Impact of Federally Funded Research, White House Office of Science and Technology Policy
  2. ↑ FDP, STAR METRICS page
  3. ↑ Julia Lane (25 March 2010). "Let's make science metrics more scientific". Nature . 464 (7288): 488–489. Bibcode:2010Natur.464..488L. doi:10.1038/464488a. hdl: 10419/43597 . PMID   20336116. S2CID   9563303.
  4. 1 2 3 Colin Macilwain (9 June 2010). "Science economics: What science is really worth". Nature. 465 (7299): 682–684. doi: 10.1038/465682a . PMID   20535177.
  5. 1 2 Colin Macilwain (28 September 2011). "A multi-billion dollar injection: Stimulus—response". Nature. 477 (7366): 524–525. Bibcode:2011Natur.477..524M. doi: 10.1038/477524a . PMID   21956310.
  6. ↑ Halevi, Gali (March 2012). "Scientific Evaluation and Metrics – an Interview with Julia Lane". Research Trends (27).
  7. 1 2 David Kramer (August 2010). "Initiative aims to quantify the paybacks from basic research". Physics Today . 63 (8): 20. Bibcode:2010PhT....63h..20K. doi: 10.1063/1.3480067 .
  8. 1 2 "Open Government at HHS". 26 January 2015.
  9. ↑ Julia Lane, Stefano Bertuzzi (11 February 2011). "Measuring the Results of Science Investments". Science. 331 (6018): 678–680. Bibcode:2011Sci...331..678L. doi:10.1126/science.1201865. PMID   21310987. S2CID   206531958.
  10. ↑ "EU looks to US model for measuring R&D impact". EurActiv. 16 April 2010.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.