Office of Portfolio Analysis

Last updated

The Office of Portfolio Analysis was established in the Division of Program Coordination, Planning, and Strategic Initiatives in 2011 to assist NIH Institutes and Centers with scientific portfolio analysis. [1] Per the Federal Register, the Office of Portfolio Analysis serves the following goals:

Contents

  1. Prepare and analyze data on NIH sponsored biomedical research to inform trans-NIH planning and coordination;
  2. Serve as a resource for portfolio management at the programmatic level;
  3. Employ databases, analytic tools, methodologies and other resources to conduct assessments in support of portfolio analyses and priority setting in scientific areas of interest across NIH;
  4. Research and develop new analytic tools, support systems, and specifications for new resources in coordination with other NIH organizations to enhance the management of the NIH's scientific portfolio; and
  5. Provide, in coordination with other NIH organizations, training on portfolio analysis tools, procedures, and methodology.

After its establishment in 2011, George Santangelo was appointed as the first Director of the Office of Portfolio Analysis.

Analytic tools

NIH COVID-19 Portfolio

In response to the COVID-19 pandemic, the Office of Portfolio Analysis developed the NIH COVID-19 Portfolio to index and track ongoing COVID-19 research and disseminate it to the public. [2] This portfolio is curated by scientific experts for COVID-19 relevance, and includes both peer-reviewed publications indexed in PubMed and preprints from bioRxiv, medRxiv, chemRxiv, arXiv, SSRN, and Research Square.

iCite

The NIH developed iCite as a bibliometrics dashboard to freely disseminate article-level citation metrics for scientific publications that are indexed in PubMed. One stated purpose of this analytic tool was to replace the use of journal level metrics like the Journal Impact Factor in research assessment and portfolio analysis. [3] Bulk data are made available through database snapshots and an API .As of 2020, iCite hosts three modules focusing on different types of citation metrics:

Influence

The research community called for the use of article-level citation metrics for research assessment instead of journal-level metrics, in the San Francisco Declaration on Research Assessment. The influence module of iCite disseminates field- and time-normalized article-level citation metrics like the Relative Citation Ratio. [4]

Translation

Because the NIH is particularly focused on science that improves human health, it developed article-level metrics that track the dissemination of basic research findings into clinical research, a process known as bench to bedside translation. The Translation module of iCite shows which clinical research articles have cited a given publication. For those publications that are not yet cited by a clinical research article, the Translation module shows the Approximate Potential to Translate, [5] which is a machine learning estimate of the probability that the publication will be cited by a clinical research article in the future.

Citations

In order to maximize transparency, the Office of Portfolio Analysis generated a public-domain citation graph named the NIH Open Citation Collection. [6] This citation graph underpins all citation metrics disseminated in iCite, and sources citation data from several sources, as well as extracting references from the PDFs of open access articles.

Related Research Articles

<span class="mw-page-title-main">National Institutes of Health</span> US government medical research agency

The National Institutes of Health, commonly referred to as NIH, is the primary agency of the United States government responsible for biomedical and public health research. It was founded in the late 1880s and is now part of the United States Department of Health and Human Services. Many NIH facilities are located in Bethesda, Maryland, and other nearby suburbs of the Washington metropolitan area, with other primary facilities in the Research Triangle Park in North Carolina and smaller satellite facilities located around the United States. The NIH conducts its own scientific research through the NIH Intramural Research Program (IRP) and provides major biomedical research funding to non-NIH research facilities through its Extramural Research Program.

<span class="mw-page-title-main">Preprint</span> Academic paper prior to journal publication

In academic publishing, a preprint is a version of a scholarly or scientific paper that precedes formal peer review and publication in a peer-reviewed scholarly or scientific journal. The preprint may be available, often as a non-typeset version available free, before or after a paper is published in a journal.

A citation index is a kind of bibliographic index, an index of citations between publications, allowing the user to easily establish which later documents cite which earlier documents. A form of citation index is first found in 12th-century Hebrew religious literature. Legal citation indexes are found in the 18th century and were made popular by citators such as Shepard's Citations (1873). In 1961, Eugene Garfield's Institute for Scientific Information (ISI) introduced the first citation index for papers published in academic journals, first the Science Citation Index (SCI), and later the Social Sciences Citation Index (SSCI) and the Arts and Humanities Citation Index (AHCI). American Chemical Society converted its printed Chemical Abstract Service into internet-accessible SciFinder in 2008. The first automated citation indexing was done by CiteSeer in 1997 and was patented. Other sources for such data include Google Scholar, Microsoft Academic, Elsevier's Scopus, and the National Institutes of Health's iCite.

The National Institute of Arthritis and Musculoskeletal and Skin Diseases (NIAMS) is one of the institutes and centers that make up the National Institutes of Health, an agency of the United States Department of Health and Human Services (HHS).

The impact factor (IF) or journal impact factor (JIF) of an academic journal is a scientometric index calculated by Clarivate that reflects the yearly mean number of citations of articles published in the last two years in a given journal, as indexed by Clarivate's Web of Science.

<span class="mw-page-title-main">Bibliometrics</span> Statistical analysis of written publications

Bibliometrics is the application of statistical methods to the study of bibliographic data, especially in scientific and library and information science contexts, and is closely associated with scientometrics to the point that both fields largely overlap.

Scientometrics is a subfield of informetrics that studies quantitative aspects of scholarly literature. Major research issues include the measurement of the impact of research papers and academic journals, the understanding of scientific citations, and the use of such measurements in policy and management contexts. In practice there is a significant overlap between scientometrics and other scientific fields such as information systems, information science, science of science policy, sociology of science, and metascience. Critics have argued that overreliance on scientometrics has created a system of perverse incentives, producing a publish or perish environment that leads to low-quality research.

<span class="mw-page-title-main">Medical research</span> Wide array of research

Medical research, also known as health research, refers to the process of using scientific methods with the aim to produce knowledge about human diseases, the prevention and treatment of illness, and the promotion of health.

Translational medicine develops the clinical practice applications of the basic science aspects of the biomedical sciences; that is, it translates basic science to applied science in medical practice. It is defined by the European Society for Translational Medicine as "an interdisciplinary branch of the biomedical field supported by three main pillars: benchside, bedside, and community". The goal of translational medicine is to combine disciplines, resources, expertise, and techniques within these pillars to promote enhancements in prevention, diagnosis, and therapies. Accordingly, translational medicine is a highly interdisciplinary field, the primary goal of which is to coalesce assets of various natures within the individual pillars in order to improve the global healthcare system significantly.

Journal Citation Reports (JCR) is an annual publication by Clarivate. It has been integrated with the Web of Science and is accessed from the Web of Science Core Collection. It provides information about academic journals in the natural and social sciences, including impact factors. JCR was originally published as a part of the Science Citation Index. Currently, the JCR, as a distinct service, is based on citations compiled from the Science Citation Index Expanded and the Social Sciences Citation Index. As of the 2023 edition, journals from the Arts and Humanities Citation Index and the Emerging Sources Citation Index have also been included.

The Pennington Biomedical Research Center is a health science-focused research center in Baton Rouge, Louisiana. It is part of the Louisiana State University System and conducts clinical, basic, and population science research. It is the largest academically-based nutrition research center in the world, with the greatest number of obesity researchers on faculty. The center's over 500 employees occupy several buildings on the 222-acre (0.90 km2) campus. The center was designed by the Baton Rouge architect John Desmond.

Translational research is research aimed at translating (converting) results in basic research into results that directly benefit humans. The term is used in science and technology, especially in biology and medical science. As such, translational research forms a subset of applied research.

International Aging Research Portfolio (IARP) is a non-profit, open-access knowledge management system incorporating grants, publications, conferences in natural and social & behavioral sciences. In addition to the advanced search and visual trend analysis tools the system includes a directory of research projects classified into categories related to aging research. The system uses automatic classification algorithms with elements of machine learning to assign research projects to the relevant categories. The directory is curated by many expert category editors and science advisory board members. The chair of the science advisory board is Dr. Charles Cantor.

<span class="mw-page-title-main">NIH Intramural Research Program</span> Internal research program of the National Institutes of Health

The NIH Intramural Research Program (IRP) is the internal research program of the National Institutes of Health (NIH), known for its synergistic approach to biomedical science. With 1,200 Principal Investigators and over 4,000 Postdoctoral Fellows conducting basic, translational, and clinical research, the NIH Intramural Research Program is the largest biomedical research institution on earth. The unique funding environment of the IRP facilitates opportunities to conduct both long-term and high-impact science that would otherwise be difficult to undertake. With rigorous external reviews ensuring that only the most outstanding research secures funding, the IRP is responsible for many scientific accomplishments, including the discovery of fluoride to prevent tooth decay, the use of lithium to manage bipolar disorder, and the creation of vaccines against hepatitis, Hemophilus influenzae (Hib), and human papillomavirus (HPV). In addition, the IRP has also produced or trained 21 Nobel Prize-winning scientists.

<span class="mw-page-title-main">Altmetrics</span> Alternative metrics for analyzing scholarship

In scholarly and scientific publishing, altmetrics are non-traditional bibliometrics proposed as an alternative or complement to more traditional citation impact metrics, such as impact factor and h-index. The term altmetrics was proposed in 2010, as a generalization of article level metrics, and has its roots in the #altmetrics hashtag. Although altmetrics are often thought of as metrics about articles, they can be applied to people, journals, books, data sets, presentations, videos, source code repositories, web pages, etc.

The Patient-Reported Outcomes Measurement Information System (PROMIS) provides clinicians and researchers access to reliable, valid, and flexible measures of health status that assess physical, mental, and social well–being from the patient perspective. PROMIS measures are standardized, allowing for assessment of many patient-reported outcome domains—including pain, fatigue, emotional distress, physical functioning and social role participation—based on common metrics that allow for comparisons across domains, across chronic diseases, and with the general population. Further, PROMIS tools allow for computer adaptive testing, efficiently achieving precise measurement of health status domains with few items. There are PROMIS measures for both adults and children. PROMIS was established in 2004 with funding from the National Institutes of Health (NIH) as one of the initiatives of the NIH Roadmap for Medical Research.

Article-level metrics are citation metrics which measure the usage and impact of individual scholarly articles.

Metascience is the use of scientific methodology to study science itself. Metascience seeks to increase the quality of scientific research while reducing inefficiency. It is also known as "research on research" and "the science of science", as it uses research methods to study how research is done and find where improvements can be made. Metascience concerns itself with all fields of research and has been described as "a bird's eye view of science". In the words of John Ioannidis, "Science is the best thing that has happened to human beings ... but we can do it better."

<span class="mw-page-title-main">George Santangelo</span> American genomicist and data scientist

George M. Santangelo is an American genomicist and data scientist. He is the director of the Office of Portfolio Analysis at the National Institutes of Health.

Sex as a biological variable (SABV) is a research policy recognizing sex as an important variable to consider when designing studies and assessing results. Research including SABV has strengthened the rigor and reproducibility of findings. Public research institutions including the European Commission, Canadian Institutes of Health Research, and the U.S. National Institutes of Health have instituted SABV policies. Editorial policies were established by various scientific journals recognizing the importance and requiring research to consider SABV.

References

  1. "National Institutes of Health Statement of Organization, Functions, and Delegations of Authority". Federal Register. U.S. National Archives. Retrieved 12 August 2020.
  2. Santangelo, George. "New NIH Resource to Analyze COVID-19 Literature: The COVID-19 Portfolio Tool". Open Mike. U.S. National Institutes of Health. Retrieved 12 August 2020.
  3. Santangelo, George (2017). "Article-level assessment of influence and translation in biomedical research". Mol Biol Cell. 28 (11): 1401–1408. doi: 10.1091/mbc.E16-01-0037 . PMC   5449139 . PMID   28559438.
  4. Hutchins, B. Ian; Yuan, Xin; Anderson, James M.; Santangelo, George (2016). "Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level". PLOS Biol. 14 (9): e1002541. doi: 10.1371/journal.pbio.1002541 . PMC   5012559 . PMID   27599104.
  5. Hutchins, B. Ian; Davis, Matthew; Meseroll, Rebecca; Santangelo, George (2019). "Predicting translational progress in biomedical research". PLOS Biol. 17 (10): e3000416. doi: 10.1371/journal.pbio.3000416 . PMC   6786525 . PMID   31600189.
  6. Hutchins, B. Ian; Baker, Kirk; Davis, Matthew; Diwersy, Mario; Haque, Ehsanul; Harriman, Robert; Hoppe, Travis; Leicht, Stephen; Meyer, Payam; Santangelo, George (2019). "The NIH Open Citation Collection: A public access, broad coverage resource". PLOS Biol. 17 (10): e3000385. doi: 10.1371/journal.pbio.3000385 . PMC   6786512 . PMID   31600197.