Faculty Scholarly Productivity Index

Last updated

The Faculty Scholarly Productivity Index (FSPI), a product of Academic Analytics, is a metric designed to create benchmark standards for the measurement of academic and scholarly quality within and among United States research universities.

Contents

The index is based on a set of statistical algorithms developed by Lawrence B. Martin and Anthony Olejniczak. It measures the annual amount and impact of faculty scholarly work in several areas, including:

The FSPI analysis creates, by academic field of study, a statistical score and a ranking based on the cumulative scoring of a program's faculty using these quantitative measures compared against national standards within the particular discipline. Individual program scores can then be combined to demonstrate the quality of the scholarly work of the entire university. This information is gathered for over 230,000 faculty members representing 118 academic disciplines in roughly 7,300 Ph.D. programs throughout more than 350 universities in the United States.

Rankings approach

Unlike other annual college and university rankings, e.g., the U.S. News & World Report annual survey, the FSPI focuses on research institutions as defined by the Carnegie Classification of Institutions of Higher Education. It draws on the approach used by the United States National Research Council (NRC), which publishes a ranking of U.S.-based graduate programs approximately every ten years, but focuses on providing a more frequently-gathered set of benchmark measurements that do not include the qualitative and subjective reputation assessments favored by the NRC and other ranking systems.

History

The system for evaluating university programs that forms the basis of the FSPI was developed by Lawrence Martin and Anthony Olejniczak of Stony Brook University. Martin had been studying, speaking, and writing about faculty scholarly productivity since 1995. During that period,[ vague ] a series of discipline-specific, per-capita regression models was created and tested to evaluate their accuracy and the feasibility of predicting the academic reputation of the faculty of doctoral programs.

These prototype materials employed data from the National Research Council's 1995 publication Continuity and Change (and the subsequent CD-ROM publication of data), describing and evaluating American Ph.D. programs by field. Martin and Olejniczak found that the reputation of a program (as measured by faculty scholarly reputation from a survey conducted by the National Research Council) could be predicted well using a discipline-specific regression equation derived from quantitative, per capita data available for each program (the number of journal articles, citations, federally funded grants, and honorific awards). Reputation could be predicted with high statistical significance but important deviations from the regression line were also apparent; that is to say, some schools were outperforming their reputation, while others were under-performing. The prototype materials based on this method, and the data from the 1995 NRC study, were subsequently presented at numerous academic conferences from 1996 to 2004, and have formed the basis on which the FSP Index was developed.

Like many academic productivity algorithms, the FSPI has major flaws. It fails to adequately differentiate among and apply appropriate measures to evaluating the very distinct academic fields represented in most colleges and universities. Furthermore, a number of specific objections have been raised about how the FSPI measures scholarly productivity. Among them are: 1) inadequate—or inconsistent—weighting of quality of journals in which publications appear; 2) failure to differentiate labor involved in producing different types of publications (publications based on secondary sources and those based on tedious and deep research are not differentiated—hence departments with many faculty members who write much but research little are better rated; 3) failure to differentiate between scholarly concentrations of departments. Departments with faculty who are more involved in obscure, non-mainstream research are less cited than those involved in fashionable, mainstream areas of research and scholarship; 4) citation indexes, extensively used in scholarly productivity indexes, do not measure citations in books; 5) citation indexes are more appropriate for hard science disciplines and less appropriate for humanities disciplines; 6) non-conventional publications, which are increasing in number (e.g. - Web sites and on-line publications, audio and media productions) are ignored; 7) use of such indexes promotes "researching and publishing to the index" in order to preserve and enlarge university, government, and private grant support—and indirectly promote conservative, safe, mainstream research and publications.

In spite of these objections, today the product is used by numerous universities. [1]

Related Research Articles

College and university rankings order the best institutions in higher education based on factors that vary depending on the ranking. Some rankings evaluate institutions within a single country, while others assess institutions worldwide. Rankings are typically conducted by magazines, newspapers, websites, governments, or academics. In addition to ranking entire institutions, specific programs, departments, and schools can be ranked. Some rankings consider measures of wealth, excellence in research, selective admissions, and alumni success. Rankings may also consider various combinations of measures of specialization expertise, student options, award numbers, internationalization, graduate employment, industrial linkage, historical reputation and other criteria.

Scientometrics is the field of study which concerns itself with measuring and analysing scholarly literature. Scientometrics is a sub-field of informetrics. Major research issues include the measurement of the impact of research papers and academic journals, the understanding of scientific citations, and the use of such measurements in policy and management contexts. In practice there is a significant overlap between scientometrics and other scientific fields such as information systems, information science, science of science policy, sociology of science, and metascience. Critics have argued that over-reliance on scientometrics has created a system of perverse incentives, producing a publish or perish environment that leads to low-quality research.

Citation analysis is the examination of the frequency, patterns, and graphs of citations in documents. It uses the directed graph of citations — links from one document to another document — to reveal properties of the documents. A typical aim would be to identify the most important documents in a collection. A classic example is that of the citations between academic articles and books. For another example, judges of law support their judgements by referring back to judgements made in earlier cases. An additional example is provided by patents which contain prior art, citation of earlier patents relevant to the current claim.

Accounting scholarship is an academic discipline oriented towards the profession of accounting, usually taught at a business school.

<span class="mw-page-title-main">Joseph M. Katz Graduate School of Business</span>

The Joseph M. Katz Graduate School of Business is the graduate business school of the University of Pittsburgh located in Pittsburgh, Pennsylvania. Although business education had its origins at the university in 1907, the Graduate School of Business was established in 1960 from a merger of its predecessors, the School of Business Administration and the Graduate School of Retailing. It was renamed in 1987 after businessman and university alumnus benefactor Joseph Katz. The school offers a traditional, accelerated, part-time, business analytics, and executive Master of Business Administration (MBA) degrees as well as Master of Science degrees in Accounting, Business Analytics, Finance, Information Systems, Management, Marketing, Supply Chain Management and several Ph.D. programs in business. Katz is regularly ranked in the top 5% of Association to Advance Collegiate Schools of Business-accredited schools and in the top 0.3% of schools worldwide that grant business degrees.

The h-index is an author-level metric that measures both the productivity and citation impact of the publications, initially used for an individual scientist or scholar. The h-index correlates with obvious success indicators such as winning the Nobel Prize, being accepted for research fellowships and holding positions at top universities. The index is based on the set of the scientist's most cited papers and the number of citations that they have received in other publications. The index has more recently been applied to the productivity and impact of a scholarly journal as well as a group of scientists, such as a department or university or country. The index was suggested in 2005 by Jorge E. Hirsch, a physicist at UC San Diego, as a tool for determining theoretical physicists' relative quality and is sometimes called the Hirsch index or Hirsch number.

<span class="mw-page-title-main">University of the Chinese Academy of Sciences</span>

The University of the Chinese Academy of Sciences is a public university for graduate education, under the direct leadership of the Chinese Academy of Sciences (CAS). The predecessors of UCAS are the Graduate University of the Chinese Academy of Sciences (GUCAS) and the Graduate School of the University of Science and Technology of China (USTC), which was founded in 1978 as the first graduate school in China by approval of the State Council of China.

Social Sciences Citation Index Citation index product of Clarivate Analytics

The Social Sciences Citation Index (SSCI) is a commercial citation index product of Clarivate Analytics. It was originally developed by the Institute for Scientific Information from the Science Citation Index. The Social Sciences Citation Index is a multidisciplinary index which indexes over 3,400 journals across 58 social science disciplines – 1985 to present, and it has 122 million cited references - 1900 to present. It also includes a range of 3,500 selected items from some of the world's finest scientific and technical journals. It has a range of useful search functions such as ‘cited reference searching’, searching by author, subject, or title. Whilst the Social Sciences Citation Index provides extensive support in bibliographic analytics and research, a number of academic scholars have expressed criticisms relating to ideological bias and it's English-dominant publishing nature.

The United States National Research Council had conducted a survey, and compiled a report, on United States Research-Doctorate Programs approximately every 10 years, although the time elapsed between each new ranking had sometimes exceeded 10 years.

Journal ranking is widely used in academic circles in the evaluation of an academic journal's impact and quality. Journal rankings are intended to reflect the place of a journal within its field, the relative difficulty of being published in that journal, and the prestige associated with it. They have been introduced as official research evaluation tools in several countries.

Mary Frank Fox is Dean's Distinguished Professor in the School of Public Policy at the Georgia Institute of Technology. She is a pioneer and leader in the field of women and men in scientific and academic occupations and organizations, with work that has significant implications for science and technology policies. Her work has shaped understandings of complex issues including:

  1. ways that team composition, modes of collaboration, work practices, and work climate explain publication productivity--including exceptional performance--among scientists;
  2. social and organizational features of departments, research groups, and advisor-advisee relationships that influence the proportions of doctoral degrees awarded to women in science and engineering;
  3. distinguishing bibliometric features of the research specialty of women, science, and engineering, including the use of "sex" and "gender" in publications over time;
  4. relationships between family characteristics and publication productivity among women and men in academic science that go beyond being married or not married and the presence/absence of children and that address the effects of type of marriage and type of family composition ;
  5. patterns and predictors of work-family conflict in academic science that both vary, and converge, by gender in unexpected ways, with implications for building institutions that support strong scientific work forces;
  6. types of programs--organized initiatives intended to open pathways--for undergraduate women in science that do support attainment of women as majors in science and engineering.

The Vilcek Institute of Graduate Biomedical Sciences at the NYU School of Medicine is a division of the Graduate School of Arts and Science of New York University, leading to the Ph.D. degree and, in coordination with The Medical Scientist Training Program, combined M.D./Ph.D. degrees. The Institute sets the policies for its admissions, curriculum, stipend levels, student evaluations and Ph.D. requirements.

QS World University Rankings is an annual publication of university rankings by Quacquarelli Symonds (QS). The QS system comprises three parts: the global overall ranking, the subject rankings, and five independent regional tables—namely Asia, Latin America, Emerging Europe and Central Asia, the Arab Region, and BRICS.

The School ofJournalism & Mass Communication is the journalism school of the University of Wisconsin–Madison. Located in Vilas Communication Hall, the School offers two undergraduate programs, two Master of Arts programs in Journalism, and a doctoral program jointly administered with the Department of Life Sciences Communication.

The University of Wisconsin–Milwaukee is a doctoral-degree granting public research university that consists of 14 colleges and schools, and 70 academic centers, institutes and laboratory facilities. It offers a total of 180 degree programs, including 94 bachelor's, 53 master's and 32 doctorate degrees. The School of Freshwater Sciences is the only graduate school of freshwater science in the U.S. and the third in the world. The School of Architecture and Urban Planning, the College of Nursing and the College of Health Sciences are the largest in Wisconsin.

Altmetrics

In scholarly and scientific publishing, altmetrics are non-traditional bibliometrics proposed as an alternative or complement to more traditional citation impact metrics, such as impact factor and h-index. The term altmetrics was proposed in 2010, as a generalization of article level metrics, and has its roots in the #altmetrics hashtag. Although altmetrics are often thought of as metrics about articles, they can be applied to people, journals, books, data sets, presentations, videos, source code repositories, web pages, etc.

Rankings of universities in Canada are typically published annually by a variety of nationally, and internationally based publications. Rankings of post-secondary institutions have most often been conducted by magazines, newspapers, websites, governments, or academia. Ranking are established to help inform potential applicants about universities in Canada based on a range of criteria, including student body characteristics, classes, faculty, finances, library, and reputation. Various rankings consider combinations of factors, including funding and endowment, research excellence and/or influence, specialization expertise, admissions, student options, award numbers, internationalization, graduate employment, industrial linkage, historical reputation and other criteria. Various rankings also evaluate universities based on research output.

The University Ranking by Academic Performance (URAP) is a university ranking developed by the Informatics Institute of Middle East Technical University. Since 2010, it has been publishing annual national and global college and university rankings for top 2000 institutions. The scientometrics measurement of URAP is based on data obtained from the Institute for Scientific Information via Web of Science and inCites. For global rankings, URAP employs indicators of research performance including the number of articles, citation, total documents, article impact total, citation impact total, and international collaboration. In addition to global rankings, URAP publishes regional rankings for universities in Turkey using additional indicators such as the number of students and faculty members obtained from Center of Measuring, Selection and Placement ÖSYM.

There are a number of approaches to ranking academic publishing groups and publishers. Rankings rely on subjective impressions by the scholarly community, on analyses of prize winners of scientific associations, discipline, a publisher's reputation, and its impact factor.

References

  1. ↑ Academic Analytics Client List Archived 2008-05-13 at the Wayback Machine
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.