Altmetrics

Last updated
The original logotype from the Altmetrics Manifesto. Altmetrics.svg
The original logotype from the Altmetrics Manifesto.

In scholarly and scientific publishing, altmetrics are non-traditional bibliometrics [2] proposed as an alternative [3] or complement [4] to more traditional citation impact metrics, such as impact factor and h-index. [5] The term altmetrics was proposed in 2010, [1] as a generalization of article level metrics, [6] and has its roots in the #altmetrics hashtag. Although altmetrics are often thought of as metrics about articles, they can be applied to people, journals, books, data sets, presentations, videos, source code repositories, web pages, etc.

Contents

Altmetrics use public APIs across platforms to gather data with open scripts and algorithms. Altmetrics did not originally cover citation counts, [7] but calculate scholar impact based on diverse online research output, such as social media, online news media, online reference managers and so on. [8] [9] It demonstrates both the impact and the detailed composition of the impact. [1] Altmetrics could be applied to research filter, [1] promotion and tenure dossiers, grant applications [10] [11] and for ranking newly-published articles in academic search engines. [12]

Adoption

The development of web 2.0 has changed the research publication seeking and sharing within or outside the academy, but also provides new innovative constructs to measure the broad scientific impact of scholar work. Although the traditional metrics are useful, they might be insufficient to measure immediate and uncited impacts, especially outside the peer-review realm. [1]

Projects such as ImpactStory, [13] [14] and various companies, including Altmetric, [13] [15] Plum Analytics [13] [16] [17] [18] and Overton [19] are calculating altmetrics. Several publishers have started providing such information to readers, including BioMed Central, Public Library of Science (PLOS), [20] [21] Frontiers, [22] Nature Publishing Group, [23] and Elsevier. [24] [25] The NIHR Journals Library also includes altmetric data alongside its publications. [26]

In 2008, the Journal of Medical Internet Research started to systematically collect tweets about its articles. [27] Starting in March 2009, the Public Library of Science also introduced article-level metrics for all articles. [20] [21] [28] Funders have started showing interest in alternative metrics, [29] including the UK Medical Research Council. [30] Altmetrics have been used in applications for promotion review by researchers. [31] Furthermore, several universities, including the University of Pittsburgh are experimenting with altmetrics at an institute level. [31]

However, it is also observed that an article needs little attention to jump to the upper quartile of ranked papers, [32] suggesting that not enough sources of altmetrics are currently available to give a balanced picture of impact for the majority of papers.

Important in determining the relative impact of a paper, a service that calculates altmetrics statistics needs a considerably sized knowledge base. The following table shows the number of artefacts, including papers, covered by services (as of 2016):

WebsiteNumber of artefacts
Plum Analytics~ 52.6 Million [33]
Altmetric.com~ 35 Million [34]
ImpactStory~ 1 Million [35]
Overton~ 6 Million [36]

Categories

Altmetrics are a very broad group of metrics, capturing various parts of impact a paper or work can have. A classification of altmetrics was proposed by ImpactStory in September 2012, [37] and a very similar classification is used by the Public Library of Science: [38]

Viewed

One of the first alternative metrics to be used was the number of views of a paper. Traditionally, an author would wish to publish in a journal with a high subscription rate, so many people would have access to the research. With the introduction of web technologies it became possible to actually count how often a single paper was looked at. Typically, publishers count the number of HTML views and PDF views. As early as 2004, the BMJ published the number of views for its articles, which was found to be somewhat correlated to citations. [40]

Discussed

The discussion of a paper can be seen as a metric that captures the potential impact of a paper. Typical sources of data to calculate this metric include Facebook, Google+, Twitter, Science Blogs, and Wikipedia pages. Some researchers regard the mentions on social media as citations. For example, citations on a social media platform could be divided into two categories: internal and external. For instance, the former includes retweets, the latter refers to tweets containing links to outside documents. [41] The correlation between the mentions and likes and citation by primary scientific literature has been studied, and a slight correlation at best was found, e.g. for articles in PubMed. [4]

In 2008 the Journal of Medical Internet Research began publishing views and tweets. These "tweetations" proved to be a good indicator of highly cited articles, leading the author to propose a "Twimpact factor", which is the number of Tweets it receives in the first seven days of publication, as well as a Twindex, which is the rank percentile of an article's Twimpact factor. [27] However, if implementing use of the Twimpact factor, research shows scores to be highly subject specific, and as a result, comparisons of Twimpact factors should be made between papers of the same subject area. [27] While past research in the literature has demonstrated a correlation between tweetations and citations, it is not a causative relationship. At this point in time, it is unclear whether higher citations occur as a result of greater media attention via Twitter and other platforms, or is simply reflective of the quality of the article itself. [27]

Recent research conducted at the individual level, rather than the article level, supports the use of Twitter and social media platforms as a mechanism for increasing impact value. [42] Results indicate that researchers whose work is mentioned on Twitter have significantly higher h-indices than those of researchers whose work was not mentioned on Twitter. The study highlights the role of using discussion based platforms, such as Twitter, in order to increase the value of traditional impact metrics.

Besides Twitter and other streams, blogging has shown to be a powerful platform to discuss literature. Various platforms exist that keep track of which papers are being blogged about. Altmetric.com uses this information for calculating metrics, while other tools just report where discussion is happening, such as ResearchBlogging and Chemical blogspace.

Platforms may even provide a formal way of ranking papers or recommending papers otherwise, such as Faculty of 1000. [43]

Saved

It is also informative to quantify the number of times a page has been saved, or bookmarked. It is thought that individuals typically choose to bookmark pages that have a high relevance to their own work, and as a result, bookmarks may be an additional indicator of impact for a specific study. Providers of such information include science specific social bookmarking services such as CiteULike and Mendeley.

Cited

The cited category is a narrowed definition, different from the discussion. Besides the traditional metrics based on citations in scientific literature, such as those obtained from Google Scholar, CrossRef, PubMed Central, and Scopus, altmetrics also adopt citations in secondary knowledge sources. For example, ImpactStory counts the number of times a paper has been referenced by Wikipedia. [44] Plum Analytics also provides metrics for various academic publications, [45] seeking to track research productivity. PLOS is also a tool that may be used to utilize information on engagement. [45]

Numerous studies have shown that scientific articles disseminated through social media channels (i.e. Twitter, Reddit, Facebook, YouTube, etc) have substantially higher biblometric scores (downlodas, reads and citations) than articles not advertised through social media. In the fields of plastic surgery, [46] hand surgery [47] and more, higher Altmetric scores are associated with better short-term bibliometrics.

Interpretation

While there is less consensus on the validity and consistency of altmetrics, [48] the interpretation of altmetrics in particular is discussed. Proponents of altmetrics make clear that many of the metrics show attention or engagement, rather than the quality of impacts on the progress of science. [38] Even citation-based metrics do not indicate if a high score implies a positive impact on science; that is, papers are also cited in papers that disagree with the cited paper, an issue for example addressed by the Citation Typing Ontology project. [49]

Altmetrics could be more appropriately interpreted by providing detailed context and qualitative data. For example, in order to evaluate the scientific contribution of a scholar work to policy making by altmetrics, qualitative data, such as who's citing online [12] and to what extent the online citation is relevant to the policymaking, should be provided as evidence. [50]

Regarding the relatively low correlation between traditional metrics and altmetrics, altmetrics might measure complementary perspectives of the scholar impact. It is reasonable to combine and compare the two types of metrics in interpreting the societal and scientific impacts. Researchers built a 2*2 framework based on the interactions between altmetrics and traditional citations. [4] Further explanations should be provided for the two groups with high altmetrics/low citations and low altmetrics/high citations. [27] [4] Thus, altmetrics provide convenient approaches for researchers and institutions to monitor the impact of their work and avoid inappropriate interpretations.

Controversy

The usefulness of metrics for estimating scientific impact is controversial. [51] [52] [53] [54] Research has found that online buzz could amplify the effect of other forms of outreach on researchers' scientific impact. For the nano-scientists that are mentioned on Twitter, their interactions with reporters and non-scientists positively and significantly predicted higher h-index, whereas the non-mentioned group failed. [42] Altmetrics expands the measurement of scholar impact for containing a rapid uptake, a broader range of audiences and diverse research outputs. In addition, the community shows a clear need: funders demand measurables on the impact of their spending, such as public engagement.

However, there are limitations that affect the usefulness due to technique problems and systematic bias of construct, such as data quality, heterogeneity and particular dependencies. [52] In terms of technique problems, the data might be incomplete, because it is difficult to collect those online research outputs without direct links to their mentions (i.e. videos) and identify different versions of one research work. Additionally, whether the API leads to any missing data is unsolved. [4]

As for systematic bias, like other metrics, altmetrics are prone to self-citation, gaming, and other mechanisms to boost one's apparent impact such as performing citation spam in Wikipedia. Altmetrics can be gamed: for example, likes and mentions can be bought. [55] Altmetrics can be more difficult to standardize than citations. One example is the number of tweets linking to a paper where the number can vary widely depending on how the tweets are collected. [56] Besides, online popularity may not equal to scientific values. Some popular online citations might be far from the value of generating further research discoveries, while some theoretical-driven or minority-targeted research of great science-related importance might be marginalized online. [27] For example, the top tweeted articles in biomedicine in 2011 were relevant to curious or funny content, potential health applications, and catastrophe. [4] Altmetric state that they have systems in place to detect, identify and correct gaming. [57] Finally, recent research has shown Altmetrics reproduce gendered biases found in disciplinary publication and citation practices: for example, journal articles authored exclusively by female scholars score 27% lower on average than exclusively male-authored outputs. At once, this same research shows 0 attention scores are more likely for male-authored articles. [58]

Altmetrics for more recent articles may be higher because of the increasing uptake of the social web and because articles may be mentioned mainly when they are published. [59] As a result, it might not be fair to compare the altmetrics scores of articles unless they have been published at a similar time. Researchers has developed a sign test to avoid the usage uptake bias by comparing the metrics of an article with the two articles published immediately before and after it. [59]

It should be kept in mind that the metrics are only one of the outcomes of tracking how research is disseminated and used. Altmetrics should be carefully interpreted to overcome the bias. Even more informative than knowing how often a paper is cited, is which papers are citing it. That information allows researchers to see how their work is impacting the field (or not). Providers of metrics also typically provide access to the information from which the metrics were calculated. For example, Web of Science shows which are the citing papers, ImpactStory shows which Wikipedia pages are referencing the paper, and CitedIn shows which databases extracted data from the paper. [60]

Another concern of altmetrics, or any metrics, is how universities or institutions are using metrics to rank their employees make promotion or funding decisions, [61] and the aim should be limited to measure engagement. [62]

The overall online research output is very little and varied among different disciplines. [27] [4] The phenomenon might be consistent with the social media use among scientists. Surveys has shown that nearly half of their respondents held ambivalent attitudes of social media's influence on academic impact and never announced their research work on social media. [63] With the changing shift in open science and social media use, the consistent altmetrics across disciplines and institutions will more likely be adopted.

Ongoing research

The specific use cases and characteristics is an active research field in bibliometrics, providing much needed data to measure the impact of altmetrics itself. Public Library of Science has an Altmetrics Collection [64] and both the Information Standards Quarterly and the Aslib Journal of Information Management recently published special issues on altmetrics. [65] [66] A series of articles that extensively reviews altmetrics was published in late 2015. [67] [68] [69]

There is other research examining the validity of one altmetrics [4] [27] or make comparisons across different platforms. [59] Researchers examine the correlation between altmetrics and traditional citations as the validity test. They assume that the positive and significant correlation reveals the accuracy of altmetrics to measure scientific impact as citations. [59] The low correlation (less than 0.30 [4] ) leads to the conclusion that altmetrics serves a complementary role in scholar impact measurement such as the study by Lamba (2020) [70] who examined 2343 articles having both altmetric attention scores and citations published by 22 core health care policy faculty members at Harvard Medical School and a significant strong positive correlation (r>0.4) was observed between the aggregated ranked altmetric attention scores and ranked citation/increased citation values for all the faculty members in the study. However, it remains unsolved that what altmetrics are most valuable and what degree of correlation between two metrics generates a stronger impact on the measurement. Additionally, the validity test itself faces some technical problems as well. For example, replication of the data collection is impossible because of the instant changing algorithms of data providers. [71]

See also

Related Research Articles

<span class="mw-page-title-main">Citation</span> Reference to a source

A citation is a reference to a source. More precisely, a citation is an abbreviated alphanumeric expression embedded in the body of an intellectual work that denotes an entry in the bibliographic references section of the work for the purpose of acknowledging the relevance of the works of others to the topic of discussion at the spot where the citation appears.

<span class="mw-page-title-main">Scientific citation</span>

Scientific citation is providing detailed reference in a scientific publication, typically a paper or book, to previous published communications which have a bearing on the subject of the new publication. The purpose of citations in original work is to allow readers of the paper to refer to cited work to assist them in judging the new work, source background information vital for future development, and acknowledge the contributions of earlier workers. Citations in, say, a review paper bring together many sources, often recent, in one place.

The impact factor (IF) or journal impact factor (JIF) of an academic journal is a scientometric index calculated by Clarivate that reflects the yearly mean number of citations of articles published in the last two years in a given journal, as indexed by Clarivate's Web of Science.

<span class="mw-page-title-main">Bibliometrics</span> Statistical analysis of written publications

Bibliometrics is the use of statistical methods to analyse books, articles and other publications, especially in scientific contents. Bibliometric methods are frequently used in the field of library and information science. Bibliometrics is closely associated with scientometrics, the analysis of scientific metrics and indicators, to the point that both fields largely overlap.

Scientometrics is the field of study which concerns itself with measuring and analysing scholarly literature. Scientometrics is a sub-field of informetrics. Major research issues include the measurement of the impact of research papers and academic journals, the understanding of scientific citations, and the use of such measurements in policy and management contexts. In practice there is a significant overlap between scientometrics and other scientific fields such as information systems, information science, science of science policy, sociology of science, and metascience. Critics have argued that over-reliance on scientometrics has created a system of perverse incentives, producing a publish or perish environment that leads to low-quality research.

<span class="mw-page-title-main">Google Scholar</span> Academic search service by Google

Google Scholar is a freely accessible web search engine that indexes the full text or metadata of scholarly literature across an array of publishing formats and disciplines. Released in beta in November 2004, the Google Scholar index includes peer-reviewed online academic journals and books, conference papers, theses and dissertations, preprints, abstracts, technical reports, and other scholarly literature, including court opinions and patents.

Citation impact or citation rate is a measure of how many times an academic journal article or book or author is cited by other articles, books or authors. Citation counts are interpreted as measures of the impact or influence of academic work and have given rise to the field of bibliometrics or scientometrics, specializing in the study of patterns of academic impact through citation analysis. The importance of journals can be measured by the average citation rate, the ratio of number of citations to number articles published within a given time period and in a given index, such as the journal impact factor or the citescore. It is used by academic institutions in decisions about academic tenure, promotion and hiring, and hence also used by authors in deciding which journal to publish in. Citation-like measures are also used in other fields that do ranking, such as Google's PageRank algorithm, software metrics, college and university rankings, and business performance indicators.

The h-index is an author-level metric that measures both the productivity and citation impact of the publications, initially used for an individual scientist or scholar. The h-index correlates with success indicators such as winning the Nobel Prize, being accepted for research fellowships and holding positions at top universities. The index is based on the set of the scientist's most cited papers and the number of citations that they have received in other publications. The index has more recently been applied to the productivity and impact of a scholarly journal as well as a group of scientists, such as a department or university or country. The index was suggested in 2005 by Jorge E. Hirsch, a physicist at UC San Diego, as a tool for determining theoretical physicists' relative quality and is sometimes called the Hirsch index or Hirsch number.

<i>PLOS One</i> Peer-reviewed open-access scientific journal

PLOS One is a peer-reviewed open access mega journal published by the Public Library of Science (PLOS) since 2006. The journal covers primary research from any discipline within science and medicine. The Public Library of Science began in 2000 with an online petition initiative by Nobel Prize winner Harold Varmus, formerly director of the National Institutes of Health and at that time director of Memorial Sloan–Kettering Cancer Center; Patrick O. Brown, a biochemist at Stanford University; and Michael Eisen, a computational biologist at the University of California, Berkeley, and the Lawrence Berkeley National Laboratory.

Journal Citation Reports (JCR) is an annual publication by Clarivate. It has been integrated with the Web of Science and is accessed from the Web of Science Core Collection. It provides information about academic journals in the natural and social sciences, including impact factors. The JCR was originally published as a part of the Science Citation Index. Currently, the JCR, as a distinct service, is based on citations compiled from the Science Citation Index Expanded and the Social Sciences Citation Index. As of the 2023 edition, journals from the Arts and Humanities Citation Index and the Emerging Sources Citation Index will also be included.

Journal ranking is widely used in academic circles in the evaluation of an academic journal's impact and quality. Journal rankings are intended to reflect the place of a journal within its field, the relative difficulty of being published in that journal, and the prestige associated with it. They have been introduced as official research evaluation tools in several countries.

The Eigenfactor score, developed by Jevin West and Carl Bergstrom at the University of Washington, is a rating of the total importance of a scientific journal. Journals are rated according to the number of incoming citations, with citations from highly ranked journals weighted to make a larger contribution to the eigenfactor than those from poorly ranked journals. As a measure of importance, the Eigenfactor score scales with the total impact of a journal. All else equal, journals generating higher impact to the field have larger Eigenfactor scores.

ResearchGate is a European commercial social networking site for scientists and researchers to share papers, ask and answer questions, and find collaborators. According to a 2014 study by Nature and a 2016 article in Times Higher Education, it is the largest academic social network in terms of active users, although other services have more registered users, and a 2015–2016 survey suggests that almost as many academics have Google Scholar profiles.

Figshare is an online open access repository where researchers can preserve and share their research outputs, including figures, datasets, images, and videos. It is free to upload content and free to access, in adherence to the principle of open data. Figshare is one of a number of portfolio businesses supported by Digital Science, a subsidiary of Springer Nature.

Article-level metrics are citation metrics which measure the usage and impact of individual scholarly articles.

The Kardashian Index (K-Index), named after media personality Kim Kardashian, is a satirical measure of the discrepancy between a scientist's social media profile and publication record. Proposed by Neil Hall in 2014, the measure compares the number of followers a research scientist has on Twitter to the number of citations they have for their peer-reviewed work.

<span class="mw-page-title-main">Altmetric</span>

Altmetric, or altmetric.com, is a data science company that tracks where published research is mentioned online, and provides tools and services to institutions, publishers, researchers, funders and other organisations to monitor this activity, commonly referred to as altmetrics. Altmetric was recognized by European Commissioner Máire Geoghegan-Quinn in 2014 as a company challenging the traditional reputation systems.

Author-level metrics are citation metrics that measure the bibliometric impact of individual authors, researchers, academics, and scholars. Many metrics have been developed that take into account varying numbers of factors.

Metascience is the use of scientific methodology to study science itself. Metascience seeks to increase the quality of scientific research while reducing inefficiency. It is also known as "research on research" and "the science of science", as it uses research methods to study how research is done and find where improvements can be made. Metascience concerns itself with all fields of research and has been described as "a bird's eye view of science". In the words of John Ioannidis, "Science is the best thing that has happened to human beings ... but we can do it better."

The Leiden Manifesto for research metrics (LM) is a list of "ten principles to guide research evaluation", published as a comment in Volume 520, Issue 7548 of Nature, on 22 April 2015. It was formulated by public policy professor Diana Hicks, scientometrics professor Paul Wouters, and their colleagues at the 19th International Conference on Science and Technology Indicators, held between 3–5 September 2014 in Leiden, The Netherlands.

References

  1. 1 2 3 4 5 Priem, Jason; Taraborelli, Dario; Groth, Paul; Neylon, Cameron (September 28, 2011). "Altmetrics: A manifesto (v 1.01)". Altmetrics.
  2. "PLOS Collections". Public Library of Science (PLOS) . 3 November 2021. Altmetrics is the study and use of non-traditional scholarly impact measures that are based on activity in web-based environments
  3. "The "alt" does indeed stand for "alternative"" Jason Priem, leading author in the Altmetrics Manifesto -- see comment 592
  4. 1 2 3 4 5 6 7 8 9 Haustein, Stefanie; Peters, Isabella; Sugimoto, Cassidy R.; Thelwall, Mike; Larivière, Vincent (2014-04-01). "Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature". Journal of the Association for Information Science and Technology. 65 (4): 656–669. arXiv: 1308.1838 . doi:10.1002/asi.23101. ISSN   2330-1643. S2CID   11113356.
  5. Chavda, Janica; Patel, Anika (30 December 2015). "Measuring research impact: bibliometrics, social media, altmetrics, and the BJGP". British Journal of General Practice. 66 (642): e59–e61. doi:10.3399/bjgp16X683353. PMC   4684037 . PMID   26719483.
  6. Binfield, Peter (9 November 2009). "Article-Level Metrics at PLoS - what are they, and why should you care?" (Video). University of California, Berkeley .
  7. Bartling, Sönke; Friesike, Sascha (2014). Opening Science: The Evolving Guide on How the Internet Is Changing Research, Collaboration and Scholarly Publishing. Cham: Springer International Publishing. p.  181. doi:10.1007/978-3-319-00026-8. ISBN   978-3-31-900026-8. OCLC   906269135. Altmetrics and article-level metrics are sometimes used interchangeably, but there are important differences: article-level metrics also include citations and usage data; ...
  8. Mcfedries, Paul (August 2012). "Measuring the impact of altmetrics [Technically Speaking]". IEEE Spectrum. 49 (8): 28. doi:10.1109/MSPEC.2012.6247557. ISSN   0018-9235.
  9. Galligan, Finbar; Dyas-Correia, Sharon (March 2013). "Altmetrics: Rethinking the Way We Measure". Serials Review. 39 (1): 56–61. doi:10.1016/j.serrev.2013.01.003.
  10. Moher, David; Naudet, Florian; Cristea, Ioana A.; Miedema, Frank; Ioannidis, John P. A.; Goodman, Steven N. (2018-03-29). "Assessing scientists for hiring, promotion, and tenure". PLOS Biology. 16 (3): e2004089. doi: 10.1371/journal.pbio.2004089 . ISSN   1545-7885. PMC   5892914 . PMID   29596415.
  11. Rajiv, Nariani (2017-03-24). "Supplementing Traditional Ways of Measuring Scholarly Impact: The Altmetrics Way". hdl:10315/33652.{{cite journal}}: Cite journal requires |journal= (help)
  12. 1 2 Mehrazar, Maryam; Kling, Christoph Carl; Lemke, Steffen; Mazarakis, Athanasios; Peters, Isabella (2018-04-08). "Can We Count on Social Media Metrics? First Insights into the Active Scholarly Use of Social Media". Proceedings of the 10th ACM Conference on Web Science. p. 215. arXiv: 1804.02751 . doi: 10.1145/3201064.3201101 . ISBN   9781450355636.
  13. 1 2 3 Liu, Jean; Euan Adie (8 July 2013). "New perspectives on article-level metrics: developing ways to assess research uptake and impact online". Insights. 26 (2): 153. doi: 10.1629/2048-7754.79 .
  14. "Impactstory: About". ImpactStory .
  15. "Altmetric: About us". Altmetric . 2015-06-02.
  16. Lindsay, J. Michael (15 April 2016). "PlumX from Plum Analytics: Not Just Altmetrics". Journal of Electronic Resources in Medical Libraries. 13 (1): 8–17. doi:10.1080/15424065.2016.1142836. S2CID   61242082.
  17. "Plum Analytics: About Us". Plum Analytics.
  18. "Plum Analytics: About Altmetrics". Plum Analytics.
  19. "Overton" . Retrieved 2021-10-22.
  20. 1 2 Fenner, Martin (1 July 2005). "Article-Level Metrics Information". Lagotto. Archived from the original on 22 September 2009.
  21. 1 2 "A Comprehensive Assessment of Impact with Article-Level Metrics (ALMs)". Public Library of Science (PLOS) . Archived from the original on 2019-04-30. Retrieved 2016-08-22.
  22. "About Frontiers: Academic Journals and Research Community". Frontiers.
  23. Baynes, Grace (25 October 2012). "Article level metrics on nature.com". Nature .
  24. Reller, Tom (15 July 2013). "Elsevier Announces 2012 Journal Impact Factor Highlights". MarketWatch . Archived from the original on 2018-06-16. Retrieved 2013-08-10.
  25. Beatty, Susannah (29 July 2015). "New Scopus Article Metrics: A better way to benchmark articles | Elsevier Scopus Blog". Scopus .
  26. "NIHR Journals Library". NIHR Journals Library. 16 September 2022. Retrieved 16 September 2022.
  27. 1 2 3 4 5 6 7 8 Eysenbach, G (19 December 2011). "Can tweets predict citations? Metrics of social impact based on Twitter and correlation with traditional metrics of scientific impact". Journal of Medical Internet Research. 13 (4): e123. doi: 10.2196/jmir.2012 . PMC   3278109 . PMID   22173204.
  28. Fenner, Martin. "Public Library of Science (PLOS)". Lagotto.
  29. Piwowar, Heather (9 January 2013). "Altmetrics: Value all research products". Nature . 493 (159): 159. Bibcode:2013Natur.493..159P. doi: 10.1038/493159a . PMID   23302843. S2CID   205075867.
  30. Viney, Ian (13 February 2013). "Altmetrics: Research council responds". Nature . 494 (7436): 176. Bibcode:2013Natur.494..176V. doi: 10.1038/494176c . PMID   23407530. S2CID   47245661.
  31. 1 2 Kwok, Roberta (21 August 2013). "Research impact: Altmetrics make their mark". Nature . 500 (7463): 491–493. doi: 10.1038/nj7463-491a . PMID   23977678.
  32. Kelly, Joel (22 August 2013). "Altmetric rankings". Infiniflux.
  33. "Plum Analytics: Coverage" . Retrieved 16 September 2022.
  34. "How it works". Altmetric. 2015-07-09. Retrieved 2022-02-18.
  35. @Impactstory (14 May 2016). "As of today, we're now tracking #altmetrics on a cool one million publications! #andGrowingFast". Twitter.
  36. "University – Impact – Overton" . Retrieved 2022-09-16.
  37. "A new framework for altmetrics". ImpactStory Blog. 2012-09-14.
  38. 1 2 Lin, J.; Fenner, M. (2013). "Altmetrics in Evolution: Defining and Redefining the Ontology of Article-Level Metrics". Information Standards Quarterly. 25 (2): 20. doi:10.3789/isqv25no2.2013.04.
  39. F1000Prime
  40. Perneger, T. V (2004). "Relation between online "hit counts" and subsequent citations: Prospective study of research papers in the BMJ". BMJ. 329 (7465): 546–7. doi:10.1136/bmj.329.7465.546. PMC   516105 . PMID   15345629.
  41. Weller, Katrin; Peters, Isabella (2012). Tokar, Alexander; Beurskens, Michael; Keuneke, Susanne; Mahrt, Merja; Peters, Isabella; Puschmann, Cornelius; Treeck, Timo van; Weller, Katrin (eds.). Citations in Web 2.0. Düsseldorf Univ. Press. pp. 209–222. ISBN   9783943460162.
  42. 1 2 Liang, Xuan (2014). "Building Buzz". Journalism & Mass Communication Quarterly. 91 (4): 772–791. doi:10.1177/1077699014550092. S2CID   56369654.
  43. Lin, Jennifer; Fenner, Martin (2013-04-01). "The many faces of article-level metrics". Bulletin of the American Society for Information Science and Technology. 39 (4): 27–30. doi: 10.1002/bult.2013.1720390409 . ISSN   1550-8366.
  44. "FAQ: which metrics are measured?". ImpactStory.
  45. 1 2 Papakostidis, Costas; Giannoudis, Peter V. (2018). "Impact Factor and Altmetrics: What is the Future?". Medical Writing and Research Methodology for the Orthopaedic Surgeon. Springer, Cham. pp. 71–79. doi:10.1007/978-3-319-69350-7_9. ISBN   9783319693491.
  46. Grant, Michael C; Scott-Bridge, Kai R; Wade, Ryckie G (May 2021). "The role of social media in disseminating plastic surgery research: The relationship between citations, altmetrics and article characteristics". Journal of Plastic, Reconstructive & Aesthetic Surgery. 74 (5): 1101–1160. doi:10.1016/j.bjps.2020.10.103. PMID   33214112.
  47. Yoshimura, Ryo; Grant, Michael C.; Gardiner, Matthew D.; Wade, Ryckie G. (September 2021). "Disseminating Hand Surgery Research Using Social Media: The Relationship Between Altmetrics and Citations". The Journal of Hand Surgery. 46 (9): 740–747. doi:10.1016/j.jhsa.2021.03.028. PMID   34052039. S2CID   235257317.
  48. Jump, Paul (23 August 2012). "Research Intelligence - Alt-metrics: fairer, faster impact data?". Times Higher Education.
  49. Shotton, D. (2010). "CiTO, the Citation Typing Ontology". Journal of Biomedical Semantics. 1 (Suppl 1): S6–S1. doi: 10.1186/2041-1480-1-S1-S6 . PMC   2903725 . PMID   20626926.
  50. "How to Use Altmetrics to Showcase Engagement Efforts for Promotion and Tenure". Altmetric. 2016-10-18. Retrieved 2018-04-12.
  51. Williams, A. (2017). "Altmetrics: An Overview and Evaluation".{{cite journal}}: Cite journal requires |journal= (help)
  52. 1 2 Mike Buschman; Andrea Michalek (April–May 2013). "Are Alternative Metrics Still Alternative?". asis&t Bulletin. Archived from the original on 2018-03-11. Retrieved 2013-08-21.
  53. Cheung, M. K. (2013). "Altmetrics: Too soon for use in assessment". Nature. 494 (7436): 176. Bibcode:2013Natur.494..176C. doi: 10.1038/494176d . PMID   23407528.
  54. Hirschmann, Barbara (2013-10-17). "Altmetrics – new forms of impact measurement on the rise?". Innovation@ETH-Bibliothek, DOI 10.16911/ethz-ib-1141-en. Retrieved 2020-04-23.
  55. J. Beall, Article-Level Metrics: An Ill-Conceived and Meretricious Idea, 2013, "Article-Level Metrics: An Ill-Conceived and Meretricious Idea | Scholarly Open Access". Archived from the original on 2013-08-06. Retrieved 2013-08-10.
  56. Chamberlain, S. (2013). "Consuming Article-Level Metrics: Observations and Lessons". Information Standards Quarterly. 25 (2): 4–13. doi:10.3789/isqv25no2.2013.02.
  57. "What are Altmetrics?". Altmetric. 16 September 2022. Retrieved 16 September 2022.
  58. Meibauer, Gustav; Phull, Kiran; Alejandro, Audrey; Ciflikli, Gokhan (2023-05-19). "Alternative metrics, traditional problems? Assessing gender dynamics in the altmetrics of political science". European Political Science: 1–20. doi:10.1057/s41304-023-00431-y. ISSN   1682-0983. PMC   10198594 .
  59. 1 2 3 4 Thelwall, M.; Haustein, S.; Larivière, V.; Sugimoto, C. R. (2013). "Do Altmetrics Work? Twitter and Ten Other Social Web Services". PLOS ONE. 8 (5): e64841. Bibcode:2013PLoSO...864841T. doi: 10.1371/journal.pone.0064841 . PMC   3665624 . PMID   23724101.
  60. Waagmeester, A.; Evelo, C. (2011). "Measuring impact in online resources with the CInumber (the CitedIn Number for online impact)". Nature Precedings. doi: 10.1038/npre.2011.6037.1 .
  61. David Colquhoun, How should universities be run to get the best out of people?, 2007
  62. Matthews, David (7 October 2015). "Altmetrics risk becoming part of problem, not solution, warns academic". Times Higher Education.
  63. "Reports". Science, Media and the Public. 2014-09-11. Retrieved 2018-04-12.
  64. Priem, Jason; Groth, Paul; Taraborelli, Dario (2012). Ouzounis, Christos A. (ed.). "The Altmetrics Collection". PLOS ONE. 7 (11): e48753. Bibcode:2012PLoSO...748753P. doi: 10.1371/journal.pone.0048753 . PMC   3486795 . PMID   23133655.
  65. "Topic: Altmetrics". Information Standards Quarterly. 25 (2). Summer 2013. doi:10.3789/isqv25no2.2013.
  66. Haustein, Stefanie; Peters, Isabella; Sugimoto, Cassidy R.; Thelwall, Mike; Larivière, Vincent (2015). Haustein, Stefanie; Sugimoto, Cassidy R.; Larivière, Vincent (eds.). "Social Media Metrics in Scholarly Communication: exploring tweets, blogs, likes and other altmetrics". ASLIB Journal of Information Management. 67 (3). arXiv: 1504.01877 . doi:10.1108/ajim-03-2015-0047. ISSN   2050-3806. S2CID   1796945.
  67. Thelwall, Mike A.; Kousha, Kayvan (2015). "Web indicators for research evaluation, part 1: Citations and links to academic articles from the web". El Profesional de la Información. 24 (5): 587–606. doi: 10.3145/epi.2015.sep.08 .
  68. Thelwall, Mike A.; Kousha, Kayvan (2015). "Web indicators for research evaluation, part 2: Social media metrics". El Profesional de la Información. 24 (5): 607–620. doi: 10.3145/epi.2015.sep.09 .
  69. Kousha, Kayvan; Thelwall, Mike A. (2015). "Web indicators for research evaluation, part 3: Books and non-standard outputs". El Profesional de la Información. 24 (6): 724–736. doi: 10.3145/epi.2015.nov.04 .
  70. Lamba, Manika (2020). "Research productivity of health care policy faculty: a cohort study of Harvard Medical School". Scientometrics. 124: 107–130. doi:10.1007/s11192-020-03433-5. S2CID   215565713.
  71. Liu, Jean; Adie, Euan (2013-04-01). "Five challenges in altmetrics: A toolmaker's perspective". Bulletin of the American Society for Information Science and Technology. 39 (4): 31–34. doi: 10.1002/bult.2013.1720390410 . ISSN   1550-8366.