The traditional system in assessing the quality of a scientific publication (a journal article, for example) has fundamentally been based on the calculation of the citations it generates. In an article published in Science (1995), Eugene Garfield (1925 – 2017) proposed a citation index as a system that would help authors find articles on a subject. It was a great innovation without doubt. Later, with the creation of the Institute for Scientific Information (today the Web of Science) and the Journal Citation Reports, this system became very prominent and centred its work on the assessment of journals because it helped authors decide in which journal to publish (based on the impact factor calculated for each one).It is a system that has been criticised from the humanities and social sciences and also because it does not focus on the article itself but instead gives the reference value to the journal in which it is published (and presupposes that an article should “inherit” the journal’s impact factor).
From 2010, people started talking about altmetrics, a set of indicators (for example, how often an article is shared, its re-dissemination, the comments it has generated, mentions (likes), etc…) that measure the presence of a publication in social and academic networks, which complement citation indexes considerably. Altmetrics, therefore, assess the repercussion of an article itself and not that of a journal as a whole (the way impact factors do, for example).
At present, several scientific editors have taken this information into consideration. One of the first examples was the journal PLOS, followed by Nature and others. Its use has also spread to data bases (e.g. Scopus) and to academic networks (e.g. ResearchGate). The altmetric data that accompany an article tend to have the sections that appear in figures 1 and 2, even though there can be small differences depending on the programme used (ImpactStory, PLUM, Article Level Metrics, altimetrics.com, etc…).
Figure 1.
Figure 1. Example of the altmetrics of an article in PLOS
And so we can see that it is not only the statistics of presence in social networks that are included (mentions, blogs, etc…) but also the use of data (visualisations and downloads) as well as the citations of an article (in Scopus, CrossRef, PubMed, GoogleScholar, etc…). We are talking about very complete quantitative information for the reader and also for the author of the article.
Figure 2. Example of the altmetrics of an article in Nature
In the case of Nature (figure 2) there is also a graphic representation in the form of a circle or “ring” in which each colour is a type of channel (twitter, blogs, facebook, wikipedia, etc…), where a contextualised percentage is given in relation to articles which are similar in age and it also indicates its precise presence in the general media (“news articles”) and scientific blogs.
Let us do a quick assessment of altmetrics. Their main strengths lie in the fact that they measure the impact of publications beyond academic circles, strictly speaking, that they can be applied to all types of documents (be it an article, a book or a doctoral thesis), that the results are immediate (there is no need to wait for the annual value of the impactor factor) and that they focus on the article (and not on the journal).
In terms of their weak points, it should be said that the indicators need to be collected very quickly (they are very volatile), that it is difficult to compare the indicators between each other (which is of more value, a retweet or a “like”?), that there is great difficulty in the normalisation and homogeneity when collecting data (which does not occur in the case of citations) and that different measuring tools produce different results (e.g. ImpactStory or Altmetrics).
Altmetrics, therefore, help to measure the impact of a specific publication in social networks. This is why we should define them as complementary metrics rather than alternative metrics. In contrast to the traditional impact factor – which is applied to a journal – altmetrics are centred on the article and this is a significant innovation. Despite them having some weak points they are in a consolidation phase and have long-term potential.
From a researcher’s perspective, it is clear that at present publishing an article in a journal is not enough and one needs to be fully involved in its dissemination in social networks (especially Twitter, blogs, etc…) and also in academic networks (Researchgate, Mendeley, etc…) so as to give visibility to the contents published. In this new scenario, altmetrics are fundamental because they are able to measure this impact in networks and offer authors (and readers) a general view of the dissemination of their publications.
Post by Ernest Abadal, Faculty of Library and Information Science, University of Barcelona.
