By analyzing a global sample of 4 million authors and 26 million scientific papers, this study finds that the top 1% most-cited scientists have increased their cumulative citation shares from 14 to 21% between 2000 and 2015 and that the Gini coefficient for citation imbalance has risen from 0.65 to 0.70. Establishing Your Author Name and Presence. Average citation count (ACC) by OA state. | Download Table For the 2019 Highly Cited Researchers analysis, the papers included in the preliminary data development were those published and cited during 20082018. Gender pay gap remained stable over past 20 years in US | Pew Research 2018); about 13% as a median, using co-author self-citation (Ioannidis et al. 5a, b compares the calculated low outlier threshold (i.e. 2), Log plots by Essential Science Indicators field of the pattern of self-referencing to earlier papers by Highly Cited Researchers identified by analysing Web of Science data for 20082018 and to (self-citing from later publications) highly cited papers on which a researcher is also an author or co-author. Is citation analysis meaningful for non-academia audiences such as the public, policy-makers, clinical trial participants, healthcare providers, or grant funding agencies? Space Science has an exceptional level of self-referencing, which is presumably also a consequence of the nature of research in that area. Communism, universalism and disinterestedness: Re-examining contemporary support among academics for Mertons scientific norms. Citation: Brandt MD, Ghozy SA, Kallmes DF, McDonald RJ, Kadirvel RD (2022) Comparison of citation rates between Covid-19 and non-Covid-19 articles across 24 major scientific journals. https://doi.org/10.1007/s11192-011-0523-6. Google Scholar. The upper quartile values rise from 3% (ECB) to 11% (ENG). PLOS ONE promises fair, rigorous peer review, ), countries represented by the authors of the citing works, subject focus or discipline of the citing works. Google Scholar. Scientometrics,82(3), 517537. One way that these effects may be observed is through the influence that Covid-19 papers will have on JIF. Merton later included humility in one description of the norms of scientific research (Merton 1957). We had reason to question this approach when we noted that China was leading in citation rates Baselines and subject schemas create This means that other publications such as letters, editorials, perspectives, and opinions were not included in our search criteria which leaves a large number of publications out of the study. Correspondence to (2015). Relevant data are summarised for reference in Appendix Tables2 and 3. The negative binomial regression model is similar to the Poisson regression model (for count data) except that it performs better with data over-dispersion [13, 14]. https://doi.org/10.1002/asi.5090140304. Consequently, it would not be universally true that a particular percentile across a field-specific range is necessarily caused by undue self-citation: it may simply be a relatively high value within normal range in that field. [12] To reach the top-100 papers required 12,119 citations by 2014. We will show below that the range of self-citation rates among Highly Cited Researchers follows a negative binomial distribution (NBD). Engqvist, L., & Frommen, J. G. (2008). (You should maintain double-spacing throughout your essay.) The 2020 Journal Impact Factors, published in the 2021 Journal Citation Report, are based on citations in 2020 to articles published in 2018 and 2019. 2019; Seeber et al. Results The search identified 296 articles of reporting guidelines . Journal of Information Science The citation advantage for open access arXiv preprint arXiv:1208.4566. by the total number of papers. Cham: Springer. Cooke, S. J., & Donaldson, M. R. (2014). Trimble, V. (1986). Our work arose out of a practical exercise, undertaken at Clarivate Analytics since 2014, to identify a group of elite, highly cited scientists and social scientists (Highly Cited Researchers, https://recognition.webofsciencegroup.com/awards/highly-cited/2019/). Field weighted citation impact (FWCI) is calculated by dividing the total number of citations an article has received the year it was published and 3 complete calendar years after its publication by the average number of citations articles of the same field, publication type, and publication year are expected to receive within the same time period. https://doi.org/10.1556/scient.67.2006.3.11. Each graph includes Q1, Median, Q3 and the lower and upper thresholds (set at 1.5 and 3 times the inter-quartile range, IQR) for indicative outliers (see Fig. 2019). relatively few highly cited papers. Self-citations in scientific literature. Web of Science provides evidence of collaboration with other scientists and institutions, publication productivity, cited-by works, the h-index and also includes tools for creating citation maps. To examine this more closely, we randomly selected three journals included for this paper and manually searched each journals website for Covid-19-related articles that the journal itself had categorized as an original piece of research over three months. Informed judgment is, as elsewhere in good research management, an essential step in valid decision-making. Zhao and Strotmann (2018) argued, on the basis on in-text analysis, that self-citations may be more important than other types of citation. Finally, though WOS is a comprehensive and highly regarded database, it is not without shortcomings. Furthermore, many will be seen by more junior peers as exemplars of leadership in their field and the standards they set would therefore be deemed appropriate to the field. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. Averages are calculated by adding the citation counts of individual papers and dividing by the number of papers. A series of disconnected points, rather more extended than in other fields, lies above this crossing the low and then the high indicative outlier threshold. This is a consequence of the relatively large number of (often annually refreshed) review papers in these fields. Covid-19 has been front and center in the global landscape since the beginning of 2020. Calculating Field Weighted Citation Impact (FWCI). Schreiber, M. (2007). Use the Previous and Next buttons to navigate the slides or the slide controller buttons at the end to navigate through each slide. The norms of citation behavior: Prolegomena to the footnote. The WOS search criteria were customized to include documents categorized as Article published between January 1, 2020 and December 31, 2021. On the shoulders of Robert Merton: Towards a normative theory of citation. Self-citation can inflate h-index. See the Establishing Your Author Name tab. Metrics of Social Impact Based on Twitter and Correlation with Traditional Metrics of Scientific Impact", "Measuring Up: Impact Factors Do Not Reflect Article Citation Rates", "Ditching Impact Factors for Deeper Data", "The effect of open access and downloads ('hits') on citation impact: a bibliography of studies", "Comparing the Impact of Open Access (OA) vs. Non-OA Articles in the Same Journals", "Citation Advantage of Open Access Articles", "Ten-Year Cross-Disciplinary Comparison of the Growth of Open Access and How It Increases Research Citation Impact", "Self-Selected or Mandated, Open Access Increases Citation Impact for Higher Quality Research", "Open access publishing, article downloads, and citations: randomised controlled trial", "The impact factor of an open access journal does not contribute to an article's citations", "Universality of citation distributions: Toward an objective measure of scientific impact", "Scholarometer: A Social Framework for Analyzing Impact across Disciplines", "What a difference a colon makes: how superficial factors influence subsequent citation", 20.500.11755/2fd7fc12-1766-4ddd-8f19-1d2603d2e11d, "Evaluation by Citation: Trends in Publication Behavior, Evaluation Criteria, and the Strive for High Impact Publications", "Psychology and Wikipedia: Measuring Psychology Journals' Impact by Wikipedia Citations", "Psychology and Wikipedia: Measuring journals' impact by Wikipedia citations", "Research Quality, Publications and Impact in Civil Engineering into the 21st Century. The field or subject area: t: Year: d: Document Type: n: The number of subjects to which a paper is assigned: i: . [6] examined OA article citation performance in the field of civil engineering, in terms of jour- . Does self-citation pay? These novel findings demonstrate that Covid-19 papers are being cited at remarkably higher rates than non-Covid-19 articles contained within the same journals. https://doi.org/10.1007/s11192-006-0006-3. Ioannidis, J. P. A. (2016). In every field, except Mathematics, the median and lower indicative threshold self-citing rates (to the highly cited papers) are lower but more variable than that of the self-referencing (from the highly cited papers) (Fig. The dataset used for this analysis was the Web of Science list of Highly Cited Researchers for 2019. 3 (self-referencing) and Fig. (2018). doi:10.1371/journal.pone.0271071, Editor: Ayman Elbehiry, Qassim University, College of Public Health and Informatics, SAUDI ARABIA, Received: February 26, 2022; Accepted: June 22, 2022; Published: July 27, 2022. The 10-year averages are calculated from citations from articles published during the same 10-year period. CINAHL offers a Cited References feature that provides a list of citations that cite a particular publication in the CINAHL database. Scientometrics,15(56), 437447. Do citations provide a full narrative of meaningful health outcomes? Rousseau, R. (1999). https://doi.org/10.1515/text-2018-0004. As noted in the Introduction, typical rate of self-referencing around 10% was discussed by Garfield (1979) and has since been found by others. A fractional approach to self-citation counting. Copyright: 2022 Brandt et al. PLOS ONE, impact factor 3.1) publish many papers that are cited 0 to 5 times but few highly cited articles. table displays aggregate data for each of the 22 ESI research fields. Central range is used here as a descriptive, non-technical term to indicate the more consistent plateau of similar self-citation rates within each field that encompasses somewhat more than the inter-quartile range for these data. Aksnes, D. W. (2003). van Raan, A. F. J. Jonathan Adams. LibGuides: Essential Science Indicators: Learn the Basics Yu, G., & Wang, L. (2007). The battle to define the meaning of a citation. New factors in the evaluation of scientific literature through citation indexing. (2015). Larivive, V., Gingras, Y., Sugimoto, C. R., & Tsou, A. Self-citation by researchers: Narcissism or an inevitable outcome of a cohesive and sustained research program? We anticipate that these findings could be of value to journals editors and researchers when considering efforts for future publications. The first example of automated citation indexing was CiteSeer, later to be followed by Google Scholar. Baselines are annualized expected citation rates for papers in a research field. Detecting impact factor manipulation with data mining techniques. Mathematics is a relatively small ESI field (97 Highly Cited Researchers) and it is possibly composed of a number of distinct sub-fields (see Bensman et al. Bartneck, C., & Kokkelmans, S. (2011). https://doi.org/10.1108/00220410810844150. Scientometrics. useful reference points for comparison and they are the basis of normalization to overcome subject bias. The trajectory changes at the higher end, curving upwards towards much greater self-citation rates. demonstration of the calculation all papers are in the same year, but in reality, baselines are also calculated for each year. Another limitation of this study is that open-access versus subscription-based journals were not filtered separately during the WOS search. Examples: For Articles in the field . The length of time surveyed certainly affects any reading since self-citations tend to be given earlier by an author than by peers: over time an authors self-citation rate tends to decline (Tagliacozzo 1977; Aksnes 2003; Glnzel et al. Pharmacology & Toxicology (PHT) is also an outlier with a median of 0%. To our knowledge, this study is the first to quantify the rate at which a large volume of peer-reviewed Covid-19 articles are being cited, on average, in major medical journals and compare these results to non-Covid-19 articles in the same journals. Scientometrics,21(2), 245254. The publication channels for many Highly Cited Researchers are the journals readily recognised as leading in their field, but this is not the case for some prolific self-citers. Evaluative bibliometrics: The use of publication and citation analysis in the evaluation of scientific activity. Biagioli, M., & Lippman, A. Citation frequency is highly skewed, with many infrequently cited papers and Note, in this paper, that we refer to self-references and to self-cites and that they are not the same thing. 2006; Minasny et al. different disciplines and time periods so it cannot be used effectively to compare entities that are in different subjects or years. (2004a). Bar plots show the total number of citations received in 20172020 to articles, reviews, conference papers, book chapters and data papers published in 20172020, with Frontiers journals in blue. To address this gap in the literature we use WOS to examine citation rates for Covid-19-related articles published between January 1, 2020 and December 31, 2021 across 24 major scientific journals. [31][32][33], Open access (OA) publications are accessible without cost to readers, hence they would be expected to be cited more frequently. The simplest journal-level metric is the journal impact factor (JIF), the average number of citations that articles published by a journal in the previous two years have received in the current year, as calculated by Clarivate. [11] By 2014 it had accumulated more than 305,000 citations. Author self-citations in the field of ecology. [55] For instance in Medicine among other factors the number of authors, the number of references, the article length, and the presence of a colon in the title influence the impact. The weight of author self-citations. 2006; Thijs and Glnzel 2006; Glnzel 2008) and others (Aksnes 2003; Hyland 2003; Fowler and Aksnes 2007; van Raan 2008; Costas et al. https://doi.org/10.1002/asi.23302. [56] Also it is found that scholars engage in ethically questionable behavior in order to inflate the number of citations articles receive.[57]. The influence of self-citation corrections and the fractionalised counting of multi-authored manuscripts on the Hirsch index. (608) 262-2020 This may also be the reason why papers with shorter titles get more citations, given that they are usually covering a broader area. Furthermore, publication and citation data are universally skewed and we will show that this is true of the range of self-citation rates across researchers. Yang, D. H., Li, X., Sun, X. X., & Wan, J. More recent studies include those of Glnzel and colleagues (Glnzel et al. 2019; Kacem et al. A high rate of self-referencing may reflect research in a specialty area or convey a pattern of a cohesive and sustained research program (Cooke and Donaldson 2014). It is said that one persons outlier may be, for an NBD, simply an extreme part of the skew. In 2022, women earned an average of 82% of what men earned, according to a new Pew Research Center analysis of median hourly earnings of both full- and part-time workers. Calculating the Relative Citation Ratio (RCR). The patterns for the key parameters for self-citations (Fig. The field-specific self-citation profiles, showing a data point for each Highly Cited Researcher and following the style of Fig.