In this paper we report our investigations as to whether there is a typical or normal range of self-citation for each of 21 discipline-based fields employed in Essential Science Indicators (ESI: these are listed in the Appendix Table1) and we describe a graphical test for significant outliers. baseline measure is the all-years citation rate, which is the citation rate for Elsevier Scopus provides traditional citation counts, the Field Weighted Citation Impact (FWCI) and benchmarking. Probing the effect of author self-citations on h index: A case study of environmental engineering. https://doi.org/10.1002/asi.20868. Carley, S., Porter, A. L., & Youtie, J. Bornmann, L., & Daniel, H.-D. (2008). (2020). We then quantify the number of citations these papers have received and compare rates to non-Covid-19 papers in the same journals over the same timeframe. Geosciences papers is 9.54, and for Immunology papers it is 20.38. Soares, J. Journal of the American Society for Information Science and Technology,61(7), 15141515. Scientometrics,120(2), 775791. https://doi.org/10.1556/Scient.67.2006.2.8. It takes into account the year of publication, document type and disciplines associated with its source. [22] Counting the number of citations per paper is also employed to identify the authors of citation classics. On the heterogeneity and classification of author self-citations. This data can help you understand where your score ranks. Using information provided in Clarivate's 2020 Journal Citation Reports [] published on June 30, 2021, the top three journals by impact factor were selected from eight scientific categories as defined by WOS.Disciplines were selected based on the likelihood of having high relevancy to Covid-19 and, therefore, a sufficient volume of Covid-19-related papers in that field . Lin, W. Y. C., & Huang, M. H. (2012). A note on self-citation rates in astronomical papers. Ioannidis et al. In W. Glnzel, H. F. Moed, U. Schmoch, & M. Thelwall (Eds. Median and range were used to represent continuous variables (not normally distributed) while we used frequencies and percentages to represent categorical variables. Finally, though WOS is a comprehensive and highly regarded database, it is not without shortcomings. Finally, attention must be paid to the presence of co-authors on publications that have self-citation rates significantly above expectations. in 2008 received 20.42 citations. Because of extreme skews, thresholds can only be indicative under any circumstances. Thus, we can consider the core referencing behaviour of the overall group of Highly Cited Researchers, as research leaders, to be in accordance with precedents previously established. The maximum number of citations was 664 and 120 papers were cited more than 100 times, of which 30 papers were cited more than 200 times. 2: r=0.55, N=240 researchers, P<0.001) and for the ESI field of Engineering (r=0.59, N=225 researchers, P<0.001). The work we report here has focussed on a particular tranche of researchers: individuals with a significant portfolio of papers that all lie within the 1% most highly cited for their field. Chorus, C. & Waltman, L. (2016). https://doi.org/10.1007/s10805-008-9055-y. Engineering (225 Highly Cited Researchers) has a continuous range that climbs to near 20% but then has a steeper part of the curve. Self-citation rates for 240 Highly Cited Researchers in the Essential Science Indicators field of Chemistry (CHE), analysing Web of Science data for 20082018. & Thombs, B. D. (2019). Cham: Springer. Brooks, T. A. [55] For instance in Medicine among other factors the number of authors, the number of references, the article length, and the presence of a colon in the title influence the impact. Part of Springer Nature. Journal of the Association for Information Science and Technology,68(4), 10361047. Such reasons imply behaviors that conform both to Mertonian norms and also to the social constructivist interpretation of citation theory (Merton 1942; Kaplan 1965; Moravcsik and Murugesan 1975; Gilbert 1977; Cozzens 1989; Bonzi and Snyder 1991; White 2001; Bornmann and Daniel 2008; Davis 2009; Erikson and Erlandson 2014; Tahamtan and Bornmann 2018, 2019; Aksnes et al. If there are indeed a significant number of individuals who abuse the conventional research system by inappropriate practice then why does the system not detect and sanction this at review before publication? Citation frequency is highly skewed, with many infrequently cited papers and Frontiers ranked 3rd most-cited with an average of 4.8 citations per article. between 2008 and the present. The negative binomial regression model was selected over a linear regression model because it resulted in a better fit to the data and was more appropriate for count data. bioRxiv preprint, December 23, 2019. https://doi.org/10.1101/2019.12.20.884031. Linear plots by Essential Science Indicators field of the pattern of self-referencing to earlier papers by Highly Cited Researchers identified by analysing Web of Science data for 20082018 and to (self-citing from later publications) highly cited papers on which a researcher is also an author or co-author. Slider with three articles shown per slide. Small, H. (2004). JIF is a commonly used surrogate to determine journal excellence and is calculated by dividing number of citations in the current year for articles published in the previous two years by total number of articles published in that journal during the previous two years [21]. 2006; Minasny et al. 2019). The fourth age of research. A series of disconnected points, rather more extended than in other fields, lies above this crossing the low and then the high indicative outlier threshold. Institutional self-citation rates: A three-year study of universities in the United States. (2013). Impact than biochemistry & molecular biology. Young, J. S., & Brandes, P. M. (2020). Costas, R., van Leeuwen, T. N., & Bordons, M. (2010). The prevalence of synchronous self-citation practices at the institutional level. Provided by the Springer Nature SharedIt content-sharing initiative, Over 10 million scientific documents at your fingertips, Not logged in Only Covid-19 articles within the Medicine, General, and Internal category were significantly affected by the field itself with a 28% boost in citation rate relative to non-Covid-19 articles (p = 0.029, 95%CI [0.132.43]). Tahamtan, I., & Bornmann, L. (2019). https://doi.org/10.1353/jhe.0.0095. . Porter, A. L. (1977). A paper with an exceptionally high ratio of self- to total-cites is clearly not reflecting the same degree of influence as one with a similar citation count where most of the cites are from other researchers. However, very high JIF or CS are often based on a small number of very highly cited papers. The citationimpact (average citations per paper) baseline for each variant of subject, year and document type will be calculated as the meanaverage: Where: e = the expected citation rate or baseline, c = Times Cited, p = the number of papers, f = the field or subject area, t = year, andd = document type. In an isolated instance, citation counts will be highly inflated, leading to overestimates of the influence the scientist has in his field. While Garfield doubted self-citation would be a problem in research evaluation, Narin imagined the possibility. The negative binomial regression model is similar to the Poisson regression model (for count data) except that it performs better with data over-dispersion [13, 14]. The difference between research influence and self-citation excess. (608) 262-2020 Galvez, R. H. (2017). Since the purpose of analysing highly cited research is to recognize scientists and social scientists with community-wide influence, which such portfolios lack, we introduced a filter to detect and review those whose high citation profile was in fact narrow and substantially self-generated. ESI surveys more than 11,000 journals from around the world to rank authors, institutions, countries, and journals in 22 broad fields based on publication and citation performance. 2018; Zhao and Strotmann 2018; Kacem et al. A percentile defines a fraction or subset of papers in a research field that received a minimum number of citations. Sugimoto, C. R., & Larivire, V. (2018). As examples: for the ESI field of Chemistry (Fig. They are not statistical tests but point to rather than definitively identifying possible cases of excessive self-citation. For simplicity of the (2016). Includes research papers, features, brief communications, case reports, technical notes, chronology, and full papers that were published in a journal and/or presented at a symposium or conference [5]. Citation benchmarking shows how citations received by this article compare with the average for similar articles. The self-citation pattern is different to other sciences and rates appear generally to be higher. Non-citation rates vary enormously by field. The journal citation reports (SCI edition) with and without journal self-citations. With three journals each from eight fields, a total of 24 journals were selected (Table 1). 2018; van Raan 2019). Glnzel, W., & Thijs, B. 2018; Baccini et al. https://doi.org/10.1016/j.joi.2018.07.009. will be below the citation rate for all years. The ethos of science and its correlates: An empirical analysis of scientists endorsement of Mertonian norms. Tang, L., Shapira, P., & Youtie, J. We thank our ISI colleagues, particularly Ross Potter, Gordon Rogers and Josh Schnell, for their advice and suggestions during the development of this work. For non-Covid-19 articles, the median citation rate is 21.63 (p = < 0.001). For everything except humanities, those numbers are far from 90% but they are still high: One third of social science articles go uncited! (2019) were right to draw attention to the statistical properties of these distributions: they have regular and testable properties. Note that we are excluding citations from 2017, as RCRs exclude the first calendar year in which the article was published. Quantity of citations for Covid-19 and non-Covid-19 articles with median and range values across all fields. For the scope of this paper, we used papers categorized as Article or Review in our WOS search to ensure that we were focusing on original works and evidence-based literature. MATH had more time to accrue citations, and therefore exhibit a higher average citation count. Frontiers journals improved their Journal Impact Factor ranking in 30 out of 39 categories in the 2021 Journal Citation Report. [13], Journal-level metrics are often misinterpreted as a measure for journal quality or article quality. By the end of January, more than 50 research papers had been published about the outbreak [2]. 2016; Heneberg 2016; Fong and Wilhite 2017; Zaggl 2017; Scarpa et al. Minasny, B., Hartemink, A. E., & McBratney, A. In-text function of author self-citations: Implications for research evaluation practice. reported that on average, delayed OAJs had citation rates twice as high as TAJs, and 3 times as high as immediate OAJs [9]. Field weighted citation impact (FWCI) is calculated by dividing the total number of citations an article has received the year it was published and 3 complete calendar years after its publication by the average number of citations articles of the same field, publication type, and publication year are expected to receive within the same time period. Price, D. J. D. (1976). To address this gap in the literature we use WOS to examine citation rates for Covid-19-related articles published between January 1, 2020 and December 31, 2021 across 24 major scientific journals. The model was also used to assess any differences in citation rates attributed to the field category. It is evident that the modal self-reference share is around 57% and the modal self-citation count is less than 5%, but this will be shown to vary by field. This certainly cautions against any simple test of inappropriate behaviour and confirms the need for informed scrutiny and interpretation. Yu, T., Yu, G., & Wang, M. Y. The Citation Rates table under the Field Baselines menu displays data on the average citation rates of papers within the scientific fields over each of the past 10 years. Schubert, A., Glnzel, W., & Thijs, B. Citation analysis: Queries and caveats. [12] To reach the top-100 papers required 12,119 citations by 2014. Chubin, D. E., & Moitra, S. D. (1975). As Covid-19 remains in the spotlight, the existing Covid-19 body of literature continues to be heavily leaned upon by scientists hoping to expand the existing knowledge further. This is very important when considering tests for outliers. Scientometrics,111(3), 18011812. A threshold for indicative outliers was then introduced to the graphical analysis. Fields that lie outside the main distribution (Pharmacology, Mathematics and Space Science) have been labelled. The key to interpretation is the need to determine the relationship between summary citation impact and fundamental research influence. A difference revealed in the analysis by field was the variable extent to which outliers were present and detectable. 2014; Chorus and Waltman 2016; Heneberg 2016; Yang et al. The time period for citation counts is 10 years, plus partial year counts for 1 with the parameters of a lognormal fit to a negative binomial distribution. Published 2016 Sep 6. doi:10.1371/journal.pbio.1002541. https://doi.org/10.1007/BF02016632. On the skewness of journal self-citations and publisher self-citations: Cues for discussion from a case study. Year on year, we have witnessed a small but increasing number of instances of the scenario described by Garfield long ago: prodigious publication in low-impact journals accompanied by high levels of author self-citation (Garfield 1979). Google Scholar. https://arxiv.org/abs/1903.06142. The linear analysis provides an accessible dataset for initial interpretation of citation rates. Publishing elite turns against controversial metric", "Prestigious Science Journals Struggle to Reach Even Average Reliability", "Requiem for impact factors and high publication charges", "ASM Journals Eliminate Impact Factor Information from Journal Websites", "Universality of Citation Distributions for Academic Institutions and Journals", "A citation-based, author- and age-normalized, logarithmic index for evaluation of individual researchers independently of publication counts", "An index to quantify an individual's scientific research output", "Handling self-citations using Google Scholar", "Citation classics published in knowledge management journals. A higher rate of self-citation is expected for co-author than for strict author self-citation, and, in general, a rising rate of co-author self-citation is observed with the growth in average number of authors per paper over time (van Raan 1998; Aksnes 2003; Glnzel and Thijs 2004b). The preliminary clusters were then cleaned by visual inspection and further aggregated where appropriate. Do citations provide a full narrative of meaningful health outcomes? (As noted above: central range is a descriptive, non-technical term used to indicate the consistent plateau of similar Highly Cited Researcher self-citation rates within each field that appears to reflect typical cultural self-citation behaviour.). Self-citation is the hallmark of productive authors, of any gender. Merton, R. K. (1995). https://doi.org/10.1007/s11192-010-0187-7. As an example, the Citation Rates Table displays data on the average citation rates of papers within the scientific fields over each of the past 10 years. [30], In response to growing concerns over the inappropriate use of journal impact factors in evaluating scientific outputs and scientists themselves, Universit de Montral, Imperial College London, PLOS, eLife, EMBO Journal, The Royal Society, Nature and Science proposed citation distributions metrics as alternative to impact factors. Kim, S. Y., & Kim, Y. *Neurosciences: The ranking is calculated from total citations for all journals in the Frontiers Neuroscience journal series, in the Neuroscience subject area (JCR 2021 update). Self-citations are somewhat lower than many fields but self-referencing is extremely low and often zero. To explore the variation in self-citation by field, a standard visualisation was created to evaluate the profile of the bulk of the population and the location within that profile of the median and upper and lower quartiles. Self-citations and scientific evaluation: Leadership, influence, and performance. 2015). Kacem, A., Flatt, J. W., & Mayr, P. (2019). The field-specific self-citation profiles, showing a data point for each Highly Cited Researcher and following the style of Fig. (2016). https://doi.org/10.1002/asi.5090140304. https://doi.org/10.1007/BF02017571. Egghe, L. (1987). Snyder, H., & Bonzi, S. (1998). Rousseau, R. (1999). 2010; Leblond 2012; Lin and Huang 2012; Cooke and Donaldson 2014; Ioannidis 2015;Soares et al. discover how a known idea or innovation has been confirmed, applied, improved, extended, or corrected.. (2010). The report does not reveal how many citations are from any single year between 2008 and the present. The total citation impact, mean citation impact and the factors contributing to 2-year and 5-year citation rate were established. We compare these rates with citation rates for non-Covid-19 articles published in the same 24 journals over an identical time frame. 2018; Baccini et al. We used WOS to determine the difference in rates at which Covid-19 and non-Covid-19 articles from 24 top medical journals are being cited. MathSciNet Social Studies of Science,7(1), 113122. Scientometrics,67(2), 263277. https://doi.org/10.1177/0165551511412027. Thijs, B., & Glnzel, W. (2006). In addition, the average number and age of the references, and the ratio of new publications in the field and the total number of publications play a role . For additional information on how RCRs are calculated, see Hutchins et al. [1][2][3][4][5] Citation counts are interpreted as measures of the impact or influence of academic work and have given rise to the field of bibliometrics or scientometrics,[6][7] specializing in the study of patterns of academic impact through citation analysis. According to the Web of Science Science Citation Index Expanded (WOS), which includes more than 8,300 journals across 150 scientific disciplines, nearly 200,000 Covid-19 related papers were published or presented in 24 months between January 1, 2020 and December 31, 2021 [5]. PLOS ONE promises fair, rigorous peer review, Key parameters for analysing the distributions of the frequency of self-references among Highly Cited Researchers (20082018) by Essential Science Indicator fields. Bensman, S. J., Smolinsky, L. J., & Pudovkin, A. I. For all years, Microbiology papers in the 10% percentile received a minimum of 38 citations. 2018; Scarpa et al. Research suggests the impact of an article can be, partly, explained by superficial factors and not only by the scientific merits of an article. The Frontiers Neuroscience journal series includes all Frontiers journals in the field of Neuroscience. Men set their own cites high: Gender and self-citation across fields and over time. For Articles in the field Chemistry, Organic published in 2010 (A&B) it would be: For articles in Chemistry, Physical published in 2010 (B&C) it would be: For reviews in Chemistry, Organic published in 2010 (D) it would be: Note: The citation distribution for any set of publications is typically skewed towards a small number of highly cited papers and a largenumber of papers with relatively few citations. Bakare, V., & Lewison, G. (2017). Other journal-level metrics include the Eigenfactor, and the SCImago Journal Rank. Kacem et al. Highest rates of self-citing in some categories that are still within that central range. https://doi.org/10.1002/(SICI)1097-4571(198601)37:1%3c34:AID-ASI5%3e3.0.CO;2-0. Note that we are excluding citations from 2017, as RCRs exclude the first calendar year in which the article was published. It is calculated by Journal of the American Society for Information Science,33(5), 281284. Private acts and public objects: an investigation of citer motivations. The disciplines chosen were respiratory, cardiology, immunology, radiology, microbiology, gastroenterology and hepatology, general and internal medicine, and multidisciplinary sciences. There are four plots: two each (one linear and one log plot) for self-references and self-citations. Humility, noted Merton, serves to reduce the misbehavior of scientists below the rate that would occur if importance were assigned only to originality and the establishing of priority (Merton 1957). Social Studies of Science,5(1), 8692. Science Technology & Society,23(1), 124. https://doi.org/10.1002/andp.200910360. The citation rate for all years is the total number of citations How frequently are articles in predatory open access journals cited. (2018). . It uses Google Scholar to obtain the raw citations, then analyzes these and presents a variety of statistics. Fister, I., Fister, I., & Perc, M. (2016). Note, however, that the expected rate of author self-citation for this group is likely to be lower than for researchers in general owing to the high levels of citation (Highly Cited Researchers are at the end of the distribution driven by the laws of cumulative advantage: Price 1976; van Raan 2008). 2019; Peroni et al. [6] examined OA article citation performance in the field of civil engineering, in terms of jour- . https://doi.org/10.1080/09737766.2008.10700836. demonstration of the calculation all papers are in the same year, but in reality, baselines are also calculated for each year. PLoS ONE, 11(8), article number e0161021. This raises questions about editorial and refereeing standards and the ability of the research base to manage its own affairs. Before considering what rates or levels of self-citation are excessive and suggestive of citation manipulation, we need to consider the definition of self-citation and the factors apart from merit or manipulation that influence the extent of self-citation in the literature. Pichappan, P., & Sarasvady, S. (2002). Note, in this paper, that we refer to self-references and to self-cites and that they are not the same thing. Merton, R. K. (1942). https://doi.org/10.1002/(SICI)1097-4571(198909)40:5%3c342:AID-ASI7%3e3.0.CO;2-U. Glnzel, W. (2008). [54] Field-dependent factors are usually listed as an issue to be tackled not only when comparison across disciplines are made, but also when different fields of research of one discipline are being compared. While marked outliers are detectable, they are not present in all fields and they cannot be excluded by a single universal arbiter such as a percentile. One of the most basic citation metrics is how often an article was cited in other articles, books, or other sources (such as theses). ), 21st International conference on science and technology indicators (STI 2016), pp. Google Scholar. Average Evidence-based Reading and Writing score: 529Average Math score: 521. These are only labelled on the first graph. Publications of the Astronomical Society of the Pacific,98(610), 13471348. Lawani, S. M. (1982). The median home value across these five cities, on average, is about $137,900.
How Do I Check My Medicaid Status In Louisiana, Hayfield Secondary School Bell Schedule, Croydon Council Bin Collection Contact Number, Calories In One Pump Of White Mocha Starbucks, Scarlets Rugby Jobs, Articles A