• Users Online: 184
  • Print this page
  • Email this page


 
 
Table of Contents
VIEW POINT
Year : 2018  |  Volume : 6  |  Issue : 2  |  Page : 37-40

Need for journal analysis: Is citation-based scores good enough to rank a journal?


1 Department of Medicine and Community Medicine, SBKS MIRC, Sumandeep Vidyapeeth, Gujarat, India
2 Department of Pharmacy, Sumandeep Vidyapeeth, Vadodara, Gujarat, India

Date of Web Publication26-Feb-2019

Correspondence Address:
Dr. Jitendra D Lakhani
Department of Medicine, SBKS MIRC, Sumandeep Vidyapeeth, Vadodara, Gujarat
India
Login to access the Email id

Source of Support: None, Conflict of Interest: None


DOI: 10.4103/JIHS.JIHS_5_19

Rights and Permissions
  Abstract 


Journal analysis denotes evaluation, assessment, ranking, and scoring of a journal. It is an important exercise to be adopted by learning resource organization for recommending a journal for referring, scanning, referencing, subscribing, publishing, circulating, and disseminating purposes. Evaluation is done qualitatively in relation to content, objectives, and ethos. Rhetorical analysis of a journal will take into account something which is abstract and nonliteral. Advancement in ideology, in relation to different sphere of academic domains, is important key element of a particular journal. Journal which may communicate theory, practice, methods, skills, and thought process as a whole can reflect the image of an excellent journal. Analysis of these qualitative aspects should be part of the journal analysis. Quantitatively it can be ranked by modern tools which started as Science Citation Index and impact factor (IF) which then progressed to other numerical integers such as Eigenfactor score, Article Influence Score, and others. Numerical IFs have led to ranking system of journals and are based on “citations.” Can “citations” and its resultant statistics measure true impact of a journal? This article tries to share their viewpoint with discussion on various aspects of journal analysis.

Keywords: Citation, journal analysis, journal ranking


How to cite this article:
Lakhani JD, Pandit N, Sailor G. Need for journal analysis: Is citation-based scores good enough to rank a journal?. J Integr Health Sci 2018;6:37-40

How to cite this URL:
Lakhani JD, Pandit N, Sailor G. Need for journal analysis: Is citation-based scores good enough to rank a journal?. J Integr Health Sci [serial online] 2018 [cited 2019 Mar 22];6:37-40. Available from: http://www.jihs.in/text.asp?2018/6/2/37/252880




  Preamble: Journal Analysis: Useful Endeavor for Academics Top


Journal analysis is useful exercise to be done by academicians, libraries, learning resource centers, teaching institutes, universities, publication houses, data collecting sites, and all the stakeholders of the research Institutes. Most of the time, this practice is done by a group or a committee; however, analysis done by an individual is equally important.[1] Research scholar has to decide for suitable journal for publishing their thought process, innovation, and research for which this process has to be taken by oneself. Thought process generated out of a journal can be concrete or may be abstract to start with. Experts, journal analysis committee, research guides, professional associations, and organizational leaders may recommend journal/journals for various academic purposes such as referring, scanning, referencing, subscribing, publishing, circulating, and disseminating. In recent times, quantitative tools are available for ranking and analysis purpose which is well researched, structured, reproducible, and authentic. However, inherited limitation does exist in this system of analysis.


  Is Rhetorical Analysis of Journal Evaluation Good Enough? Top


Rhetorical analysis is a part of qualitative analysis of a journal which forms an important component of journal analysis.[2] Rhetorical analysis is breaking a “whole” “to” pieces” for scrutiny.[3] Rhetorical analysis may take into account, some subtle aspects which may be abstract, metaphorical, value based, and nonmeasurable in numerical. If authenticity and publication ethics is maintained, good journal can be easily picked up through viewing it through viewpoint of a user. Rhetorical analysis may involve various portions of a journal like how an editorial is written, how original research manuscript is presented? Which language is used? What is referencing style? Articles contained in the journals gives clear message or not? Presentation of results and reviews which is viewer friendly such as tables, charts, graphs, pictures, forest plots, figures, and necessary illustrations giving translucent and logical information reflects the quality of good journal. Simple but up to date, not very lengthy manuscripts but to the point discussion, use of necessary statistics and evidence, meta-analysis, and systematic reviews all may give eminence to a journal. English language is widely used medium in most journals. Correct English in grammar, syntax, spelling, and meaning may be an essential part of the journal. A good journal should maintain reasonable standards of English language which is conveying message with clarity.


  Title of Journal: first Impression Cannot Be Final Notion Top


Title based on prefix “International,” “National,” and “Regional” may carry message to its user but should not be judged for better ranking. Important aspect is the content delivered by the journal. Title of the journal can be “Running Title” which may be abbreviated for convenience sake if it is long. It is printed on the text pages. Title may be prefixed with Country (Indian Journal of ….,) State (Gujarat Medical Journal), Continent (Asian Journal of….), Geographical region (Tropical journal.), or many links with Associations and Organizations.


  Important Facets in Journal Analysis Top


In recent times, lots of importance is given by to “peer-reviewing process” of the journal, their policies in regard to plagiarism, publication ethics, archiving methods, and citations of research articles of a particular journal. Research communication in the form of Original articles, Innovations, Reviews, Ideas, Discussions, Critical analysis, Meta-analysis, Therapeutic guidelines, Conference proceeding, and others which will be a part of vista of an academic journal may vary in tempo in different journals. The academic impact given by them is essential core part of journal analysis is an agreeable connotation. This impact has abstract meaning and part of rhetorical analysis but now is given numerical characteristic by various tools of scoring and journal analysis.


  Quantitative Evaluation of a Journal: Scores and Tools Used for Ranking Top


To score a given journal in a measurable number is done through quantitative analysis. How best a journal is able to do its job in various domains is measurable through quantitative tools of evaluation. Science Citation Index (SCI) is an innovation of Eugene Garfield in 1955, was put in practice in 1964, and its by-product “SCI Journal Citation Reports (JCR)” was launched in 1975.[4],[5],[6] In his landmark article in the year 1955 on “ Citation Indexes for Science A New Dimension in Documentation through Association of Ideas,” he proposed a bibliographic system for scientific literature.[4] It was thus, devised as a search engine, but it got success as a tool for measuring scientific productivity. JCRs and its impact factor (IF) rankings are a byproduct of SCI.[5],[6] Thomson Reuters has produced citation reports (JCRs) database for evaluation of a journal.[7] This tool uses citation data to form an IF which is measurable and has numerical value. IF denotes figure and gives a meaningful symbol which mean articles of the journal are acknowledged, cited, read meaningfully, applied, and have given impact to the stakeholder's credentials. Statistical analysis of written publications is known as bibliometrics. Citation analysis, IF, and other scores are used for bibliometrics.[8],[9] Use of IF for quantitative journal evaluation has limitations such as wide use of English language journals may have better citation score. Impact Factor (IF) may be more due to self-citation, citation by the review articles and due to noncitable items, different denominator of total number of citable items and others.[10]


  Advancement in Bibliometrics and Scoring Systems for Journal Analysis Top


Eigenfactor score developed at University of Washington is based on the number of incoming citations. The impact of the journal goes pari-passu with Eigenfactor score. The Eigenfactor approach is more advanced technique than the IF. Impact Factor (IF) counts incoming citations without considering the significance of those citations which is been taken care in Eigen Factor (EF). For a given number of citations, those from more significant journals will result in a higher Eigenfactor score. Originally, Eigenfactor scores were measures of a journal's importance, it has been extended to author level. It can also be used in combination with the h-index to evaluate the work of individual scientists.[11],[12],[13],[14],[15]

The Article Influence Score (AIS) is like the traditional IF which signifies influence of articles in the journal. Eigenfactor Score (ES) and AIS rank journals in a slightly different manner than IF. This score uses algorithm similar to “Page Rank (PR)” of Google. PR, named on one of the founders of Google, Larry Page, uses an algorithm by a way of measuring the importance of website pages.[16] Similar algorithm is used by ES and AIS taking into consideration of prestige of citation source in the account. Again, they have different time window based on 5 years of citations. ES is based on total citations not the citable items of a journal. It is not having denominator like IF. AIS and SCImago Journal Rank (SJR) indicator have similar concepts in the sense that calculation is of mean influence of citations.[17]


  SCImago Journal Rank Indicator and Scopus Journal Analyzer Top


This journal quality indicator was proposed by SCImago Research Laboratory in Spain in 2007, which uses Scopus indexed journals for quality assessment and consider citations in Scopus database in a 3-year period.[16] Elsevier produced a tool known as Scopus Journal Analyzer (SJA), which is designed for evaluating journals in sphere of medicine, technology, science, and social science. SJA provides SJR which indicates scientific influence of the journal.[17] Source Normalized Impact per Paper (SNIP) scores for journals were created by Professor Henk Moed at the Centre for Science and Technology Studies, University of Leiden. SNIP which is a part of SJA.[18],[19]


  International Identifier for Serials and Other Continuing Resources, in the Electronic and Print World: first Step for Journal Recognition and Assessment Top


One of the first important assessments of a journal is done by ISSN.[20] One of the sources of bibliographic and publisher information is Ulrichsweb.[21] It gives preliminary information of all types of publication such as peer-reviewed titles, newspapers as well as newsletters, and also Open Access publications. It has data of 300,000 periodicals including academic and scholarly journals.

Limitation of scoring systems

Many issues can influence citation rates, on which this score is based. Some may be directly related to citation, while some may be related indirectly as article appeared in a journal which is not high ranking. This issue may be in relation to specialty, language, and track record of journal, format, publication frequency, and time lapse between origins of a manuscript to final publication. The factor which is important for developing countries which has indirect bearing to journal's IF is publication cost.[22]

The number of articles given for journals listed in JCR includes primarily original research and review articles. Editorials, letters, news items, and meeting abstracts are usually not included in article counts because they are not generally cited. Most of the tools used for quantitative analysis for journal evaluation take into account number of citation, which of course has changed and revolutionized publication ethics; however, it is like monopolizing business. Better ranking journals may get more number of citations and they get better in rank. Complex scores and metrics maybe difficult to be understood by an academician which may result in noncitation of their work which in turn not published in high-ranking journal. There are many nonacademic factors such as visibility, archiving policies, marketing techniques, and others which may lead to more citations. Like an amateur artist finding a breakthrough platform difficult, a budding scientist may not be able to communicate research work in high ranking established journal because of want of awareness of such scores,[23] long publication time, various stipulated manuscript norms, and manuscript processing fees. Establishing a novice journal which has innovative ideas may not get good clientage and stakeholders as their ranking in relation to citation score may be poor. This maybe a vicious circle and such journal may die before time.


  Conclusion Top


Quantitative tools, most of which takes citation for ranking of the journal may have limitations. A need-based analysis of a journal at an institutional level is required, which should be unbiased, multifactorial, and holistic. Not only quantitative scoring tools and citation numbers to be accounted for but also qualitative, ethics, and values should be a part of journal analysis process. For sustenance of a value-based good quality journal, ranking system should not become an obstacle.

Financial support and sponsorship

Nil.

Conflicts of interest

There are no conflicts of interest.



 
  References Top

1.
Mingers J, Yang L. Evaluating journal quality: A review of journal citation indicators and ranking in business and management. Eur J Oper Res 2017;257:323-37.  Back to cited text no. 1
    
2.
Colorado State University. Journal Analysis Assignment – Myers. Available from: https://www.writing.colostate.edu/guides/teaching/co301aman/pop7a3.cfm. [Last accessed on 2019 Jan 02].  Back to cited text no. 2
    
3.
Aube M. Learning Commons: Writing Centre/Assignments. Available from: http://www.wiki.ubc.ca/index.php?oldid=191820. [Last accessed on 2019 Jan 02].  Back to cited text no. 3
    
4.
Garfield E. Citation indexes for science; a new dimension in documentation through association of ideas. Science 1955;122:108-11.  Back to cited text no. 4
    
5.
Garfield E. Citation analysis as a tool in journal evaluation. Science 1972;178:471-9.  Back to cited text no. 5
    
6.
Garfield E. The evolution of the science citation index. Int Microbiol 2007;10:65-9.  Back to cited text no. 6
    
7.
Allahbadia GN. Thinking beyond the Thomson reuters “impact factor”. J Obstet Gynaecol India 2014;64:231-3.  Back to cited text no. 7
    
8.
Kianifar H, Sadeghi R, Zarifmahmoudi L. Comparison between impact factor, eigenfactor metrics, and SCimago journal rank indicator of pediatric neurology journals. Acta Inform Med 2014;22:103-6.  Back to cited text no. 8
    
9.
Shrivastava SR, Shrivastava PS, Ramasamy J. Ascertaining the standard of journal using quality indices. Indian J Occup Environ Med 2015;19:119-20.  Back to cited text no. 9
[PUBMED]  [Full text]  
10.
Seglen PO. Why the impact factor of journals should not be used for evaluating research. BMJ 1997;314:498-502.  Back to cited text no. 10
    
11.
Bergstrom CT, West JD, Wiseman MA. The Eigenfactor™ metrics. J Neurosci 2008;28:11433-4.  Back to cited text no. 11
    
12.
Murphy LS, Kraus CK, Lotfipour S, Gottlieb M, Langabeer JR 2nd, Langdorf MI, et al. Measuring scholarly productivity: A primer for junior faculty. Part III: Understanding publication metrics. West J Emerg Med 2018;19:1003-11.  Back to cited text no. 12
    
13.
Ranjan CK. Bibliometric indices of scientific journals: Time to overcome the obsession and think beyond the impact factor. Med J Armed Forces India 2017;73:175-7.  Back to cited text no. 13
    
14.
Bibliometrics Breakdown: An Insider's Insight. Niche Science & Technology Ltd.; 2016. Available from: http://www.niche.org.uk/asset/insider-insight/Insider-Bibliometrics.pdf. [Last accessed on 2019 Jan 02].  Back to cited text no. 14
    
15.
Bar-Ilan J. Which h-index? – A comparison of WoS, scopus and Google scholar. Scientometrics 2008;74:257-71.  Back to cited text no. 15
    
16.
Sullivan D. What is Google PageRank? A guide for searchers & webmasters. Search Engine Land 2007. Available from: https://searchengineland.com/what-is-google-pagerank-a-guide-for-searchers-webmasters-11068. [Last assessed on 2019 Feb 11].  Back to cited text no. 16
    
17.
Jamali J, Salehi-Marzijarani M, Ayatollahi SM. Factors affecting journal quality indicator in scopus (SCImago journal rank) in obstetrics and gynecology journals: A longitudinal study (1999-2013). Acta Inform Med 2014;22:385-8.  Back to cited text no. 17
    
18.
Moed HF. Measuring contextual citation impact of scientific journals. J Informetr 2010;4:265-77.  Back to cited text no. 18
    
19.
Cooper ID. Bibliometrics basics. J Med Libr Assoc 2015;103:217-8.  Back to cited text no. 19
    
20.
International Standard Serial Number. Available from: https://www.issn.org. [Last accessed on 2019 Jan 02].  Back to cited text no. 20
    
21.
Proquest. Ulrichsweb™. Available from: https://www.proquest.com/products-services. [Last accessed on 2019 Jan 02].  Back to cited text no. 21
    
22.
University Libraries, University of Maryland. Bibliometrics and Altmetrics: Measuring the Impact of Knowledge. Available from: http://www.lib.guides.umd.edu/bibliometrics/altmetrics. [Last accessed on 2019 Jan 02].  Back to cited text no. 22
    
23.
Agarwal A, Durairajanayagam D, Tatagari S, Esteves SC, Harlev A, Henkel R, et al. Bibliometrics: Tracking research impact by selecting the appropriate metrics. Asian J Androl 2016;18:296-309.  Back to cited text no. 23
[PUBMED]  [Full text]  




 

Top
 
  Search
 
    Similar in PUBMED
   Search Pubmed for
   Search in Google Scholar for
 Related articles
    Access Statistics
    Email Alert *
    Add to My List *
* Registration required (free)  

 
  In this article
Abstract
Preamble: Journa...
Is Rhetorical An...
Title of Journal...
Important Facets...
Quantitative Eva...
Advancement in B...
SCImago Journal ...
International Id...
Conclusion
References

 Article Access Statistics
    Viewed93    
    Printed2    
    Emailed0    
    PDF Downloaded47    
    Comments [Add]    

Recommend this journal