Tab Application Banner
  • Users Online: 495
  • Home
  • Print this page
  • Email this page
Home About us Editorial board Ahead of print Current issue Search Archives Submit article Instructions Subscribe Contacts Login 


 
 Table of Contents  
EDITORIAL
Year : 2020  |  Volume : 15  |  Issue : 3  |  Page : 162-164

Blaming the peer reviewer: Don't shoot the messenger!!


Department of Clinical Immunology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow, Uttar Pradesh, India

Date of Submission16-Jul-2020
Date of Acceptance19-Jul-2020
Date of Web Publication3-Sep-2020

Correspondence Address:
Dr. Durga Prasanna Misra
Department of Clinical Immunology, Sanjay Gandhi Postgraduate Institute of Medical Sciences, Lucknow - 226 014, Uttar Pradesh
India
Login to access the Email id

Source of Support: None, Conflict of Interest: None


DOI: 10.4103/injr.injr_187_20

Rights and Permissions

How to cite this article:
Misra DP, Agarwal V. Blaming the peer reviewer: Don't shoot the messenger!!. Indian J Rheumatol 2020;15:162-4

How to cite this URL:
Misra DP, Agarwal V. Blaming the peer reviewer: Don't shoot the messenger!!. Indian J Rheumatol [serial online] 2020 [cited 2020 Nov 28];15:162-4. Available from: https://www.indianjrheumatol.com/text.asp?2020/15/3/162/294309



The coronavirus disease 19 (COVID-19) pandemic has brought into focus realities in scientific publishing, with a perceived pressure to rapidly share and publish relevant information also resulting in instances of misinformation.[1] Rheumatologists have found themselves at the unwanted center of one of such arguments, regarding the safety and utility of hydroxychloroquine, a time-tested disease modifying anti rheumatic drug. This was particularly the case when a large global study purported the apparent increase in mortality risk for patients with COVID-19 treated with hydroxychloroquine. Later, when questions arose about the geographic coverage and numbers of patients included in the published database, as well as queries regarding the remarkable homogeneity of such data across diverse geographical regions, attempts were made to verify the study data by external sources.[2],[3] As sensational and unbelievable the origins of this remarkable study were, so was its fall from grace when part of the author group themselves refused to stand by this study and recommended retraction of this as well as another prominent study (addressing another area of controversy in COVID-19, regarding the use of angiotensin converting enzyme inhibitors and mortality risk).[4],[5],[6] A surprising fallout of such public disowning of these studies and subsequent retraction were the remarkable criticism that seemed targeted at peer reviewers of these studies.[6] This raised questions in our mind as to who should bear the responsibility for research integrity – the authors themselves, the handling editors of journals, or peer reviewers. Therefore, we overviewed various types of research misconduct related to data handling, consequences of such articles containing research misconduct and propose distribution of responsibilities for such research misconduct amongst authors, editors, and reviewers.


  Types of Scientific Misconduct Related to Data Top


Dubious data

The data on which the study in question is based on might not be of good quality or might be unreliable. The sources of such data might not be clear. The data might be being used for a different purpose than for which it was collected (thereby compromising quality) and therefore might not be of high quality. There may be issues with collection of data or with inaccurate coding of the data. Particularly, such concerns should be kept in mind when interpreting data collected from routine health-care databases.[7],[8] The primary reason for the retraction of the aforementioned studies on COVID-19 was the lack of access to their data, when this had subsequently been sought for auditing by the concerned journals after complaints were received regarding the potential veracity of such data.[3],[4],[5] Notably, some of the authors of the said studies simply stated that they could no longer guarantee the veracity of the data on which these papers were published.[4],[5] Keeping in mind the principles for authorship espoused by the International Committee of Medical Journal Editors,[9] such individuals should probably have never agreed to be listed as authors on the said manuscript if they could not guarantee the accuracy of the data sources. A review of the literature also reveals that data falsification or data fabrication accounts for between 20% and 40% of retracted publications from certain Asian countries.[10] In the fields of dentistry[11] and genetics,[12] nearly one-fourth of retractions due to research misconduct were due to concerns about the veracity of data.[11],[12]

Dubious analysis of data

The data for a particular study might not have been properly analyzed. Either inappropriate methods might have been used (e.g., parametric tests for small numbers), or the results might be too homogenous between groups to be considered truly representative. In the aforementioned retracted papers, unexpected homogeneity of the data raised questions about its veracity.[3],[13]

Dubious ethical aspects

Studies not conducted ethically should not be considered as relevant, no matter how attractive their results might appear to be. Due consideration toward informed consent (or in its absence, appropriate anonymization of data) and approval by local ethics committees should always be considered by researchers.[14] In the aforementioned retracted publications on COVID-19, lack of information regarding ethics committee review and the outright refusal to share the identities of hospitals that the transcontinental database was supposedly based on were fatal flaws that ultimately rendered the study findings unreliable.[3],[4],[5]


  Consequences of Data Unreliability, Fabrication, or Misconduct Related to Data Handling Top


Depending on the degree of inappropriate or fraudulent practices related to data handling, journals might either issue expression (s) of concerns (EOC), correct the said papers, or retract them from the published literature. EOC are generally issued when the matter in question is under active investigation by the journal. After the completion of such investigations, EOC might be withdrawn if no evidence of misconduct was found, or the degree of inaccuracy was found to be trivial and not directly affecting the said study and its interpretations. If such inaccuracies are significant, corrections might be issued for the said paper to rectify those parts which are inaccurate. If the said mistakes in data integrity compromise the study and its interpretations and are not amenable to a correction, the said paper might be retracted.[14],[15] Instances exist of honest mistakes by authors, resulting in retraction and republication of the same paper in the same journal.[16]


  Responsibility for Integrity of Data Top


Since authors purposefully submit their manuscripts for publication by journals, they should be responsible for the integrity of their published data. Any responsibility for data fabrication or falsification should therefore lie primarily with the authors of the manuscript in question.[2],[3],[17] Editors have access to all the submitted information and are generally more experienced in dealing with scientific misconduct than peer reviewers; hence, they should also bear responsibility for the manuscripts they approve for publication, after the authors. Peer reviewers often do not have access to the primary data. Ethical statements might also not be available to reviewers when there is double blind peer review. While some reviewers may be statistical experts, many others are technical subject experts and not necessarily able to identify subtle clues toward data fraud. Hence, they should be least held responsible for data fraud and should rather bear responsibility for technical correctness of the manuscripts they review and recommend for publication. Efforts might be made to train reviewers to pick up subtle clues toward data manipulation based on past experiences.[3],[18] Fraudulent behavior with respect to data handling primarily remains the domain of the authors, rather than laying blame to peer reviewers as occurred recently during the prominent COVID-19 retractions.[6] Peer reviewers that volunteer their precious time setting aside their own patient care, teaching and research responsibilities as well as their personal time should be valued more rather than being taken for granted and blamed at the earliest opportunity if published manuscripts are found to have problems.[19]



 
  References Top

1.
Gupta L, Gasparyan AY, Misra DP, Agarwal V, Zimba O, Yessirkepov M. Information and misinformation on COVID-19: A cross-sectional survey study. J Korean Med Sci 2020;35:e256.  Back to cited text no. 1
    
2.
Top European Hospitals Deny Providing Data for Retracted COVID-19 Research. Available from: https://www.google.com/search?client=safari&rls=en&q=Top+European+hospitals+deny+providing+data+for+retracted+Covid-19+research&ie=UTF-8&oe=UTF-8. [Last accessed on 2020 Jul 14].  Back to cited text no. 2
    
3.
Concerns Regarding the Statistical Analysis and Data Integrity-Open Letter. Available from: https://zenodo.org/record/3862789#. Xw0shi2B06j. [Last accessed on 2020 Jul 14].  Back to cited text no. 3
    
4.
Mehra MR, Desai SS, Kuy S, Henry TD, Patel AN. Retraction: Cardiovascular disease, drug therapy, and mortality in COVID-19. N Engl J Med 2020;382:2582.  Back to cited text no. 4
    
5.
Mehra MR, Ruschitzka F, Patel AN. Retraction-Hydroxychloroquine or chloroquine with or without a macrolide for treatment of COVID-19: A multinational registry analysis. Lancet 2020;395:1820.  Back to cited text no. 5
    
6.
Lancet and NEJM Retractions Related to COVID-19. Available from: https://forbettersciencecom/2020/06/05/would-lancet-and-nejm- retractions-happen-if-not-for-covid-19-and-chloroquine/. [Last accessed on 2020 Jul 14].  Back to cited text no. 6
    
7.
Ta CN, Weng C. Detecting systemic data quality issues in electronic health records. Stud Health Technol Inform 2019;264:383-7.  Back to cited text no. 7
    
8.
Arts DG, De Keizer NF, Scheffer GJ. Defining and improving data quality in medical registries: A literature review, case study, and generic framework. J Am Med Informatics Assoc 2002;9:600-11.  Back to cited text no. 8
    
9.
Misra DP, Ravindran V, Agarwal V. Integrity of authorship and peer review practices: Challenges and opportunities for improvement. J Korean Med Sci 2018;33:14.  Back to cited text no. 9
    
10.
Palla IA, Singson M, Thiyagarajan S. A comparative analysis of retracted papers in Health Sciences from China and India Account Res. 2020;1-16. doi:10.1080/08989621.2020.1754804. [published online ahead of print, 2020 Apr 18].  Back to cited text no. 10
    
11.
Rapani A, Lombardi T, Berton F, Del Lupo V, Di Lenarda R, Stacchi C. Retracted publications and their citation in dental literature: A systematic review. Clin Exp Dent Res. 2020; 1-8. https://doi.org/10.1002/cre2.292.  Back to cited text no. 11
    
12.
Dal-Ré R, Ayuso C. Reasons for and time to retraction of genetics articles published between 1970 and 2018. J Med Genet 2019;56:734-40.  Back to cited text no. 12
    
13.
Kretser A, Murphy D, Bertuzzi S, Abraham T, Allison DB, Boor KJ, et al. Scientific integrity principles and best practices: Recommendations from a scientific integrity consortium. Sci Eng Ethics 2019;25:327-55.  Back to cited text no. 13
    
14.
Misra DP, Agarwal V. Integrity of clinical research conduct, reporting, publishing, and post-publication promotion in rheumatology. Clin Rheumatol 2020;39:1049-60.  Back to cited text no. 14
    
15.
Gasparyan AY, Ayvazyan L, Akazhanov NA, Kitas GD. Self-correction in biomedical publications and the scientific impact. Croat Med J 2014;55:61-72.  Back to cited text no. 15
    
16.
The Editors of The Lancet. Retraction and republication-Effectiveness of non-steroidal anti-inflammatory drugs for the treatment of osteoarthritis pain: A network meta-analysis. Lancet 2017;390:109.  Back to cited text no. 16
    
17.
ICMJE Recommendations. Available from: http://www.icmje.org/icmje-recommendations.pdf. [Last updated on 2019 Dec 20; Last accessed on 2020 Jan 09].  Back to cited text no. 17
    
18.
Adam D. How a data detective exposed suspicious medical trials. Nature 2019;571:462-4.  Back to cited text no. 18
    
19.
Misra DP, Ravindran V. Peer review in academic publishing: Threats and challenges. J R Coll Physicians Edinb 2019;49:99-100.  Back to cited text no. 19
    




 

Top
 
 
  Search
 
Similar in PUBMED
   Search Pubmed for
   Search in Google Scholar for
Access Statistics
Email Alert *
Add to My List *
* Registration required (free)

 
  In this article
Types of Scienti...
Consequences of ...
Responsibility f...
References

 Article Access Statistics
    Viewed774    
    Printed19    
    Emailed0    
    PDF Downloaded81    
    Comments [Add]    

Recommend this journal


[TAG2]
[TAG3]
[TAG4]