The WEAK case against double-blind peer review – highlighting why we need it!! #science @NatureNews

NATURE this week feature a correspondence from Thomas E. DeCoursey reasoning against double-blind peer review. In my humble opinion his reasoning is flawed…. not unlike the current peer-review structure. To air out my laundry, I support a completely open or double-blind system for manuscript peer review. All of the peer review models have some flaws, but these two seem infinitely better than the current system where authors are blinded to reviewers but not vice-versa.

DeCoursey makes the somewhat legitimate point that it may be possible for reviewers to ascertain who the authors of a manuscript are based on citations. However, there would always be some element of doubt for the reviewer about who the authors are, and there are many cases where this circumstance would not occur.

Then DeCoursey reasons that reviewers need to know who the authors are in order to judge them on their past work…. or something…. wha???

To function in our increasingly competitive research culture, in which misconduct is on the rise, researchers need to be aware of which labs can be trusted and which have a record of irreproducibility. If a highly regarded lab and one with a questionable reputation each submit reports of similar investigations, a good reviewer would be extra vigilant in assessing the less-reliable lab’s study, even though the same evaluation standards would be upheld for both.

Yes, misconduct is on the rise, but this point seems wrong to me on every level. Reviewer’s should be vigilant of misconduct and scientific quality on every paper, regardless of what lab the paper comes from. Plenty of ‘good’ labs have had to retract papers for many reasons, and labs with a history of misconduct have reformed and redeemed themselves with quality papers. In fact, less vigilant reviewers may be to blame when flawed papers from highly regarded labs make it through the review process with glaring mistakes. Any reviewer that is more or less vigilant reviewing a manuscript based on the author’s names is not an impartial reviewer. PARTIALITY is bad when reviewing papers and grants…  Ethics 101 – Conflict of Interest. For the same reason, most journals won’t allow scientists to review a manuscript from within the same institution.

There is a reason double-blind experimental design is the gold standard for experiments and human clinical trials. Just like a reviewer might think he knows who the authors are, a doctor might think he knows whether a patient is receiving placebo, but neither can ever really be sure. Why wouldn’t we want the same type of controls for peer review?

Double-blind peer review removes this crucial quality-control option, opening the way for mediocre and bad labs to clutter the literature with sub-standard science.

#FacePalm…

Maybe I’m jaded, but good reviewers should be screening out sub-standard science regardless of whether they know what lab a manuscript is from or not. This closing statement makes it sound like DeCoursey thinks only the best labs, with the biggest names, and the highest impact factor publications should be publishing… which I hope is not the case (maybe I read into it too much). If it is the case, then that only argues stronger for a double-blind peer review system.

And in closing, a double-blind peer review system would help avoid racist, sexist, or other embarrassing situations like this one, where a reviewer commented that the two female author’s should add a male author in order to strengthen the manuscript. Double-blind peer review erases sexism, racism, nationalism, institutionalism (?), and other discrimination from the peer review process, which is definitely huge plus!

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s