Radar Perene / Archive / science

Blind review and open review: how journals evaluate

◦ Index methodology v2.2 (working papers with DOI). See the methodology.

Science

American orchestras changed one detail in their auditions from the 1970s onward: they hung a curtain between the musician and the panel. The jury began to listen without seeing — without knowing the name, the face, the training of whoever was playing. A celebrated study by Goldin and Rouse, published in 2000, documented what followed: with the curtain, the share of women advancing rose notably. The lesson crossed field boundaries: when the evaluator knows the evaluated, they judge two things at once — the work and the person. Science built its own curtain, and named it blind review.

Blind review is the evaluation arrangement in which identities stay hidden: in the single-blind form, the reviewer knows the author, but the author does not know the reviewer; in the double-blind form, neither knows who the other is. Open review is the opposite arrangement: identities revealed and, at some journals, the referee reports themselves published alongside the article.

What the curtain tries to prevent

The ideal report judges the manuscript: does the method support the conclusion? Do the data say what the text claims? But the referee is human, and the name in the header carries contaminating information — the famous university, the celebrated author, the unknown without affiliation, the seminar rival. The literature on evaluation bias records the pattern in several contexts: identical works receive different judgments depending on the signature they carry. Double-blinding is the engineering attempt against this: if the evaluator does not know who wrote, there is less surface for prestige — or its absence — to weigh on.

For those researching outside the university circuit, the detail has a direct consequence: under double-blind, an independent researcher's manuscript enters the room through the same curtain as a full professor's. It is one of the few points in the system where the absence of affiliation, by design, does not show.

Where the curtain fails

Honesty requires the other side. In small fields, anonymity is frequently theater: the reviewer recognizes the author by the topic, the style, the self-citations — and studies of the process indicate those guesses land often. Nor does the curtain prevent the lazy report or the bad-faith veto; it merely makes them anonymous. Out of that critique the opposite movement was born.

Open review: the bet on light

Open review inverts the logic: instead of protecting the judgment with secrecy, it exposes it to the public. In the fullest versions, the reader sees the article, the reports, the authors' replies and everyone's names — the entire history of the evaluation becomes a document. The argument is one of incentives: whoever signs a publishable report tends to write it with more care and less venom. The counter-argument is also one of incentives: a young researcher will think twice before signing harsh criticism of someone who may, tomorrow, evaluate their career.

Between the two poles, intermediate arrangements have multiplied. There is triple-blind, in which not even the editor knows the authorship at screening. There are journals that hide identities during evaluation and reveal them after acceptance, with the reviewers' consent. And there is post-publication review, in which the text comes out first and public criticism follows, on permanent commentary platforms — a regime that, in practice, every working paper already lives informally from the day it goes online.

The two models coexist, and economics mostly adopts the blind forms — with the well-known irony that the working paper circulates open and signed before the same text enters the evaluation anonymously.

The before and after, seen from this house

That irony is observable in the house's own practice. Radar Perene's working papers are the "open-faced" stage of the process: signed, dated, public on Zenodo with DOIs — the first in the series sits at 10.5281/zenodo.21325743 — and exposed to any reader's criticism, with no curtain at all. In numbers: six studies are published under that open regime, each checkable on the house's research page. The contrast between that format and the anonymized version double-blind review demands — no name, no acknowledgments, no revealing self-citation — is the best practical lesson on what each arrangement protects: the open text builds reputation; the blind text suspends it, so the argument speaks alone.

Frequently asked questions

What is the difference between single-blind and double-blind?

In single-blind, the reviewer knows who the author is but remains anonymous. In double-blind, neither side knows the other — the declared standard at most economics journals.

Does double-blind anonymity actually work?

Partially. In small niches, reviewers often guess authorship from topic and style. The arrangement reduces the available information; it does not eliminate it.

What exactly does open review publish?

It depends on the journal: it may reveal only the reviewers' names, or publish the full reports and the authors' replies as part of the article's record.

Does a public working paper undermine double-blind review of the same text?

Formally, the author submits an anonymized version, and the reviewer is not required to hunt for the public one. In practice, the search is possible — one more reason double-blind is understood as bias reduction, not perfect secrecy.

---

Continue the track: Look-ahead bias: the error that makes a model "predict the past" →

House readings: today's reading is in the Diário; the historical precedents, in the Atlas.

Reading a referee report — or preparing a text to pass through the curtain — is a craft learned by doing; the house talks through that backstage with those who seek it.

Read also: Look-ahead bias: the error that lets a model \"predict the past\"