Quote
As a PC chair or PC member, try to enforce high reviewing quality at your venue:
- Do not settle for shallow reviews, and ask reviewers to work harder on reviews that are obviously bad or that are unnecessarily abusive.
- Consider giving authors the possibility to submit feedback about the reviews. Of course, authors usually prefer favorable reviews even when they are shallow, so you need to take this into account, e.g., grading independently the “accept” reviews and the “reject” reviews. Another way is to have the reviews evaluated by the PC chair, or (at larger conferences) by the “meta-reviewer” or “area chair” that summarizes the reviews. A third solution is to ask the reviewers on each submission to evaluate (confidentially) the quality of the other reviews. These is research about the question of evaluating reviews, see this study for instance.
- Encourage initiatives like “best reviewer” awards, which gives some prestige to reviewers who are doing a good job.