Nowadays, before discarding material I try to extract interesting data. Here are two related pieces on the theme of reviewer opinions versus subsequent citations of research papers.

Data regarding my own reports as referee

This data is from paper files of referee reports written by myself in 1992-5. The table relates "enthusiasm of my report", on a scale of 1 (poor) to 2 (average published paper) to 3 (excellent), and this is compared to the Google Scholar citation counts from 2007.

enthusiasm citations
1 * 0 0 1 4
1+ * 0 0 1 1 2 3
2- * 1 1 1 1 3 3 5 5 7 8 8 12
2 * 1 3 4 6 8 23
2+ * 4 4 13 14
3- * 27 37
3 * 38 42 85 450



Data regarding my own reports as Associate Editor

This data is from Associate Editor reports written by myself in the years stated, with Google Scholar citation counts from a recent year.


Ann. Probability EJP/ECP EJP/ECP RS&A
Year of report 1996 1999 - 2003 2004 - 2006 2001 - 2012 (parts)
Year of citation count 2012 2014 2016 2017
Acceptance rate 22% = 7/32 56% = 14/25 59% = 17/29 52% = 15/29
rejected; never published 2 2 4 9
published elsewhere; < 20 citations 15 7 7 4
published elsewhere; > 20 citations 8 2 1 1
(citation counts for above) (53 45 30 29 28 23 23 23) (40 34) (73) (57)
accepted; < 20 citations 0 5 12 10
accepted; > 20 citations 7 9 5 5
(citation counts for above) (470 85 67 45 29 22 22 ) (71 64 50 38 37 30 22 22 20) (67 51 37 34 29) (126 72 61 31 31)