Someone sent me an ArXiv link to a paper they thought I’d be interested in. Turns out I was reviewing the paper for Neurips.

I had to contact the Meta-reviewer and get taken off the paper.

This is a downside to ArXiv that I hadn’t even thought of: some of the the folks who are would be best able to interpret your work will likely have seen it if it’s on ArXiv. By posting before review, you may be reducing the pool of reviewers that are best able to asses the paper.

Mentioned elsewhere on the indieweb

I'm not outdated: not saying author's cant put submissions up on ArXiv. I'm simply pointing out that If a reviewer has already seen the paper, or if it is de-anonymised, they must contact the AC/Meta-reviewer. This likely means they're taken off as a reviewer. See second tweet.

You are outdated. NEurips allows publishing in Arixv, despite it being a good idea or not