"Men are usually neutral of statements like there is rape culture"

In all instances of transgressions, no matter who it's being committed against, who ever takes a neutral stand takes the side of the oppressor by default.