There's a lot of male fragility in the world. Not too long ago I had a man tell me that it was misandric to say that nearly every woman has experience with sexual harassment or violence because, you guessed it, it makes men look bad. The fact that the statistics support this was irrelevant to this guy. He didn't care about all the women that had happened to - he only cared about feeling bad or ashamed or defensive about it.
Don't let guys like this shut you up, which is exactly what they want to do. You are entitled to your experiences and to writing about them however you wish.