It's OK to say imo. It isn't really used to insult someone, and if it is, it is usually followed by more harsh language. "You are a damn" makes no sense at all.
I assume it's OK to say in PM's opinion too, because if it wasn't, he would've censored it by now.