I was pretty sure PM was wrong and after testing it here I was proved correct. My answer had 2 upvotes and I was at 14,036 points, after hiding the answer, I remained at 14,036 points, not losing 20 for the 2 upvotes. Points changes from upvotes or down votes are kept even after the post is hidden.