You lose 2 points when you downvote and it takes 100 points to downvote, so after you downvote when you have 100 points you have 98 points. So can you remove the downvote when you don't have enough points to downvote.
You can. We tested it, remember?