In simpler words, people would upvote a lot more - or even spam upvote for gaining points - resulting in everyone having a lot more points, and points in general would lose their value (that is, an "inflation"). We would have to create higher point requirements for privileges, which would be chaotic.