I like the idea, but it wouldn't be ideal.
Comments are there because that is what they are; comments!
If voting were done on comments, nothing would make sense! Comments is the one place people are entitled with their opinion, or if they literally want to make a comment on something!