To be honest, I don't like this idea much. I could see showing top-voted answers to gain credibility, but most down-voted answers counteract that impression. I also have a feeling that it would just add more hierarchy to the base, as well; people would compete to have the most upvotes on a single question.