Rarely using rare candies won't have a negative effect, but 96% of the Pokemon will get a negative effect no matter what like: less health, less defense, less speed, and less attack. In fact, all Pokemon's happiness won't go up as fast as it does when training.