Supposedly, if you have about 2 or 3 hearts in Pokemon Amie your Pokemon will begin to shudder. After getting about 4 or 5 Sylveon will start to peak back at you. Its just a little something Game Freak threw in to keep the game play and the Pokemon Amie stuff linked.
Source: Here and a Chart on this page.