If I use a Berry to make my Eevee happier which lowers a certain stat, will the stat be permanently lowered?
No, the effects of the Berries that lower an EV and raise happiness are not permanent. However, the Berries lower a Pokemon's EVs, meaning that you will have to get those EVs back in order to reverse the effects of the Berries.
Hope this helps!