Yes you can do it with the EV reducing berries.
>Pomeg Berry – Lowers a Pokémon's HP by 10 EVs.
Kelpsy Berry – Lowers a Pokémon's Attack by 10 EVs.
Qualot Berry – Lowers a Pokémon's Defense by 10 EVs.
Hondew Berry – Lowers a Pokémon's Special Attack by 10 EVs.
Grepa Berry – Lowers a Pokémon's Special Defense by 10 EVs.
Tamato Berry – Lowers a Pokémon's Speed by 10 EVs.
Source