i personally think you should sacrifice the necessary HP EV’s. you’re right, no sitrus activating is death. you should put the remaining EV’s into your special defenses, as you put 4 in them already. this way, you partially make up for your lost bulk.
on the other hand, situationally, something could happen where you would need the extra HP. however, that is very situational. there is almost no reason to keep unnecessary EV’s.
hope I helped :7