No, Double Team is not impacted more by stomp and body slam, but Minimize is.
Minimize is actually hurt more by many attacks, including: Stomp and Body Slam of course, Steamroller, Dragon Rush, Flying Press, and Phantom Force. However, it is unlikely you will see any of these moves besides maybe Stomp and Body slam.
Besides taking more damage from those attacks, Minimize also has less PP than Double Team does. If you max out the amount of PP you can have, then the difference is only 8, but that can mean a world of difference if a game comes down to PP stalling.
In my opinion, since Minimize's weaknesses are mostly circumstantial, Minimize is still better than Double Team, simply because of the faster boost of evasion. You wouldn't replace Swords Dance for Howl, would you? (I know, not exactly the same thing, but close).
Hope this helps! :)