No.
Although I don't know about ORAS, but in X/Y the Delivery man stays as long as he needs before the player accepts/denies the gift. I doubt this system has changed in ORAS, but one never knows.
Source: Tried it out with items I obtained from Pokemon global link, also that my Delivery man was standing with an event Vivillon for several weeks.
Hope I helped!