That is impossible, because your Partner Pokémon asks Emolga and Dunsparce to join your party, and your character agrees to this notion; therefore the choice isn't yours to make, it is Dunsparce and Emolga's. And, of course, they say yes. :P
Source: Experience, and this.
Hope I Helped!