Just like you said, the reciever might be weak to the opponet. Another thing is if the reciever is weak to Rocks,(Stealth Rocks,Spikes,Toxic Spikes,) their health will be lowered and they have less time in field to sweep. Most "good" baton passer, and what I mean are the most common, are low and defenses and could be killed in one hit, defeating the purpose of your reciver. You might want to have a pokemon to set up some rock because once you switch to your reciever, the opponet is going to switch to a stronger pokemon that can kill your reciever easily, like maybe a Snorlax, and since he has such a good movepool, he most likely us going to have a move super-effective to you.
Thats pretty much it, so try and use some of my advice so you can be better!
P.S. Sorry for wall of text.