do you get the extra atk boost because your speed was decrease
No, defiant only increases your attack if the opponent decreases a stat, even if you do baton pass.