Well Yeah, that pretty much sums it up, this also applies to other abilities that prevent confusion.
Yes, If Swagger is used on a Pokemon with Own Tempo, they will get the attack boost, but they are immune to confusion so they don't get confused.
Source
