Ever since the rivaler thing, I've been suspicious of any role I haven't heard of.
According to Smogon's 'Pokemon dictionary', an 'annoyer' is not a real role, though by common sence I would assume it is another way to say 'staller', as stallers do annoy you.
