General rule:
- Flag if the team breaks the rules (if the person asks you to make a team, incomplete sets, etc) and leave a comment explaining why you flagged.
- Downvoting is typically the next option if the problem persists, or, for answers, if something is incorrect or very insufficient.
The only place you downvote on opinion is the meta if something is a suggestion.