It all depends on the last time you streetpassed them. If you streetpassed them after they've collected some flags, then they will give you some flags. If you've only Streetpassed them once, at the beginning, then they won't give you flags unless you streetpass them again.
Edit: You can always collect flags from their base, once a day. The above only applies to the Pals in your base.