I am only saying for users with no activity. If they have 1 Upvote and 1 Downvote then allow them to stay, but if they have absolutely no activity and have been users for at least a week then make some way to hide them but still allow them to post, and when they finally post, allow them to be shown again. These users are the majority of the users pages and really don't need to be shown unless they want to be active.
And once they make one post then the can stay on the page unhidden.