Well, it all depends on how often you talk or pay attention to others. If you don't use residents enough, they will dissapear, and any new scenery will decrease in size. The more people you bring into the forest, the more the things there will grow. Some things have higher/lower chances of changing, so make sure you visit white forest regularly.