The fast currents where they are too fast to surf are meant not to be surfed on.
They act as a game barrier because there is no where else to go if you surf along that water. You can explore the other islands and places by simply taking the boat to the other islands, or by simply exploring and traveling yourself to the landmarks.