To access Kyogre, you need to obtain the Blue Orb. This orb is found from Mr. Pokémon after you have obtained the National Dex and received the Kanto starters from Professor Oak. With this orb in hand, you need to head to a cave in Route 47, the Embedded Tower. Traverse the cave and you will find Kyogre.
Source