I lost to Ting-Lu, and when I went back, it said the shrine wouldn't "open again for a little while".
Happened to me to me as well you have to wait an hour before you can face the shrine again.