Damn. I didn't have bombs on X or Y when I got there so I couldn't die, but then I was stupid enough to kill bongo-bongo, grab the heart container and die + save so now when I try warping back I just end up in pitch black and keep falling to my death. No way to get back then on this save file... but thanks, I'll do it on my next file!
Tried heading to Fire and Forest temple too, and Spirit. I love this glitch.