Decided to start a new game. Spent an hour or so on the initial stuff, went into the catacombs under the village, got the 3 orbs to open the portal. Opened it. Went back to town before going through. Got distracted, came back later. No more portal and you can't pick up and replace the orbs. Game Over.