After returning to the town where you first talked to the Mayor, going to that area and the Mayor tells you soldiers have taken over the town, you will get stuck in that area and there's no way back out.