Ok I've played the mission again now. The stairs out of the prison are in cellblock 1, if you check the map you can see them top right corner of the cellblocks. Then take another set of stairs up inside the chapel. The secret passage I mentioned is actually where you have to go on expert to get the evidence (after finding it's not in the safe like usual) and you find it at the guard post with the flashing light on your way up to cellblocks 3+4 - there's a hole in one of the walls you can crouch through. Note it's not jumping into the flowing water, that leads to the bottom of the mine and is a handy way to get most of the way back out..
I do have a feeling there is another secret passage somewhere that goes up to the officer's quarters but I really can't remember for sure. There is a secret room behind one of the banners you cut with your sword up there with some wine in it and I *think* it might be in there but I spent a few minutes and couldn't find how to open it so maybe I'm remembering wrong.