I appear to be unable to use the token to gain access to restricted areas. I have it equipped in a quick item slot and I have tried to talking to the guards, but I have no dialogue options other than asking directions and asking what is behind the door. Am I missing something, and if it is simply glitched for me, is it something I can afford to just leave and move on from?

Edit: OK, scratch that, it decided to work out of the blue this time. Carry on.