I can't seem to get to cloakwood is that area glitched in game?

You can only get there after a certain part in the game. I'm assuming you've reached that point.

I can't remember exactly where I "discovered" it from but I'm pretty sure I went west from either the Friendly Arm Inn or the location just north of that (with the ankhegs (spelling)).

Without mods, Cloakwood is hidden until you have cleared out the bandit camp, and enter Chapter 4. Once you enter Chapter 4 the first Cloakwood area will be shown (greyed) on the map. Enter it from the west side of FAI, or the North of Coast Way or Lion's Way.

Thanks guys! :D