I had an occasion where I thought the camera was bugged because it hit some invisible bounds. Turns out, there was an objective I had not done. After completing it the next objective appeared and the camera was allowed to move up the island. Maybe that's the issue you're having, too?