The dungeon guard was sentenced to serve these grounds for life for the safety of his family. He will not let you pass for his own safety.