I go there, and all the inhabitants (not the attackers) are hostile to me. I have neuteral relations with them, so i am not sure how im even supposed to do that quest.