After another look it appears that all of the harbor is safe. I dont know what killed me but I remember dying there. Maybe I just fell to my death? It looks like all of the dwarven district, old town and the cathedral district are safe. I died just outside of the cathedral district though.