squid830: the quest should have failed (and not be in your quest log anymore).
However, if this quest does involve Romulus & Remus (as per the hint above), then you shouldn't need to go inside for it, and it should (hopefully) still be possible to complete.
ERISS: Okay thanks, I'll search trying to involve those R&R (didn't know them in the game). Or the quest is bugged.
EDIT: Oh, they are surely among those who suddenly did attack me in the fort, I didn't know why. I killed them all because I had not offended them. Then I saw about this water affair... What badly done quests here.
EDIT2: Then I met guards on a bridge, they follow me, I don't know their purpose, what to do with them.
It's possible you've done things in a non-optimal order for this series of quests. It shouldn't be a big deal, it may just mean you have less people to send to your island. Which equates to missing out on a small number of Power and/or Prosperity points, but unless you've been failing quests left and right both of these can easily be made up via building improvements without limiting your options later.
Basically, the "Roman" faction is made up of two main sub-factions, plus there are Christian zealots near the bridge, plus some refugees across the river surrounded by some small woods. Looks like you've inadvertently helped the Christians wipe out the Romans - which is a perfectly valid resolution to the quest. If the refugees are still around you may still have some options with them.
There are also the three stooges (er, craftsmen) who IIRC this particular quest was for - if you've drowned or otherwise wiped the Romans out, then go back to talk to them - you should still have some options if I'm not mistaken.