Built originally as a wooden fortress, it proved completely insufficient for any defence purposes and was eventually burnt down by Berber pirates. It was then replaced by a stone castle in the 16th Century, finally playing a vital role in the protection of the harbor and the town.