A Heavy Storm
Apparently, there was a massive storm on the night the ships set sail. The majority of the fleet made it past the Keys before the storm hit, but the ones who left later were caught in the midst of the storm and didn’t manage to make it out.
They’ve been there since the 16th century!