I get it! The ancestors remained on the treasure island in case if the ishigami ancestors didn't make it in the ocean voyage, kinda like how Senku and co does it now. Even though the possibility of a threat on the island still remains, but sending Soyuz as a baby to the Ishigami village might...