There's no way Imu can just make anyone her subordinate. Her contract is probably made with king harold and the giant pirates (old). The old giant pirates might even just be unaware but because they trusted harold, they got roped in somehow. Loki's backstory will probably reveal everything.