They choose to live in isolation—but the world won’t leave them alone