Afaik theres a problematic code in the Game which is checking if you have the specific Charakter hired or the specific tool of that character for most of the Perks thats why there are no good Mods for that so far.
Most Perks just won't work with an self created IMP thats the big problem here.
A solution would be self created Perks which are similiar or weakend versions of the Original ones if thats possible.

Oh interesting. As i have seen a combination of mods that seem to allow for that. But that combination lacks on other parts.

So it did appear doable. Had no clue they would protect all their stuff this intensely. Guess you'd need to make mods that bring in new perks especially for IMPs then.