Lore wise, it makes sense for this to be the case, you aren't just not part of the hive, you're worse than dirt as far as the hive proper is concerned. You live without a queen, and as far as the hive is concerned that is an abomination against everything they know and love, Your very existence makes them uncomfortable. The caravans only take pity on you because they are experiencing the beginnings of the same disconnect that separated you from the hive to begin with, but back within the hive proper those feelings of resentment are reinforced, so they don't want you around.
I'd say for the sake of the world lore, this base mod shouldn't be changed, but it is relatively easy for you to make some minor changes in the FCS and alter it however you want.
Personally, I don't like playing hive without a queen, so I use a combination of this, the "clean queen" mod, the "Lost Hive" mod, the "Hive Village Pack" mod, and a little bit of FCS modifications to start with easy access to the relevant recipe books

loot a southern hive village, there were recipes in the barrels of their huts