I believe every lord or hero you recruit has a negative impact on your economy until you invest a skill point in maintenance. That includes disbanded lords idling in your recruitment pool. The only way to get rid of the penalty is via the skill tree or getting the character killed (not wounded).

Quickly spamming lords/heroes like in vanilla can quickly mess up your economy.