After taking a castle/city i typically leave it unassigned until later. This gives a small garrison of ~30 men. Later on when I assign it to a lord, they do not increase the garrison at all, even given months of ingame time. I award them with surrounding villages as well, in case that matters. Surely this can't be working as intended?