Okay, looking a little closer its probably related to the Figure Head trait which states "This character has vary little power due to the system of government in his realm and has the pilgrimage effect."

That being said I don't know why exactly I have this trait since I have the basic feudal government type. So not sure quiet how to deal with it. :|