How exactly do you recruit Lords into your party? From what I've read it's possible, but I'm not sure how. I want to recruit the Divine Physician guy and I've got his relationship at 100 from gifts and I did his mind reading quest (took a bunch of tries). What else do I need to do? I'm not in his faction if that matters, and I have more renown than him and 25+ honor.

edit: nevermind, you do have to be part of the same faction. I suppose that's obvious but you never know.