Harlaus was still hanging around in the Swadian faction even though I finished Isolla's quest. He was still named "King Harlaus", and was a count under Isolla. Never seen this and always assumed the old leader disappeared forever, or at least that's how I thought it was supposed to work.