I usually put on the "kick on skip turn" equal to how many turns he has missed, then wait 5 mins and it should kick him and you can revert the skip turn back to what it was.

Where is this option?

if you are the host its in the general settings for the game.

I am the host and the game has already started. Can't find that option anywhere.

In the details page, in the Turn Timer box, there is an edit button with pencil icon, click that.
Then, this box turns in to a Modify Turn Timer box.
At the bottom of that box, there is a setting for "Kick a player after being skipped", you can type that player's skipped turn count there. Next time it is his turn, he will be kicked (at the end of turn timer I guess)

Thanks for the help, I got it working.