You need to either convert and culture shift the province or purge/expel the dominant race in the province and wait for an event that inserts your race/religion along with a contingent of dwarven population. Either way it can take a while to get the job done if rng isn't favorable.