You can set the amount of bandits in the Mod Options area. If you're hosting a server for MP or just playing on a server rather than a single player instance, you'll have to be flagged as an Admin player and then you can adjust the mod settings in game.

For single player you can adjust all those settings before you hit launch. Just set Day One's settings to Bandits never, etc. etc.