You always have the desync when the game lag or sometimes it randomly happens? Thanks

Try turning debris lifetime down to low, should help a lot there. And anyway you should be collecting the debris for RU's, the boost you get from it is really helpful when you are trying to rush-build a fortress/BC.