Do you have auto designs on? That's the only way that your selected design would be overwritten.

I do, so that would affect the visuals as well then?

The visuals are tied to the section you use. Each section has a weighting that scales with its tech level.

Auto-designing will select the highest weighted section.

There's no real way to stop that, without the game letting the AI use sub-optimal designs.