A restart of the game usually is sufficient to prevent new ones from spawning.Not entirely sure but I was under the impression that the universe needed to be reset for that change to be applied to the server config. I remember hearing this a while back... maybe even on the old forums.