Do change the invitation code when someone leaves (or is banned) from the group – so that the person cannot rejoin back. Make sure that you also save the settings, else the changed invitation code does not get applied.