I’m not 100% sure of the problem you are having ? But I don’t think I’m having any similar issues
did you use the “remove vst connect” menu item ? - this takes out all the plugins but doesn’t change the "Audio Connections (F4)
Are you using the Control Room when you are not using VST connect ?