Load and Unload VST in the Manager

Of course it can. You only have to load what you need for a project. Personally I handle it by having templates with the various instruments I might use present but the tracks are disabled (and hidden) so the VSTis don’t load.

Alternatively start with a blank project and load what you need.

Unless I’ve misunderstood your request?