If you’re fiddling with individual systems’ staff spacing on a regular basis, you could probably do with making some global changes in Layout Options > Vertical spacing.
The Casting Off feature is really designed for individual parts (with the same number of staffs on each system). Using it in scores with varying numbers of staves in a system leads to just the sort of headache you’ve mentioned!