How do I remove a page in the middle of a score?

Well, if you have a lot of overrides in your layout, I don’t think you can do this in such a way that you won’t have some manual fix-up to do, precisely because the placement of the page overrides is completely independent of the music that flows through the music frames on those pages, by design.