Make sure you select in the Pages panel only the page whose override you want to remove, and in the right-click menu choose Remove Page Override(s) and not Remove All Page Overrides.
Make sure you select in the Pages panel only the page whose override you want to remove, and in the right-click menu choose Remove Page Override(s) and not Remove All Page Overrides.