Markers change position when changing tempo

You might take a leaf out of Alan Silvestri’s book, since your process is, I guess, similar to his. He uses system-attached text rather than “real” markers for this kind of thing, since system-attached text doesn’t move when the tempo changes.