After you’ve done what you said in the 1st paragraph, apply the function “Set definition from tempo” to the audio (I think it’s in the Sample Editor chapter, but you can search in the .pdf to find it).
Then, you can turn the tempo track on, type the desired fixed tempo, and the audio will play back at that steady tempo.
(I think the 1st link in my sig goes into more detail).