That sounds like you are using some wrong settings in reaper. In the export options, see if you are including inserts.
I don’t use reaper at all so I have no idea where these settings are and what they look like, but you should be able to solve this within reaper from what I understand.