1. Which codecs are being used? Do you perform any transcoding in FS?
2. If no transcoding is done, maybe you could enable "proxy-media" for a moment http://wiki.freeswitch.org/wiki/Proxy_Media and check again whether the RTP is changed or not by FS, at this time.