I believe there's an issue with FS's ICE implementation. Others seem to have noticed the same problem (see http://lists.freeswitch.org/pipermail/freeswitch-users/2014-June/105877.html)

Is it possible to tweak and/or turn off ICE in FS?

Thanks