Make sure its going to the ports that are advertised in the sdp and that there are no nat or firewall issues in between.