It has NOTHING at all to do with the ext-sip-ip and ext-rtp-ip settings, If you don't want outside access then block it at your nat/firewall.