Hello all, Let's assume i have a 28 CPU (56 cores) with 64gb RAM. I'm load-testing that box with something like this: SIPp->--\ /----> FS1 ---->FS SIPp->--/ \----> FS2 SIPp is simply sending calls with rtp to FS. FS just forward the calls to FS1 and FS2 based on some very simple decision. FS1 and FS2 simply answer and execute echo. At ~2000 channels FS fails to reply to some SIP messages, basically calls are timing out, answer ratio goes down. BUT CPU never goes over 45% on the FS and memory is ample. I don't see packe drops on the interface. FS is running in a docker. I'm wondering whether FS would use all of the available CPU or am I hitting some other limit somewhere. Any insight is welcomed! Regards, David Villasmil email: david.villasmil.work@gmail.com phone: +34669448337
Just for info. Can you try on windows? On Fri, 10 Jul 2020, 21:15 Victor, <victor.chukalovskiy@gmail.com> wrote:
any messages in the console? i recall it can sometimes hint whatever is choking.
apart from that, check core db connection and that you moved all possible db's in ram.
also there are some global limits either in var.conf. xml or switch.conf.xml
FreeSWITCH Users Help wrote:
Hello all,
Let's assume i have a 28 CPU (56 cores) with 64gb RAM. I'm load-testing that box with something like this:
SIPp->--\ /----> FS1 ---->FS SIPp->--/ \----> FS2
SIPp is simply sending calls with rtp to FS. FS just forward the calls to FS1 and FS2 based on some very simple decision. FS1 and FS2 simply answer and execute echo. At ~2000 channels FS fails to reply to some SIP messages, basically calls are timing out, answer ratio goes down. BUT CPU never goes over 45% on the FS and memory is ample. I don't see packe drops on the interface. FS is running in a docker.
I'm wondering whether FS would use all of the available CPU or am I hitting some other limit somewhere.
Any insight is welcomed!
Regards,
David Villasmil email: david.villasmil.work@gmail.com phone: +34669448337
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
Hello, What is your OS? What is your Sofia configuration? What the vmstat -w -S M 1 10 says? Can you try without Docker? Regards,Alex On Fri, 2020-07-10 at 19:53 +0100, David Villasmil wrote:
Hello all, Let's assume i have a 28 CPU (56 cores) with 64gb RAM. I'm load-testing that box with something like this:
SIPp->--\ /----> FS1 ---->FS SIPp->--/ \----> FS2
SIPp is simply sending calls with rtp to FS. FS just forward the calls to FS1 and FS2 based on some very simple decision. FS1 and FS2 simply answer and execute echo. At ~2000 channels FS fails to reply to some SIP messages, basically calls are timing out, answer ratio goes down. BUT CPU never goes over 45% on the FS and memory is ample. I don't see packe drops on the interface. FS is running in a docker.
I'm wondering whether FS would use all of the available CPU or am I hitting some other limit somewhere.
Any insight is welcomed!
Regards,
David Villasmilemail: david.villasmil.work@gmail.com phone: +34669448337
_____________________________________________________________________ ____ The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services.Build your next product on our scalable cloud platform. Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Servicessales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Siteshttps://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing listFreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
SIPP can record failed call ID Using this call-id you search for FreeSwitch logs. Also, you can record all network traffic using dumpcap or tcpdump utility to disk. Later you can open these pcap files using sngrep utility and check waht is wrong with failed calls. On Sat, Jul 11, 2020 at 5:07 AM Alex Sibyakin <alex@freeswitch.com> wrote:
Hello,
What is your OS? What is your Sofia configuration?
What the vmstat -w -S M 1 10 says?
Can you try without Docker?
Regards, Alex
On Fri, 2020-07-10 at 19:53 +0100, David Villasmil wrote:
Hello all,
Let's assume i have a 28 CPU (56 cores) with 64gb RAM. I'm load-testing that box with something like this:
SIPp->--\ /----> FS1 ---->FS SIPp->--/ \----> FS2
SIPp is simply sending calls with rtp to FS. FS just forward the calls to FS1 and FS2 based on some very simple decision. FS1 and FS2 simply answer and execute echo. At ~2000 channels FS fails to reply to some SIP messages, basically calls are timing out, answer ratio goes down. BUT CPU never goes over 45% on the FS and memory is ample. I don't see packe drops on the interface. FS is running in a docker.
I'm wondering whether FS would use all of the available CPU or am I hitting some other limit somewhere.
Any insight is welcomed!
Regards,
David Villasmil email: david.villasmil.work@gmail.com phone: +34669448337
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire
Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services.
Build your next product on our scalable cloud platform.
Join our online community to chat in real time
Professional FreeSWITCH Services
sales@freeswitch.com
Official FreeSWITCH Sites
https://freeswitch.org/confluence
FreeSWITCH-users mailing list
FreeSWITCH-users@lists.freeswitch.org
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:
http://lists.freeswitch.org/mailman/options/freeswitch-users
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
Just for info. Can you try on windows?
That does not matter. On Linux, I get results with 50 calls per second, every call continues for 24 seconds, 1000 concurrent calls, and 10 000 total calls with only 3 failed calls. Tested kazoo cluster, more complex cluster then standalone freeswitch. So must work on Linux On Sat, Jul 11, 2020 at 6:09 AM Sergey Safarov <s.safarov@gmail.com> wrote:
SIPP can record failed call ID Using this call-id you search for FreeSwitch logs. Also, you can record all network traffic using dumpcap or tcpdump utility to disk. Later you can open these pcap files using sngrep utility and check waht is wrong with failed calls.
On Sat, Jul 11, 2020 at 5:07 AM Alex Sibyakin <alex@freeswitch.com> wrote:
Hello,
What is your OS? What is your Sofia configuration?
What the vmstat -w -S M 1 10 says?
Can you try without Docker?
Regards, Alex
On Fri, 2020-07-10 at 19:53 +0100, David Villasmil wrote:
Hello all,
Let's assume i have a 28 CPU (56 cores) with 64gb RAM. I'm load-testing that box with something like this:
SIPp->--\ /----> FS1 ---->FS SIPp->--/ \----> FS2
SIPp is simply sending calls with rtp to FS. FS just forward the calls to FS1 and FS2 based on some very simple decision. FS1 and FS2 simply answer and execute echo. At ~2000 channels FS fails to reply to some SIP messages, basically calls are timing out, answer ratio goes down. BUT CPU never goes over 45% on the FS and memory is ample. I don't see packe drops on the interface. FS is running in a docker.
I'm wondering whether FS would use all of the available CPU or am I hitting some other limit somewhere.
Any insight is welcomed!
Regards,
David Villasmil email: david.villasmil.work@gmail.com phone: +34669448337
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire
Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services.
Build your next product on our scalable cloud platform.
Join our online community to chat in real time
Professional FreeSWITCH Services
sales@freeswitch.com
Official FreeSWITCH Sites
https://freeswitch.org/confluence
FreeSWITCH-users mailing list
FreeSWITCH-users@lists.freeswitch.org
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:
http://lists.freeswitch.org/mailman/options/freeswitch-users
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
I get to 2000 channels fine. My question is why can’t I higher without calls failing? FS never uses more than 40% CPU and 20 gb RAM. Config is basically vanilla, I unloaded most unnecessary modules, too. On Sat, 11 Jul 2020 at 04:59, Sergey Safarov <s.safarov@gmail.com> wrote:
Just for info. Can you try on windows?
That does not matter. On Linux, I get results with 50 calls per second, every call continues for 24 seconds, 1000 concurrent calls, and 10 000 total calls with only 3 failed calls. Tested kazoo cluster, more complex cluster then standalone freeswitch. So must work on Linux
On Sat, Jul 11, 2020 at 6:09 AM Sergey Safarov <s.safarov@gmail.com> wrote:
SIPP can record failed call ID Using this call-id you search for FreeSwitch logs. Also, you can record all network traffic using dumpcap or tcpdump utility to disk. Later you can open these pcap files using sngrep utility and check waht is wrong with failed calls.
On Sat, Jul 11, 2020 at 5:07 AM Alex Sibyakin <alex@freeswitch.com> wrote:
Hello,
What is your OS? What is your Sofia configuration?
What the vmstat -w -S M 1 10 says?
Can you try without Docker?
Regards, Alex
On Fri, 2020-07-10 at 19:53 +0100, David Villasmil wrote:
Hello all,
Let's assume i have a 28 CPU (56 cores) with 64gb RAM. I'm load-testing that box with something like this:
SIPp->--\ /----> FS1 ---->FS SIPp->--/ \----> FS2
SIPp is simply sending calls with rtp to FS. FS just forward the calls to FS1 and FS2 based on some very simple decision. FS1 and FS2 simply answer and execute echo. At ~2000 channels FS fails to reply to some SIP messages, basically calls are timing out, answer ratio goes down. BUT CPU never goes over 45% on the FS and memory is ample. I don't see packe drops on the interface. FS is running in a docker.
I'm wondering whether FS would use all of the available CPU or am I hitting some other limit somewhere.
Any insight is welcomed!
Regards,
David Villasmil email: david.villasmil.work@gmail.com phone: +34669448337
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire
Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services.
Build your next product on our scalable cloud platform.
Join our online community to chat in real time
Professional FreeSWITCH Services
sales@freeswitch.com
Official FreeSWITCH Sites
https://freeswitch.org/confluence
FreeSWITCH-users mailing list
FreeSWITCH-users@lists.freeswitch.org
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:
http://lists.freeswitch.org/mailman/options/freeswitch-users
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
-- Regards, David Villasmil email: david.villasmil.work@gmail.com phone: +34669448337
Need looks FreeSwitch logs. On Sat, Jul 11, 2020 at 12:53 PM David Villasmil < david.villasmil.work@gmail.com> wrote:
I get to 2000 channels fine. My question is why can’t I higher without calls failing? FS never uses more than 40% CPU and 20 gb RAM. Config is basically vanilla, I unloaded most unnecessary modules, too.
On Sat, 11 Jul 2020 at 04:59, Sergey Safarov <s.safarov@gmail.com> wrote:
Just for info. Can you try on windows?
That does not matter. On Linux, I get results with 50 calls per second, every call continues for 24 seconds, 1000 concurrent calls, and 10 000 total calls with only 3 failed calls. Tested kazoo cluster, more complex cluster then standalone freeswitch. So must work on Linux
On Sat, Jul 11, 2020 at 6:09 AM Sergey Safarov <s.safarov@gmail.com> wrote:
SIPP can record failed call ID Using this call-id you search for FreeSwitch logs. Also, you can record all network traffic using dumpcap or tcpdump utility to disk. Later you can open these pcap files using sngrep utility and check waht is wrong with failed calls.
On Sat, Jul 11, 2020 at 5:07 AM Alex Sibyakin <alex@freeswitch.com> wrote:
Hello,
What is your OS? What is your Sofia configuration?
What the vmstat -w -S M 1 10 says?
Can you try without Docker?
Regards, Alex
On Fri, 2020-07-10 at 19:53 +0100, David Villasmil wrote:
Hello all,
Let's assume i have a 28 CPU (56 cores) with 64gb RAM. I'm load-testing that box with something like this:
SIPp->--\ /----> FS1 ---->FS SIPp->--/ \----> FS2
SIPp is simply sending calls with rtp to FS. FS just forward the calls to FS1 and FS2 based on some very simple decision. FS1 and FS2 simply answer and execute echo. At ~2000 channels FS fails to reply to some SIP messages, basically calls are timing out, answer ratio goes down. BUT CPU never goes over 45% on the FS and memory is ample. I don't see packe drops on the interface. FS is running in a docker.
I'm wondering whether FS would use all of the available CPU or am I hitting some other limit somewhere.
Any insight is welcomed!
Regards,
David Villasmil email: david.villasmil.work@gmail.com phone: +34669448337
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire
Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services.
Build your next product on our scalable cloud platform.
Join our online community to chat in real time
Professional FreeSWITCH Services
sales@freeswitch.com
Official FreeSWITCH Sites
https://freeswitch.org/confluence
FreeSWITCH-users mailing list
FreeSWITCH-users@lists.freeswitch.org
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:
http://lists.freeswitch.org/mailman/options/freeswitch-users
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
-- Regards,
David Villasmil email: david.villasmil.work@gmail.com phone: +34669448337 _________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
Have you checked the max-sessions (switch.conf.xml) and the ulimits etc (OS level)? On Sat, Jul 11, 2020 at 03:45 Sergey Safarov <s.safarov@gmail.com> wrote:
Need looks FreeSwitch logs.
On Sat, Jul 11, 2020 at 12:53 PM David Villasmil < david.villasmil.work@gmail.com> wrote:
I get to 2000 channels fine. My question is why can’t I higher without calls failing? FS never uses more than 40% CPU and 20 gb RAM. Config is basically vanilla, I unloaded most unnecessary modules, too.
On Sat, 11 Jul 2020 at 04:59, Sergey Safarov <s.safarov@gmail.com> wrote:
Just for info. Can you try on windows?
That does not matter. On Linux, I get results with 50 calls per second, every call continues for 24 seconds, 1000 concurrent calls, and 10 000 total calls with only 3 failed calls. Tested kazoo cluster, more complex cluster then standalone freeswitch. So must work on Linux
On Sat, Jul 11, 2020 at 6:09 AM Sergey Safarov <s.safarov@gmail.com> wrote:
SIPP can record failed call ID Using this call-id you search for FreeSwitch logs. Also, you can record all network traffic using dumpcap or tcpdump utility to disk. Later you can open these pcap files using sngrep utility and check waht is wrong with failed calls.
On Sat, Jul 11, 2020 at 5:07 AM Alex Sibyakin <alex@freeswitch.com> wrote:
Hello,
What is your OS? What is your Sofia configuration?
What the vmstat -w -S M 1 10 says?
Can you try without Docker?
Regards, Alex
On Fri, 2020-07-10 at 19:53 +0100, David Villasmil wrote:
Hello all,
Let's assume i have a 28 CPU (56 cores) with 64gb RAM. I'm load-testing that box with something like this:
SIPp->--\ /----> FS1 ---->FS SIPp->--/ \----> FS2
SIPp is simply sending calls with rtp to FS. FS just forward the calls to FS1 and FS2 based on some very simple decision. FS1 and FS2 simply answer and execute echo. At ~2000 channels FS fails to reply to some SIP messages, basically calls are timing out, answer ratio goes down. BUT CPU never goes over 45% on the FS and memory is ample. I don't see packe drops on the interface. FS is running in a docker.
I'm wondering whether FS would use all of the available CPU or am I hitting some other limit somewhere.
Any insight is welcomed!
Regards,
David Villasmil email: david.villasmil.work@gmail.com phone: +34669448337
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire
Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services.
Build your next product on our scalable cloud platform.
Join our online community to chat in real time
Professional FreeSWITCH Services
sales@freeswitch.com
Official FreeSWITCH Sites
https://freeswitch.org/confluence
FreeSWITCH-users mailing list
FreeSWITCH-users@lists.freeswitch.org
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:
http://lists.freeswitch.org/mailman/options/freeswitch-users
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
-- Regards,
David Villasmil email: david.villasmil.work@gmail.com phone: +34669448337 _________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
Hi, fs_cli -x "status" should show the actual set value and the peak of max current session. And don't forget if you bridge a and b leg it used two sessions. Kind regards Karsten Joel Serrano <joel@textplus.com> schrieb am Sa., 11. Juli 2020, 20:09:
Have you checked the max-sessions (switch.conf.xml) and the ulimits etc (OS level)?
On Sat, Jul 11, 2020 at 03:45 Sergey Safarov <s.safarov@gmail.com> wrote:
Need looks FreeSwitch logs.
On Sat, Jul 11, 2020 at 12:53 PM David Villasmil < david.villasmil.work@gmail.com> wrote:
I get to 2000 channels fine. My question is why can’t I higher without calls failing? FS never uses more than 40% CPU and 20 gb RAM. Config is basically vanilla, I unloaded most unnecessary modules, too.
On Sat, 11 Jul 2020 at 04:59, Sergey Safarov <s.safarov@gmail.com> wrote:
Just for info. Can you try on windows?
That does not matter. On Linux, I get results with 50 calls per second, every call continues for 24 seconds, 1000 concurrent calls, and 10 000 total calls with only 3 failed calls. Tested kazoo cluster, more complex cluster then standalone freeswitch. So must work on Linux
On Sat, Jul 11, 2020 at 6:09 AM Sergey Safarov <s.safarov@gmail.com> wrote:
SIPP can record failed call ID Using this call-id you search for FreeSwitch logs. Also, you can record all network traffic using dumpcap or tcpdump utility to disk. Later you can open these pcap files using sngrep utility and check waht is wrong with failed calls.
On Sat, Jul 11, 2020 at 5:07 AM Alex Sibyakin <alex@freeswitch.com> wrote:
Hello,
What is your OS? What is your Sofia configuration?
What the vmstat -w -S M 1 10 says?
Can you try without Docker?
Regards, Alex
On Fri, 2020-07-10 at 19:53 +0100, David Villasmil wrote:
Hello all,
Let's assume i have a 28 CPU (56 cores) with 64gb RAM. I'm load-testing that box with something like this:
SIPp->--\ /----> FS1 ---->FS SIPp->--/ \----> FS2
SIPp is simply sending calls with rtp to FS. FS just forward the calls to FS1 and FS2 based on some very simple decision. FS1 and FS2 simply answer and execute echo. At ~2000 channels FS fails to reply to some SIP messages, basically calls are timing out, answer ratio goes down. BUT CPU never goes over 45% on the FS and memory is ample. I don't see packe drops on the interface. FS is running in a docker.
I'm wondering whether FS would use all of the available CPU or am I hitting some other limit somewhere.
Any insight is welcomed!
Regards,
David Villasmil email: david.villasmil.work@gmail.com phone: +34669448337
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire
Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services.
Build your next product on our scalable cloud platform.
Join our online community to chat in real time
Professional FreeSWITCH Services
sales@freeswitch.com
Official FreeSWITCH Sites
https://freeswitch.org/confluence
FreeSWITCH-users mailing list
FreeSWITCH-users@lists.freeswitch.org
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:
http://lists.freeswitch.org/mailman/options/freeswitch-users
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
-- Regards,
David Villasmil email: david.villasmil.work@gmail.com phone: +34669448337 _________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
Perhaps an issue in packet throughput (packets-per-second) on the NIC or any virtualized driver levels? -- Craig On Sat, Jul 11, 2020 at 10:57 AM Joel Serrano <joel@textplus.com> wrote:
Have you checked the max-sessions (switch.conf.xml) and the ulimits etc (OS level)?
On Sat, Jul 11, 2020 at 03:45 Sergey Safarov <s.safarov@gmail.com> wrote:
Need looks FreeSwitch logs.
On Sat, Jul 11, 2020 at 12:53 PM David Villasmil < david.villasmil.work@gmail.com> wrote:
I get to 2000 channels fine. My question is why can’t I higher without calls failing? FS never uses more than 40% CPU and 20 gb RAM. Config is basically vanilla, I unloaded most unnecessary modules, too.
On Sat, 11 Jul 2020 at 04:59, Sergey Safarov <s.safarov@gmail.com> wrote:
Just for info. Can you try on windows?
That does not matter. On Linux, I get results with 50 calls per second, every call continues for 24 seconds, 1000 concurrent calls, and 10 000 total calls with only 3 failed calls. Tested kazoo cluster, more complex cluster then standalone freeswitch. So must work on Linux
On Sat, Jul 11, 2020 at 6:09 AM Sergey Safarov <s.safarov@gmail.com> wrote:
SIPP can record failed call ID Using this call-id you search for FreeSwitch logs. Also, you can record all network traffic using dumpcap or tcpdump utility to disk. Later you can open these pcap files using sngrep utility and check waht is wrong with failed calls.
On Sat, Jul 11, 2020 at 5:07 AM Alex Sibyakin <alex@freeswitch.com> wrote:
Hello,
What is your OS? What is your Sofia configuration?
What the vmstat -w -S M 1 10 says?
Can you try without Docker?
Regards, Alex
On Fri, 2020-07-10 at 19:53 +0100, David Villasmil wrote:
Hello all,
Let's assume i have a 28 CPU (56 cores) with 64gb RAM. I'm load-testing that box with something like this:
SIPp->--\ /----> FS1 ---->FS SIPp->--/ \----> FS2
SIPp is simply sending calls with rtp to FS. FS just forward the calls to FS1 and FS2 based on some very simple decision. FS1 and FS2 simply answer and execute echo. At ~2000 channels FS fails to reply to some SIP messages, basically calls are timing out, answer ratio goes down. BUT CPU never goes over 45% on the FS and memory is ample. I don't see packe drops on the interface. FS is running in a docker.
I'm wondering whether FS would use all of the available CPU or am I hitting some other limit somewhere.
Any insight is welcomed!
Regards,
David Villasmil email: david.villasmil.work@gmail.com phone: +34669448337
_________________________________________________________________________
-- Regards,
David Villasmil email: david.villasmil.work@gmail.com phone: +34669448337 _________________________________________________________________________
On Sat, 11 Jul 2020 10:37:39 -0700 Joel Serrano <joel@textplus.com> wrote:
Have you checked the max-sessions (switch.conf.xml) and the ulimits etc (OS level)?
Pay particular attention to your open file limits (ulimit -n), traditionally on Linux this has defaulted to 1024 per process. Of course if you're getting to 2000 connections then you likely have a higher limit than 1024, perhaps 4096 or some such and if FS is using 2 sockets per connection... The simplest way to check what limits a process is currently using is to look in /proc/PID/limits, where PID is the process id of the process you want to examine. Look for the 'Max open file' line. The 'soft' limit is what is currently in use. There are numerous ways of changing these, if you are on a semi-recent distro check the prlimit(1) command. Cheers, Andrew
Hello guys, One of the terminators was running on a 100mb NIC and that was limiting the calls. Thanks On Fri, 24 Jul 2020 at 18:23, Andrew Clayton <andrew@zeta.digital-domain.net> wrote:
On Sat, 11 Jul 2020 10:37:39 -0700 Joel Serrano <joel@textplus.com> wrote:
Have you checked the max-sessions (switch.conf.xml) and the ulimits etc (OS level)?
Pay particular attention to your open file limits (ulimit -n), traditionally on Linux this has defaulted to 1024 per process.
Of course if you're getting to 2000 connections then you likely have a higher limit than 1024, perhaps 4096 or some such and if FS is using 2 sockets per connection...
The simplest way to check what limits a process is currently using is to look in /proc/PID/limits, where PID is the process id of the process you want to examine. Look for the 'Max open file' line.
The 'soft' limit is what is currently in use.
There are numerous ways of changing these, if you are on a semi-recent distro check the prlimit(1) command.
Cheers, Andrew
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
-- Regards, David Villasmil email: david.villasmil.work@gmail.com phone: +34669448337
Out of curiosity, what are your real results after solving the problem? On Fri, Jul 24, 2020 at 17:26 David Villasmil < david.villasmil.work@gmail.com> wrote:
Hello guys,
One of the terminators was running on a 100mb NIC and that was limiting the calls.
Thanks
On Fri, 24 Jul 2020 at 18:23, Andrew Clayton < andrew@zeta.digital-domain.net> wrote:
On Sat, 11 Jul 2020 10:37:39 -0700 Joel Serrano <joel@textplus.com> wrote:
Have you checked the max-sessions (switch.conf.xml) and the ulimits etc (OS level)?
Pay particular attention to your open file limits (ulimit -n), traditionally on Linux this has defaulted to 1024 per process.
Of course if you're getting to 2000 connections then you likely have a higher limit than 1024, perhaps 4096 or some such and if FS is using 2 sockets per connection...
The simplest way to check what limits a process is currently using is to look in /proc/PID/limits, where PID is the process id of the process you want to examine. Look for the 'Max open file' line.
The 'soft' limit is what is currently in use.
There are numerous ways of changing these, if you are on a semi-recent distro check the prlimit(1) command.
Cheers, Andrew
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
-- Regards,
David Villasmil email: david.villasmil.work@gmail.com phone: +34669448337 _________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
We’re testing on 48 cores 64gb and reaching ~3500 channels before ASR starts dropping (this is a simple call forward to 2 different receivers. No transcoding, no recording, nothing.). ~80-90% CPU not very high memory, ~20gb. At this point I’m seeing packets not being replied, timeouts, etc. but i can’t yet blame FS because it might well be on the receivers... it’s an ongoing load-test. On Sat, 25 Jul 2020 at 02:53, Joel Serrano <joel@textplus.com> wrote:
Out of curiosity, what are your real results after solving the problem?
On Fri, Jul 24, 2020 at 17:26 David Villasmil < david.villasmil.work@gmail.com> wrote:
Hello guys,
One of the terminators was running on a 100mb NIC and that was limiting the calls.
Thanks
On Fri, 24 Jul 2020 at 18:23, Andrew Clayton < andrew@zeta.digital-domain.net> wrote:
On Sat, 11 Jul 2020 10:37:39 -0700 Joel Serrano <joel@textplus.com> wrote:
Have you checked the max-sessions (switch.conf.xml) and the ulimits etc (OS level)?
Pay particular attention to your open file limits (ulimit -n), traditionally on Linux this has defaulted to 1024 per process.
Of course if you're getting to 2000 connections then you likely have a higher limit than 1024, perhaps 4096 or some such and if FS is using 2 sockets per connection...
The simplest way to check what limits a process is currently using is to look in /proc/PID/limits, where PID is the process id of the process you want to examine. Look for the 'Max open file' line.
The 'soft' limit is what is currently in use.
There are numerous ways of changing these, if you are on a semi-recent distro check the prlimit(1) command.
Cheers, Andrew
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
-- Regards,
David Villasmil email: david.villasmil.work@gmail.com phone: +34669448337 _________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
_________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
-- Regards, David Villasmil email: david.villasmil.work@gmail.com phone: +34669448337
Hi David, You don’t perhaps have the “max-sessions” in your switch.conf.xml left at the default 1000? Best Regards Keith
On 10 Jul 2020, at 20:53, David Villasmil <david.villasmil.work@gmail.com> wrote:
Hello all,
Let's assume i have a 28 CPU (56 cores) with 64gb RAM. I'm load-testing that box with something like this:
SIPp->--\ /----> FS1 ---->FS SIPp->--/ \----> FS2
SIPp is simply sending calls with rtp to FS. FS just forward the calls to FS1 and FS2 based on some very simple decision. FS1 and FS2 simply answer and execute echo. At ~2000 channels FS fails to reply to some SIP messages, basically calls are timing out, answer ratio goes down. BUT CPU never goes over 45% on the FS and memory is ample. I don't see packe drops on the interface. FS is running in a docker.
I'm wondering whether FS would use all of the available CPU or am I hitting some other limit somewhere.
Any insight is welcomed!
Regards,
David Villasmil email: david.villasmil.work@gmail.com <mailto:david.villasmil.work@gmail.com> phone: +34669448337 _________________________________________________________________________
The FreeSWITCH project is sponsored by SignalWire https://signalwire.com Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services. Build your next product on our scalable cloud platform.
Join our online community to chat in real time https://signalwire.community
Professional FreeSWITCH Services sales@freeswitch.com https://freeswitch.com
Official FreeSWITCH Sites https://freeswitch.com/oss https://freeswitch.org/confluence https://cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users https://freeswitch.com
participants (10)
-
Alex Sibyakin
-
Andrew Clayton
-
Craig Stevenson
-
David Villasmil
-
Gregor Nanger
-
Joel Serrano
-
Karsten Horsmann
-
Keith Laaks
-
Sergey Safarov
-
Victor