Dear list, I've been playing with freeswitch for some time (2 months) and the fact is that I'm very pleased with the functionnalities of this software. I'd like to use FS as a SBC handling media and I'm doing some tests with sipp to load the machine but I'm unable to bridge more than 60 calls without seeing the CPU being loaded at 100%. I'm sure something is going wrong with my setup but I'm unable to see what. The test machine has the following specs: Athlon XP 3500+ with 2GB of memory (I know this is not a high end machine :p) Freeswitch:/opt/freeswitch/log# cat /proc/cpuinfo processor : 0 vendor_id : AuthenticAMD cpu family : 15 model : 95 model name : AMD Athlon(tm) 64 Processor 3500+ stepping : 2 cpu MHz : 2199.973 cache size : 512 KB fpu : yes fpu_exception : yes cpuid level : 1 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt rdtscp lm 3dnowext 3dnow up rep_good pni cx16 lahf_lm svm extapic cr8_legacy bogomips : 4402.97 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management: ts fid vid ttp tm stc I installed FS on a fresh debian 64: Linux Freeswitch 2.6.26-1-amd64 #1 SMP Sat Jan 10 17:57:00 UTC 2009 x86_64 GNU/Linux I set the ulimit parameters like those on the website: freeswitch@internal> ... Freeswitch:/opt/free-svn/bin# ulimit -a core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 999999 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) unlimited real-time priority (-r) 0 stack size (kbytes, -s) 244 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited My network setup is the following: SIPP machine (10.10.10.1/24)----------------vlan 55 ----------(10.10.10.254/24) FS (10.10.20.254/24)-------------- vlan56 -------------------(10.10.20.100/24) OTHER STOCK FS I launched sipp with: sipp -sn uac_pcap -s 9999 -r 10 -l 80 -d 60000 -mi 10.10.10.1 -i 10.10.10.1 -mp 25000 10.10.10.254:5060 The dialplan on FS is very simple: <?xml version="1.0" encoding="utf-8"?> <!-- http://wiki.freeswitch.org/wiki/Dialplan_XML --> <include> <context name="default"> <extension name="hold_music_bridge"> <condition field="destination_number" expression="^9999$"> <action application="answer"/> <action application="bridge" data="sofia/external/9999@10.10.20.100"/> </condition> </extension> </context> </include> FreeSWITCH Version 1.0.trunk (11560M) Started. Crash Protection [Disabled] Max Sessions[1000] Session Rate[100] SQL [Enabled] The test is very simple: sipp dial 9999 that matches in my FS dialplan and this is bridged to an other FS machine playing music on hold. When I launch "top" I see after 30 to 40 s that FS consumes all the CPU ressources (with a mean of 50-60 % before), with 80 calls. When I set 70 calls, I have to wait 70-80 s before seeing the same issue. Presence is set to false on the 2 profile. I have the same issue with FS 1.0.2 that' s why I tried FS 11560. When I use the FS machine as a router to test the packet per second performance, I'm reaching 100Mbps with 8000pps in each direction (from vlan 55 to vlan56) with less than 12% CPU. So that I don't think there's an issue with the network. Here is an "mpstat -P ALL 1" to show you what's happening suddenly with 70 bridge calls: 12:31:26 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:27 all 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00 12:31:27 0 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00 12:31:27 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:28 all 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35 12:31:28 0 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35 12:31:28 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:29 all 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17 12:31:29 0 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17 The CPU is going from 89% idle to 0% in less than 2 seconds. I know that I don't have to expect too much from this kind of hardware, but it seems strange that the CPU power vanished so suddenly. Thanks a lot for the guys that have read this long mail :p kind regards, rod
Which of the 2 machines has the load issue? You said it was one box calling the other. You have 2 major things against you, single CPU and AMD, but you should at least be able to get in the vicinity of 800-1000 calls on a box like that. Are you calling the default 9999? It's not really an appropriate extension for load testing. On the terminating box you should set up a manual extension that is the first one in the dial plan to play a wav file from preferably a ram disk or /tmp If you do plan on using this in production accept nothing less than a multi-core intel machine with at least 4 cores, the more cores the better because that parallel processing is where FS gets it's atvantage. On Fri, Jan 30, 2009 at 5:56 AM, rod <kawarod@laposte.net> wrote:
Dear list,
I've been playing with freeswitch for some time (2 months) and the fact is that I'm very pleased with the functionnalities of this software.
I'd like to use FS as a SBC handling media and I'm doing some tests with sipp to load the machine but I'm unable to bridge more than 60 calls without seeing the CPU being loaded at 100%. I'm sure something is going wrong with my setup but I'm unable to see what.
The test machine has the following specs: Athlon XP 3500+ with 2GB of memory (I know this is not a high end machine :p)
Freeswitch:/opt/freeswitch/log# cat /proc/cpuinfo processor : 0 vendor_id : AuthenticAMD cpu family : 15 model : 95 model name : AMD Athlon(tm) 64 Processor 3500+ stepping : 2 cpu MHz : 2199.973 cache size : 512 KB fpu : yes fpu_exception : yes cpuid level : 1 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt rdtscp lm 3dnowext 3dnow up rep_good pni cx16 lahf_lm svm extapic cr8_legacy bogomips : 4402.97 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management: ts fid vid ttp tm stc
I installed FS on a fresh debian 64: Linux Freeswitch 2.6.26-1-amd64 #1 SMP Sat Jan 10 17:57:00 UTC 2009 x86_64 GNU/Linux
I set the ulimit parameters like those on the website: freeswitch@internal> ... Freeswitch:/opt/free-svn/bin# ulimit -a core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 999999 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) unlimited real-time priority (-r) 0 stack size (kbytes, -s) 244 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited
My network setup is the following:
SIPP machine (10.10.10.1/24)----------------vlan<http://10.10.10.1/24%29----------------vlan>55 ----------(10.10.10.254/24) FS (10.10.20.254/24)--------------<http://10.10.20.254/24%29-------------->vlan56 -------------------(10.10.20.100/24) OTHER STOCK FS
I launched sipp with: sipp -sn uac_pcap -s 9999 -r 10 -l 80 -d 60000 -mi 10.10.10.1 -i 10.10.10.1 -mp 25000 10.10.10.254:5060
The dialplan on FS is very simple: <?xml version="1.0" encoding="utf-8"?> <!-- http://wiki.freeswitch.org/wiki/Dialplan_XML --> <include> <context name="default">
<extension name="hold_music_bridge"> <condition field="destination_number" expression="^9999$"> <action application="answer"/> <action application="bridge" data="sofia/external/9999@10.10.20.100"/> </condition> </extension> </context>
</include>
FreeSWITCH Version 1.0.trunk (11560M) Started. Crash Protection [Disabled] Max Sessions[1000] Session Rate[100] SQL [Enabled]
The test is very simple: sipp dial 9999 that matches in my FS dialplan and this is bridged to an other FS machine playing music on hold. When I launch "top" I see after 30 to 40 s that FS consumes all the CPU ressources (with a mean of 50-60 % before), with 80 calls. When I set 70 calls, I have to wait 70-80 s before seeing the same issue.
Presence is set to false on the 2 profile.
I have the same issue with FS 1.0.2 that' s why I tried FS 11560.
When I use the FS machine as a router to test the packet per second performance, I'm reaching 100Mbps with 8000pps in each direction (from vlan 55 to vlan56) with less than 12% CPU. So that I don't think there's an issue with the network.
Here is an "mpstat -P ALL 1" to show you what's happening suddenly with 70 bridge calls: 12:31:26 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:27 all 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00 12:31:27 0 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00
12:31:27 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:28 all 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35 12:31:28 0 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35
12:31:28 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:29 all 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17 12:31:29 0 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17
The CPU is going from 89% idle to 0% in less than 2 seconds.
I know that I don't have to expect too much from this kind of hardware, but it seems strange that the CPU power vanished so suddenly.
Thanks a lot for the guys that have read this long mail :p
kind regards, rod
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Anthony Minessale II FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/ AIM: anthm MSN:anthony_minessale@hotmail.com <MSN%3Aanthony_minessale@hotmail.com> GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com<PAYPAL%3Aanthony.minessale@gmail.com> IRC: irc.freenode.net #freeswitch FreeSWITCH Developer Conference sip:888@conference.freeswitch.org <sip%3A888@conference.freeswitch.org> iax:guest@conference.freeswitch.org/888 googletalk:conf+888@conference.freeswitch.org<googletalk%3Aconf%2B888@conference.freeswitch.org> pstn:213-799-1400
Given the choice between dual core and dual processor, would one work better than the other for FS? Assuming roughly the same speed. Or would it not really have a measurable difference assuming same speed and both Intel? Anthony Minessale wrote:
Which of the 2 machines has the load issue? You said it was one box calling the other.
You have 2 major things against you, single CPU and AMD, but you should at least be able to get in the vicinity of 800-1000 calls on a box like that.
Are you calling the default 9999? It's not really an appropriate extension for load testing. On the terminating box you should set up a manual extension that is the first one in the dial plan to play a wav file from preferably a ram disk or /tmp
If you do plan on using this in production accept nothing less than a multi-core intel machine with at least 4 cores, the more cores the better because that parallel processing is where FS gets it's atvantage.
On Fri, Jan 30, 2009 at 5:56 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net>> wrote:
Dear list,
I've been playing with freeswitch for some time (2 months) and the fact is that I'm very pleased with the functionnalities of this software.
I'd like to use FS as a SBC handling media and I'm doing some tests with sipp to load the machine but I'm unable to bridge more than 60 calls without seeing the CPU being loaded at 100%. I'm sure something is going wrong with my setup but I'm unable to see what.
The test machine has the following specs: Athlon XP 3500+ with 2GB of memory (I know this is not a high end machine :p)
Freeswitch:/opt/freeswitch/log# cat /proc/cpuinfo processor : 0 vendor_id : AuthenticAMD cpu family : 15 model : 95 model name : AMD Athlon(tm) 64 Processor 3500+ stepping : 2 cpu MHz : 2199.973 cache size : 512 KB fpu : yes fpu_exception : yes cpuid level : 1 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt rdtscp lm 3dnowext 3dnow up rep_good pni cx16 lahf_lm svm extapic cr8_legacy bogomips : 4402.97 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management: ts fid vid ttp tm stc
I installed FS on a fresh debian 64: Linux Freeswitch 2.6.26-1-amd64 #1 SMP Sat Jan 10 17:57:00 UTC 2009 x86_64 GNU/Linux
I set the ulimit parameters like those on the website: freeswitch@internal> ... Freeswitch:/opt/free-svn/bin# ulimit -a core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 999999 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) unlimited real-time priority (-r) 0 stack size (kbytes, -s) 244 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited
My network setup is the following:
SIPP machine (10.10.10.1/24)----------------vlan <http://10.10.10.1/24%29----------------vlan> 55 ----------(10.10.10.254/24 <http://10.10.10.254/24>) FS (10.10.20.254/24)-------------- <http://10.10.20.254/24%29--------------> vlan56 -------------------(10.10.20.100/24 <http://10.10.20.100/24>) OTHER STOCK FS
I launched sipp with: sipp -sn uac_pcap -s 9999 -r 10 -l 80 -d 60000 -mi 10.10.10.1 -i 10.10.10.1 -mp 25000 10.10.10.254:5060 <http://10.10.10.254:5060>
The dialplan on FS is very simple: <?xml version="1.0" encoding="utf-8"?> <!-- http://wiki.freeswitch.org/wiki/Dialplan_XML --> <include> <context name="default">
<extension name="hold_music_bridge"> <condition field="destination_number" expression="^9999$"> <action application="answer"/> <action application="bridge" data="sofia/external/9999@10.10.20.100 <mailto:9999@10.10.20.100>"/> </condition> </extension> </context>
</include>
FreeSWITCH Version 1.0.trunk (11560M) Started. Crash Protection [Disabled] Max Sessions[1000] Session Rate[100] SQL [Enabled]
The test is very simple: sipp dial 9999 that matches in my FS dialplan and this is bridged to an other FS machine playing music on hold. When I launch "top" I see after 30 to 40 s that FS consumes all the CPU ressources (with a mean of 50-60 % before), with 80 calls. When I set 70 calls, I have to wait 70-80 s before seeing the same issue.
Presence is set to false on the 2 profile.
I have the same issue with FS 1.0.2 that' s why I tried FS 11560.
When I use the FS machine as a router to test the packet per second performance, I'm reaching 100Mbps with 8000pps in each direction (from vlan 55 to vlan56) with less than 12% CPU. So that I don't think there's an issue with the network.
Here is an "mpstat -P ALL 1" to show you what's happening suddenly with 70 bridge calls: 12:31:26 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:27 all 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00 12:31:27 0 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00
12:31:27 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:28 all 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35 12:31:28 0 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35
12:31:28 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:29 all 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17 12:31:29 0 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17
The CPU is going from 89% idle to 0% in less than 2 seconds.
I know that I don't have to expect too much from this kind of hardware, but it seems strange that the CPU power vanished so suddenly.
Thanks a lot for the guys that have read this long mail :p
kind regards, rod
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Anthony Minessale II
FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/
AIM: anthm MSN:anthony_minessale@hotmail.com <mailto:MSN%3Aanthony_minessale@hotmail.com> GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com <mailto:PAYPAL%3Aanthony.minessale@gmail.com> IRC: irc.freenode.net <http://irc.freenode.net> #freeswitch
FreeSWITCH Developer Conference sip:888@conference.freeswitch.org <mailto:sip%3A888@conference.freeswitch.org> iax:guest@conference.freeswitch.org/888 <http://iax:guest@conference.freeswitch.org/888> googletalk:conf+888@conference.freeswitch.org <mailto:googletalk%3Aconf%2B888@conference.freeswitch.org> pstn:213-799-1400
------------------------------------------------------------------------
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
I have not compared them directly to be able to answer. I do know that the more cores the better (even slower ones) because each core divides the entire workload of the scheduler and increases the total threads that can work in parallel. also you can start FS with -hp (high performance) which activates the round-robin scheduler, increases some ulimits and forces all consumed memory to be permanently resident with mlockall (no swapping) On Fri, Jan 30, 2009 at 11:05 AM, peder@networkoblivion.com < peder@networkoblivion.com> wrote:
Given the choice between dual core and dual processor, would one work better than the other for FS? Assuming roughly the same speed. Or would it not really have a measurable difference assuming same speed and both Intel?
Anthony Minessale wrote:
Which of the 2 machines has the load issue? You said it was one box calling the other.
You have 2 major things against you, single CPU and AMD, but you should at least be able to get in the vicinity of 800-1000 calls on a box like that.
Are you calling the default 9999? It's not really an appropriate extension for load testing. On the terminating box you should set up a manual extension that is the first one in the dial plan to play a wav file from preferably a ram disk or /tmp
If you do plan on using this in production accept nothing less than a multi-core intel machine with at least 4 cores, the more cores the better because that parallel processing is where FS gets it's atvantage.
On Fri, Jan 30, 2009 at 5:56 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net>> wrote:
Dear list,
I've been playing with freeswitch for some time (2 months) and the fact is that I'm very pleased with the functionnalities of this software.
I'd like to use FS as a SBC handling media and I'm doing some tests with sipp to load the machine but I'm unable to bridge more than 60 calls without seeing the CPU being loaded at 100%. I'm sure something is going wrong with my setup but I'm unable to see what.
The test machine has the following specs: Athlon XP 3500+ with 2GB of memory (I know this is not a high end machine :p)
Freeswitch:/opt/freeswitch/log# cat /proc/cpuinfo processor : 0 vendor_id : AuthenticAMD cpu family : 15 model : 95 model name : AMD Athlon(tm) 64 Processor 3500+ stepping : 2 cpu MHz : 2199.973 cache size : 512 KB fpu : yes fpu_exception : yes cpuid level : 1 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt rdtscp lm 3dnowext 3dnow up rep_good pni cx16 lahf_lm svm extapic cr8_legacy bogomips : 4402.97 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management: ts fid vid ttp tm stc
I installed FS on a fresh debian 64: Linux Freeswitch 2.6.26-1-amd64 #1 SMP Sat Jan 10 17:57:00 UTC 2009 x86_64 GNU/Linux
I set the ulimit parameters like those on the website: freeswitch@internal> ... Freeswitch:/opt/free-svn/bin# ulimit -a core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 999999 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) unlimited real-time priority (-r) 0 stack size (kbytes, -s) 244 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited
My network setup is the following:
SIPP machine (10.10.10.1/24)----------------vlan<http://10.10.10.1/24%29----------------vlan> <http://10.10.10.1/24%29----------------vlan> 55 ----------(10.10.10.254/24 <http://10.10.10.254/24>) FS (10.10.20.254/24)--------------<http://10.10.20.254/24%29--------------> <http://10.10.20.254/24%29--------------> vlan56 -------------------(10.10.20.100/24 <http://10.10.20.100/24>) OTHER STOCK FS
I launched sipp with: sipp -sn uac_pcap -s 9999 -r 10 -l 80 -d 60000 -mi 10.10.10.1 -i 10.10.10.1 -mp 25000 10.10.10.254:5060 <http://10.10.10.254:5060>
The dialplan on FS is very simple: <?xml version="1.0" encoding="utf-8"?> <!-- http://wiki.freeswitch.org/wiki/Dialplan_XML --> <include> <context name="default">
<extension name="hold_music_bridge"> <condition field="destination_number" expression="^9999$"> <action application="answer"/> <action application="bridge" data="sofia/external/9999@10.10.20.100 <mailto:9999@10.10.20.100>"/> </condition> </extension> </context>
</include>
FreeSWITCH Version 1.0.trunk (11560M) Started. Crash Protection [Disabled] Max Sessions[1000] Session Rate[100] SQL [Enabled]
The test is very simple: sipp dial 9999 that matches in my FS dialplan and this is bridged to an other FS machine playing music on hold. When I launch "top" I see after 30 to 40 s that FS consumes all the CPU ressources (with a mean of 50-60 % before), with 80 calls. When I set 70 calls, I have to wait 70-80 s before seeing the same issue.
Presence is set to false on the 2 profile.
I have the same issue with FS 1.0.2 that' s why I tried FS 11560.
When I use the FS machine as a router to test the packet per second performance, I'm reaching 100Mbps with 8000pps in each direction (from vlan 55 to vlan56) with less than 12% CPU. So that I don't think there's an issue with the network.
Here is an "mpstat -P ALL 1" to show you what's happening suddenly with 70 bridge calls: 12:31:26 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:27 all 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00 12:31:27 0 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00
12:31:27 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:28 all 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35 12:31:28 0 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35
12:31:28 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:29 all 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17 12:31:29 0 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17
The CPU is going from 89% idle to 0% in less than 2 seconds.
I know that I don't have to expect too much from this kind of hardware, but it seems strange that the CPU power vanished so suddenly.
Thanks a lot for the guys that have read this long mail :p
kind regards, rod
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Anthony Minessale II
FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/
AIM: anthm MSN:anthony_minessale@hotmail.com <MSN%3Aanthony_minessale@hotmail.com> <mailto:MSN%3Aanthony_minessale@hotmail.com<MSN%253Aanthony_minessale@hotmail.com>
GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com<PAYPAL%3Aanthony.minessale@gmail.com> <mailto:PAYPAL%3Aanthony.minessale@gmail.com<PAYPAL%253Aanthony.minessale@gmail.com>
IRC: irc.freenode.net <http://irc.freenode.net> #freeswitch
FreeSWITCH Developer Conference sip:888@conference.freeswitch.org <sip%3A888@conference.freeswitch.org> <mailto:sip%3A888@conference.freeswitch.org<sip%253A888@conference.freeswitch.org>
iax:guest@conference.freeswitch.org/888 <http://iax:guest@conference.freeswitch.org/888> googletalk:conf+888@conference.freeswitch.org<googletalk%3Aconf%2B888@conference.freeswitch.org> <mailto:googletalk%3Aconf%2B888@conference.freeswitch.org<googletalk%253Aconf%252B888@conference.freeswitch.org>
pstn:213-799-1400
------------------------------------------------------------------------
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Anthony Minessale II FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/ AIM: anthm MSN:anthony_minessale@hotmail.com <MSN%3Aanthony_minessale@hotmail.com> GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com<PAYPAL%3Aanthony.minessale@gmail.com> IRC: irc.freenode.net #freeswitch FreeSWITCH Developer Conference sip:888@conference.freeswitch.org <sip%3A888@conference.freeswitch.org> iax:guest@conference.freeswitch.org/888 googletalk:conf+888@conference.freeswitch.org<googletalk%3Aconf%2B888@conference.freeswitch.org> pstn:213-799-1400
Thanks Anthony, the setup is like this: sipp server ---- FS 1 ---- FS2 FS1 is the AMD CPU that has only one extension in dialplan that bridges 9999 to FS2. 9999 is the first extension in FS2 dialplan that plays moh, FS2 has no CPU pbm. FS1 is maxing out at 60 bridged calls without your option -hp. Using -hp, I'm now able to bridge 200 concurrent calls (a great improvement) and the system is still reactive. CPU load is high but not 100% and as the system responds well, I think that doesn't matter. The 2GB of memory are completely consumed (top command shows 700MB for FS process). I understand that FS1 server is not the best hardware platform, and I'm waiting for new 4 cores server for testing. I will update those numbers when testing with the new hardware. regards, rod. Anthony Minessale wrote:
Which of the 2 machines has the load issue? You said it was one box calling the other.
You have 2 major things against you, single CPU and AMD, but you should at least be able to get in the vicinity of 800-1000 calls on a box like that.
Are you calling the default 9999? It's not really an appropriate extension for load testing. On the terminating box you should set up a manual extension that is the first one in the dial plan to play a wav file from preferably a ram disk or /tmp
If you do plan on using this in production accept nothing less than a multi-core intel machine with at least 4 cores, the more cores the better because that parallel processing is where FS gets it's atvantage.
On Fri, Jan 30, 2009 at 5:56 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net>> wrote:
Dear list,
I've been playing with freeswitch for some time (2 months) and the fact is that I'm very pleased with the functionnalities of this software.
I'd like to use FS as a SBC handling media and I'm doing some tests with sipp to load the machine but I'm unable to bridge more than 60 calls without seeing the CPU being loaded at 100%. I'm sure something is going wrong with my setup but I'm unable to see what.
The test machine has the following specs: Athlon XP 3500+ with 2GB of memory (I know this is not a high end machine :p)
Freeswitch:/opt/freeswitch/log# cat /proc/cpuinfo processor : 0 vendor_id : AuthenticAMD cpu family : 15 model : 95 model name : AMD Athlon(tm) 64 Processor 3500+ stepping : 2 cpu MHz : 2199.973 cache size : 512 KB fpu : yes fpu_exception : yes cpuid level : 1 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt rdtscp lm 3dnowext 3dnow up rep_good pni cx16 lahf_lm svm extapic cr8_legacy bogomips : 4402.97 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management: ts fid vid ttp tm stc
I installed FS on a fresh debian 64: Linux Freeswitch 2.6.26-1-amd64 #1 SMP Sat Jan 10 17:57:00 UTC 2009 x86_64 GNU/Linux
I set the ulimit parameters like those on the website: freeswitch@internal> ... Freeswitch:/opt/free-svn/bin# ulimit -a core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 999999 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) unlimited real-time priority (-r) 0 stack size (kbytes, -s) 244 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited
My network setup is the following:
SIPP machine (10.10.10.1/24)----------------vlan <http://10.10.10.1/24%29----------------vlan> 55 ----------(10.10.10.254/24 <http://10.10.10.254/24>) FS (10.10.20.254/24)-------------- <http://10.10.20.254/24%29--------------> vlan56 -------------------(10.10.20.100/24 <http://10.10.20.100/24>) OTHER STOCK FS
I launched sipp with: sipp -sn uac_pcap -s 9999 -r 10 -l 80 -d 60000 -mi 10.10.10.1 -i 10.10.10.1 -mp 25000 10.10.10.254:5060 <http://10.10.10.254:5060>
The dialplan on FS is very simple: <?xml version="1.0" encoding="utf-8"?> <!-- http://wiki.freeswitch.org/wiki/Dialplan_XML --> <include> <context name="default">
<extension name="hold_music_bridge"> <condition field="destination_number" expression="^9999$"> <action application="answer"/> <action application="bridge" data="sofia/external/9999@10.10.20.100 <mailto:9999@10.10.20.100>"/> </condition> </extension> </context>
</include>
FreeSWITCH Version 1.0.trunk (11560M) Started. Crash Protection [Disabled] Max Sessions[1000] Session Rate[100] SQL [Enabled]
The test is very simple: sipp dial 9999 that matches in my FS dialplan and this is bridged to an other FS machine playing music on hold. When I launch "top" I see after 30 to 40 s that FS consumes all the CPU ressources (with a mean of 50-60 % before), with 80 calls. When I set 70 calls, I have to wait 70-80 s before seeing the same issue.
Presence is set to false on the 2 profile.
I have the same issue with FS 1.0.2 that' s why I tried FS 11560.
When I use the FS machine as a router to test the packet per second performance, I'm reaching 100Mbps with 8000pps in each direction (from vlan 55 to vlan56) with less than 12% CPU. So that I don't think there's an issue with the network.
Here is an "mpstat -P ALL 1" to show you what's happening suddenly with 70 bridge calls: 12:31:26 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:27 all 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00 12:31:27 0 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00
12:31:27 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:28 all 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35 12:31:28 0 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35
12:31:28 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:29 all 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17 12:31:29 0 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17
The CPU is going from 89% idle to 0% in less than 2 seconds.
I know that I don't have to expect too much from this kind of hardware, but it seems strange that the CPU power vanished so suddenly.
Thanks a lot for the guys that have read this long mail :p
kind regards, rod
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Anthony Minessale II
FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/
AIM: anthm MSN:anthony_minessale@hotmail.com <mailto:MSN%3Aanthony_minessale@hotmail.com> GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com <mailto:PAYPAL%3Aanthony.minessale@gmail.com> IRC: irc.freenode.net <http://irc.freenode.net> #freeswitch
FreeSWITCH Developer Conference sip:888@conference.freeswitch.org <mailto:sip%3A888@conference.freeswitch.org> iax:guest@conference.freeswitch.org/888 <http://iax:guest@conference.freeswitch.org/888> googletalk:conf+888@conference.freeswitch.org <mailto:googletalk%3Aconf%2B888@conference.freeswitch.org> pstn:213-799-1400 ------------------------------------------------------------------------
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Dont forget there are several things you can do to increase performance... 1) where possible use bypass media or media proxy modes 2) mount freeswitch/db as a ram drive (if you are using voicemail with the internal FS DBs you'll need a way to make this persistant across reboots) 3) see the wiki for setting reasonable ulimits 4) (this is my oppinion others may vary) dont use mod_cdr_csv 5) turn off (or reduce logging) in switch.conf.xml all of these thing can greatly improve performance. On Mon, Feb 2, 2009 at 1:04 AM, rod <kawarod@laposte.net> wrote:
Thanks Anthony,
the setup is like this:
sipp server ---- FS 1 ---- FS2
FS1 is the AMD CPU that has only one extension in dialplan that bridges 9999 to FS2. 9999 is the first extension in FS2 dialplan that plays moh, FS2 has no CPU pbm.
FS1 is maxing out at 60 bridged calls without your option -hp.
Using -hp, I'm now able to bridge 200 concurrent calls (a great improvement) and the system is still reactive. CPU load is high but not 100% and as the system responds well, I think that doesn't matter. The 2GB of memory are completely consumed (top command shows 700MB for FS process).
I understand that FS1 server is not the best hardware platform, and I'm waiting for new 4 cores server for testing. I will update those numbers when testing with the new hardware.
regards, rod.
Anthony Minessale wrote:
Which of the 2 machines has the load issue? You said it was one box calling the other.
You have 2 major things against you, single CPU and AMD, but you should at least be able to get in the vicinity of 800-1000 calls on a box like that.
Are you calling the default 9999? It's not really an appropriate extension for load testing. On the terminating box you should set up a manual extension that is the first one in the dial plan to play a wav file from preferably a ram disk or /tmp
If you do plan on using this in production accept nothing less than a multi-core intel machine with at least 4 cores, the more cores the better because that parallel processing is where FS gets it's atvantage.
On Fri, Jan 30, 2009 at 5:56 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net>> wrote:
Dear list,
I've been playing with freeswitch for some time (2 months) and the fact is that I'm very pleased with the functionnalities of this software.
I'd like to use FS as a SBC handling media and I'm doing some tests with sipp to load the machine but I'm unable to bridge more than 60 calls without seeing the CPU being loaded at 100%. I'm sure something is going wrong with my setup but I'm unable to see what.
The test machine has the following specs: Athlon XP 3500+ with 2GB of memory (I know this is not a high end machine :p)
Freeswitch:/opt/freeswitch/log# cat /proc/cpuinfo processor : 0 vendor_id : AuthenticAMD cpu family : 15 model : 95 model name : AMD Athlon(tm) 64 Processor 3500+ stepping : 2 cpu MHz : 2199.973 cache size : 512 KB fpu : yes fpu_exception : yes cpuid level : 1 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt rdtscp lm 3dnowext 3dnow up rep_good pni cx16 lahf_lm svm extapic cr8_legacy bogomips : 4402.97 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management: ts fid vid ttp tm stc
I installed FS on a fresh debian 64: Linux Freeswitch 2.6.26-1-amd64 #1 SMP Sat Jan 10 17:57:00 UTC 2009 x86_64 GNU/Linux
I set the ulimit parameters like those on the website: freeswitch@internal> ... Freeswitch:/opt/free-svn/bin# ulimit -a core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 999999 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) unlimited real-time priority (-r) 0 stack size (kbytes, -s) 244 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited
My network setup is the following:
SIPP machine (10.10.10.1/24)----------------vlan<http://10.10.10.1/24%29----------------vlan> <http://10.10.10.1/24%29----------------vlan> 55 ----------(10.10.10.254/24 <http://10.10.10.254/24>) FS (10.10.20.254/24)--------------<http://10.10.20.254/24%29--------------> <http://10.10.20.254/24%29--------------> vlan56 -------------------(10.10.20.100/24 <http://10.10.20.100/24>) OTHER STOCK FS
I launched sipp with: sipp -sn uac_pcap -s 9999 -r 10 -l 80 -d 60000 -mi 10.10.10.1 -i 10.10.10.1 -mp 25000 10.10.10.254:5060 <http://10.10.10.254:5060>
The dialplan on FS is very simple: <?xml version="1.0" encoding="utf-8"?> <!-- http://wiki.freeswitch.org/wiki/Dialplan_XML --> <include> <context name="default">
<extension name="hold_music_bridge"> <condition field="destination_number" expression="^9999$"> <action application="answer"/> <action application="bridge" data="sofia/external/9999@10.10.20.100 <mailto:9999@10.10.20.100>"/> </condition> </extension> </context>
</include>
FreeSWITCH Version 1.0.trunk (11560M) Started. Crash Protection [Disabled] Max Sessions[1000] Session Rate[100] SQL [Enabled]
The test is very simple: sipp dial 9999 that matches in my FS dialplan and this is bridged to an other FS machine playing music on hold. When I launch "top" I see after 30 to 40 s that FS consumes all the CPU ressources (with a mean of 50-60 % before), with 80 calls. When I set 70 calls, I have to wait 70-80 s before seeing the same issue.
Presence is set to false on the 2 profile.
I have the same issue with FS 1.0.2 that' s why I tried FS 11560.
When I use the FS machine as a router to test the packet per second performance, I'm reaching 100Mbps with 8000pps in each direction (from vlan 55 to vlan56) with less than 12% CPU. So that I don't think there's an issue with the network.
Here is an "mpstat -P ALL 1" to show you what's happening suddenly with 70 bridge calls: 12:31:26 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:27 all 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00 12:31:27 0 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00
12:31:27 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:28 all 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35 12:31:28 0 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35
12:31:28 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:29 all 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17 12:31:29 0 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17
The CPU is going from 89% idle to 0% in less than 2 seconds.
I know that I don't have to expect too much from this kind of hardware, but it seems strange that the CPU power vanished so suddenly.
Thanks a lot for the guys that have read this long mail :p
kind regards, rod
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Anthony Minessale II
FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/
AIM: anthm MSN:anthony_minessale@hotmail.com <MSN%3Aanthony_minessale@hotmail.com> <mailto:MSN%3Aanthony_minessale@hotmail.com<MSN%253Aanthony_minessale@hotmail.com>
GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com<PAYPAL%3Aanthony.minessale@gmail.com> <mailto:PAYPAL%3Aanthony.minessale@gmail.com<PAYPAL%253Aanthony.minessale@gmail.com>
IRC: irc.freenode.net <http://irc.freenode.net> #freeswitch
FreeSWITCH Developer Conference sip:888@conference.freeswitch.org <sip%3A888@conference.freeswitch.org> <mailto:sip%3A888@conference.freeswitch.org<sip%253A888@conference.freeswitch.org>
iax:guest@conference.freeswitch.org/888 <http://iax:guest@conference.freeswitch.org/888> googletalk:conf+888@conference.freeswitch.org<googletalk%3Aconf%2B888@conference.freeswitch.org> <mailto:googletalk%3Aconf%2B888@conference.freeswitch.org<googletalk%253Aconf%252B888@conference.freeswitch.org>
pstn:213-799-1400 ------------------------------------------------------------------------
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Hi Ken, 1) I'd like to use FS to hide topology, so bypass media is not possible 2) done 3) done 4) not used 5) i'm using this ins switch.xml -> <param name="loglevel" value="info"/>, if you think an other log level is more suitable. Regarding logging, I can see in console and in the freeswitch.log that there is still a lot of NOTICE logging, see below: 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8721 (sofia/internal/sipp@10.10.10.1:5060) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/internal/sipp@10.10.10.1:5060 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8722 (sofia/external/9998@10.10.20.100) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/external/9998@10.10.20.100 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] sofia.c:3164 sofia_handle_sip_i_state() Channel [sofia/external/9998@10.10.20.100] has been answered 2009-02-02 08:33:56 [WARNING] mod_sofia.c:740 sofia_read_frame() Changing codec ptime to 30. I bet you have a linksys/sipura =D Do you have any idea where I can switch off this kind of logging. I thought it should be in /dialplan/internal.xml, but I see that in internal.xml -> <param name="debug" value="0"/> thanks a lot for your suggestion. regards, rod Ken Rice wrote:
Dont forget there are several things you can do to increase performance...
1) where possible use bypass media or media proxy modes 2) mount freeswitch/db as a ram drive (if you are using voicemail with the internal FS DBs you'll need a way to make this persistant across reboots) 3) see the wiki for setting reasonable ulimits 4) (this is my oppinion others may vary) dont use mod_cdr_csv 5) turn off (or reduce logging) in switch.conf.xml
all of these thing can greatly improve performance.
On Mon, Feb 2, 2009 at 1:04 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net>> wrote:
Thanks Anthony,
the setup is like this:
sipp server ---- FS 1 ---- FS2
FS1 is the AMD CPU that has only one extension in dialplan that bridges 9999 to FS2. 9999 is the first extension in FS2 dialplan that plays moh, FS2 has no CPU pbm.
FS1 is maxing out at 60 bridged calls without your option -hp.
Using -hp, I'm now able to bridge 200 concurrent calls (a great improvement) and the system is still reactive. CPU load is high but not 100% and as the system responds well, I think that doesn't matter. The 2GB of memory are completely consumed (top command shows 700MB for FS process).
I understand that FS1 server is not the best hardware platform, and I'm waiting for new 4 cores server for testing. I will update those numbers when testing with the new hardware.
regards, rod.
Anthony Minessale wrote: > Which of the 2 machines has the load issue? You said it was one box > calling the other. > > You have 2 major things against you, single CPU and AMD, but you > should at least be able to get in the vicinity of 800-1000 calls on a > box like that. > > Are you calling the default 9999? It's not really an appropriate > extension for load testing. > On the terminating box you should set up a manual extension that is > the first one in the dial plan > to play a wav file from preferably a ram disk or /tmp > > If you do plan on using this in production accept nothing less than a > multi-core intel machine with at least 4 cores, the more cores the > better because that parallel processing is where FS gets it's atvantage. > > > > On Fri, Jan 30, 2009 at 5:56 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net> > <mailto:kawarod@laposte.net <mailto:kawarod@laposte.net>>> wrote: > > Dear list, > > I've been playing with freeswitch for some time (2 months) and the > fact > is that I'm very pleased with the functionnalities of this software. > > I'd like to use FS as a SBC handling media and I'm doing some > tests with > sipp to load the machine but I'm unable to bridge more than 60 calls > without seeing the CPU being loaded at 100%. I'm sure something is > going > wrong with my setup but I'm unable to see what. > > The test machine has the following specs: > Athlon XP 3500+ with 2GB of memory (I know this is not a high end > machine :p) > > Freeswitch:/opt/freeswitch/log# cat /proc/cpuinfo > processor : 0 > vendor_id : AuthenticAMD > cpu family : 15 > model : 95 > model name : AMD Athlon(tm) 64 Processor 3500+ > stepping : 2 > cpu MHz : 2199.973 > cache size : 512 KB > fpu : yes > fpu_exception : yes > cpuid level : 1 > wp : yes > flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge > mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext > fxsr_opt > rdtscp lm 3dnowext 3dnow up rep_good pni cx16 lahf_lm svm extapic > cr8_legacy > bogomips : 4402.97 > TLB size : 1024 4K pages > clflush size : 64 > cache_alignment : 64 > address sizes : 40 bits physical, 48 bits virtual > power management: ts fid vid ttp tm stc > > I installed FS on a fresh debian 64: > Linux Freeswitch 2.6.26-1-amd64 #1 SMP Sat Jan 10 17:57:00 UTC 2009 > x86_64 GNU/Linux > > I set the ulimit parameters like those on the website: > freeswitch@internal> ... > Freeswitch:/opt/free-svn/bin# ulimit -a > core file size (blocks, -c) unlimited > data seg size (kbytes, -d) unlimited > scheduling priority (-e) 0 > file size (blocks, -f) unlimited > pending signals (-i) unlimited > max locked memory (kbytes, -l) unlimited > max memory size (kbytes, -m) unlimited > open files (-n) 999999 > pipe size (512 bytes, -p) 8 > POSIX message queues (bytes, -q) unlimited > real-time priority (-r) 0 > stack size (kbytes, -s) 244 > cpu time (seconds, -t) unlimited > max user processes (-u) unlimited > virtual memory (kbytes, -v) unlimited > file locks (-x) unlimited > > > My network setup is the following: > > SIPP machine (10.10.10.1/24)----------------vlan <http://10.10.10.1/24%29----------------vlan> > <http://10.10.10.1/24%29----------------vlan> 55 > ----------(10.10.10.254/24 <http://10.10.10.254/24> <http://10.10.10.254/24>) FS > (10.10.20.254/24)-------------- <http://10.10.20.254/24%29--------------> > <http://10.10.20.254/24%29--------------> vlan56 > -------------------(10.10.20.100/24 <http://10.10.20.100/24> <http://10.10.20.100/24>) > OTHER STOCK FS > > > I launched sipp with: > sipp -sn uac_pcap -s 9999 -r 10 -l 80 -d 60000 -mi 10.10.10.1 -i > 10.10.10.1 -mp 25000 10.10.10.254:5060 <http://10.10.10.254:5060> <http://10.10.10.254:5060> > > The dialplan on FS is very simple: > <?xml version="1.0" encoding="utf-8"?> > <!-- http://wiki.freeswitch.org/wiki/Dialplan_XML --> > <include> > <context name="default"> > > <extension name="hold_music_bridge"> > <condition field="destination_number" expression="^9999$"> > <action application="answer"/> > <action application="bridge" > data="sofia/external/9999@10.10.20.100 <mailto:9999@10.10.20.100> <mailto:9999@10.10.20.100 <mailto:9999@10.10.20.100>>"/> > </condition> > </extension> > </context> > > </include> > > FreeSWITCH Version 1.0.trunk (11560M) Started. > Crash Protection [Disabled] > Max Sessions[1000] > Session Rate[100] > SQL [Enabled] > > > The test is very simple: sipp dial 9999 that matches in my FS dialplan > and this is bridged to an other FS machine playing music on hold. > When I launch "top" I see after 30 to 40 s that FS consumes all > the CPU > ressources (with a mean of 50-60 % before), with 80 calls. > When I set 70 calls, I have to wait 70-80 s before seeing the same > issue. > > Presence is set to false on the 2 profile. > > I have the same issue with FS 1.0.2 that' s why I tried FS 11560. > > When I use the FS machine as a router to test the packet per second > performance, I'm reaching 100Mbps with 8000pps in each direction (from > vlan 55 to vlan56) with less than 12% CPU. So that I don't think > there's > an issue with the network. > > Here is an "mpstat -P ALL 1" to show you what's happening suddenly > with > 70 bridge calls: > 12:31:26 CPU %user %nice %sys %iowait %irq %soft > %steal %idle intr/s > 12:31:27 all 3,00 0,00 3,00 0,00 1,00 4,00 > 0,00 89,00 6241,00 > 12:31:27 0 3,00 0,00 3,00 0,00 1,00 4,00 > 0,00 89,00 6241,00 > > 12:31:27 CPU %user %nice %sys %iowait %irq %soft > %steal %idle intr/s > 12:31:28 all 14,14 0,00 56,57 0,00 2,02 5,05 > 0,00 22,22 6035,35 > 12:31:28 0 14,14 0,00 56,57 0,00 2,02 5,05 > 0,00 22,22 6035,35 > > 12:31:28 CPU %user %nice %sys %iowait %irq %soft > %steal %idle intr/s > 12:31:29 all 24,75 0,00 67,33 0,00 0,99 6,93 > 0,00 0,00 5483,17 > 12:31:29 0 24,75 0,00 67,33 0,00 0,99 6,93 > 0,00 0,00 5483,17 > > > The CPU is going from 89% idle to 0% in less than 2 seconds. > > I know that I don't have to expect too much from this kind of > hardware, > but it seems strange that the CPU power vanished so suddenly. > > Thanks a lot for the guys that have read this long mail :p > > kind regards, > rod > > > _______________________________________________ > Freeswitch-users mailing list > Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> > <mailto:Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org>> > http://lists.freeswitch.org/mailman/listinfo/freeswitch-users > UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users > http://www.freeswitch.org > > > > > -- > Anthony Minessale II > > FreeSWITCH http://www.freeswitch.org/ > ClueCon http://www.cluecon.com/ > > AIM: anthm > MSN:anthony_minessale@hotmail.com <mailto:MSN%3Aanthony_minessale@hotmail.com> > <mailto:MSN%3Aanthony_minessale@hotmail.com <mailto:MSN%253Aanthony_minessale@hotmail.com>> > GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com <mailto:PAYPAL%3Aanthony.minessale@gmail.com> > <mailto:PAYPAL%3Aanthony.minessale@gmail.com <mailto:PAYPAL%253Aanthony.minessale@gmail.com>> > IRC: irc.freenode.net <http://irc.freenode.net> <http://irc.freenode.net> #freeswitch > > FreeSWITCH Developer Conference > sip:888@conference.freeswitch.org <mailto:sip%3A888@conference.freeswitch.org> > <mailto:sip%3A888@conference.freeswitch.org <mailto:sip%253A888@conference.freeswitch.org>> > iax:guest@conference.freeswitch.org/888 <http://iax:guest@conference.freeswitch.org/888> > <http://iax:guest@conference.freeswitch.org/888> > googletalk:conf+888@conference.freeswitch.org <mailto:googletalk%3Aconf%2B888@conference.freeswitch.org> > <mailto:googletalk%3Aconf%2B888@conference.freeswitch.org <mailto:googletalk%253Aconf%252B888@conference.freeswitch.org>> > pstn:213-799-1400 > ------------------------------------------------------------------------ > > _______________________________________________ > Freeswitch-users mailing list > Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> > http://lists.freeswitch.org/mailman/listinfo/freeswitch-users > UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users > http://www.freeswitch.org >
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
------------------------------------------------------------------------
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
for topology hiding, use proxy media. it means FS ignores the RTP stream totally, and just passes it through. On Mon, Feb 2, 2009 at 5:36 PM, rod <kawarod@laposte.net> wrote:
Hi Ken,
1) I'd like to use FS to hide topology, so bypass media is not possible 2) done 3) done 4) not used 5) i'm using this ins switch.xml -> <param name="loglevel" value="info"/>, if you think an other log level is more suitable.
Regarding logging, I can see in console and in the freeswitch.log that there is still a lot of NOTICE logging, see below: 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8721 (sofia/internal/sipp@10.10.10.1:5060) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/internal/sipp@10.10.10.1:5060 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8722 (sofia/external/9998@10.10.20.100) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/external/9998@10.10.20.100 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] sofia.c:3164 sofia_handle_sip_i_state() Channel [sofia/external/9998@10.10.20.100] has been answered 2009-02-02 08:33:56 [WARNING] mod_sofia.c:740 sofia_read_frame() Changing codec ptime to 30. I bet you have a linksys/sipura =D
Do you have any idea where I can switch off this kind of logging. I thought it should be in /dialplan/internal.xml, but I see that in internal.xml -> <param name="debug" value="0"/>
thanks a lot for your suggestion.
regards, rod
Ken Rice wrote:
Dont forget there are several things you can do to increase performance...
1) where possible use bypass media or media proxy modes 2) mount freeswitch/db as a ram drive (if you are using voicemail with the internal FS DBs you'll need a way to make this persistant across reboots) 3) see the wiki for setting reasonable ulimits 4) (this is my oppinion others may vary) dont use mod_cdr_csv 5) turn off (or reduce logging) in switch.conf.xml
all of these thing can greatly improve performance.
On Mon, Feb 2, 2009 at 1:04 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net>> wrote:
Thanks Anthony,
the setup is like this:
sipp server ---- FS 1 ---- FS2
FS1 is the AMD CPU that has only one extension in dialplan that bridges 9999 to FS2. 9999 is the first extension in FS2 dialplan that plays moh, FS2 has no CPU pbm.
FS1 is maxing out at 60 bridged calls without your option -hp.
Using -hp, I'm now able to bridge 200 concurrent calls (a great improvement) and the system is still reactive. CPU load is high but not 100% and as the system responds well, I think that doesn't matter. The 2GB of memory are completely consumed (top command shows 700MB for FS process).
I understand that FS1 server is not the best hardware platform, and I'm waiting for new 4 cores server for testing. I will update those numbers when testing with the new hardware.
regards, rod.
Anthony Minessale wrote: > Which of the 2 machines has the load issue? You said it was one box > calling the other. > > You have 2 major things against you, single CPU and AMD, but you > should at least be able to get in the vicinity of 800-1000 calls on a > box like that. > > Are you calling the default 9999? It's not really an appropriate > extension for load testing. > On the terminating box you should set up a manual extension that is > the first one in the dial plan > to play a wav file from preferably a ram disk or /tmp > > If you do plan on using this in production accept nothing less than a > multi-core intel machine with at least 4 cores, the more cores the > better because that parallel processing is where FS gets it's atvantage. > > > > On Fri, Jan 30, 2009 at 5:56 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net> > <mailto:kawarod@laposte.net <mailto:kawarod@laposte.net>>> wrote: > > Dear list, > > I've been playing with freeswitch for some time (2 months) and the > fact > is that I'm very pleased with the functionnalities of this software. > > I'd like to use FS as a SBC handling media and I'm doing some > tests with > sipp to load the machine but I'm unable to bridge more than 60 calls > without seeing the CPU being loaded at 100%. I'm sure something is > going > wrong with my setup but I'm unable to see what. > > The test machine has the following specs: > Athlon XP 3500+ with 2GB of memory (I know this is not a high end > machine :p) > > Freeswitch:/opt/freeswitch/log# cat /proc/cpuinfo > processor : 0 > vendor_id : AuthenticAMD > cpu family : 15 > model : 95 > model name : AMD Athlon(tm) 64 Processor 3500+ > stepping : 2 > cpu MHz : 2199.973 > cache size : 512 KB > fpu : yes > fpu_exception : yes > cpuid level : 1 > wp : yes > flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge > mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext > fxsr_opt > rdtscp lm 3dnowext 3dnow up rep_good pni cx16 lahf_lm svm extapic > cr8_legacy > bogomips : 4402.97 > TLB size : 1024 4K pages > clflush size : 64 > cache_alignment : 64 > address sizes : 40 bits physical, 48 bits virtual > power management: ts fid vid ttp tm stc > > I installed FS on a fresh debian 64: > Linux Freeswitch 2.6.26-1-amd64 #1 SMP Sat Jan 10 17:57:00 UTC 2009 > x86_64 GNU/Linux > > I set the ulimit parameters like those on the website: > freeswitch@internal> ... > Freeswitch:/opt/free-svn/bin# ulimit -a > core file size (blocks, -c) unlimited > data seg size (kbytes, -d) unlimited > scheduling priority (-e) 0 > file size (blocks, -f) unlimited > pending signals (-i) unlimited > max locked memory (kbytes, -l) unlimited > max memory size (kbytes, -m) unlimited > open files (-n) 999999 > pipe size (512 bytes, -p) 8 > POSIX message queues (bytes, -q) unlimited > real-time priority (-r) 0 > stack size (kbytes, -s) 244 > cpu time (seconds, -t) unlimited > max user processes (-u) unlimited > virtual memory (kbytes, -v) unlimited > file locks (-x) unlimited > > > My network setup is the following: > > SIPP machine (10.10.10.1/24)----------------vlan<http://10.10.10.1/24%29----------------vlan> <http://10.10.10.1/24%29----------------vlan> > <http://10.10.10.1/24%29----------------vlan> 55 > ----------(10.10.10.254/24 <http://10.10.10.254/24> <http://10.10.10.254/24>) FS > (10.10.20.254/24)--------------<http://10.10.20.254/24%29--------------> <http://10.10.20.254/24%29--------------> > <http://10.10.20.254/24%29--------------> vlan56 > -------------------(10.10.20.100/24 <http://10.10.20.100/24> <http://10.10.20.100/24>) > OTHER STOCK FS > > > I launched sipp with: > sipp -sn uac_pcap -s 9999 -r 10 -l 80 -d 60000 -mi 10.10.10.1 -i > 10.10.10.1 -mp 25000 10.10.10.254:5060 <http://10.10.10.254:5060> <http://10.10.10.254:5060> > > The dialplan on FS is very simple: > <?xml version="1.0" encoding="utf-8"?> > <!-- http://wiki.freeswitch.org/wiki/Dialplan_XML --> > <include> > <context name="default"> > > <extension name="hold_music_bridge"> > <condition field="destination_number" expression="^9999$"> > <action application="answer"/> > <action application="bridge" > data="sofia/external/9999@10.10.20.100 <mailto:9999@10.10.20.100> <mailto:9999@10.10.20.100 <mailto:9999@10.10.20.100>>"/> > </condition> > </extension> > </context> > > </include> > > FreeSWITCH Version 1.0.trunk (11560M) Started. > Crash Protection [Disabled] > Max Sessions[1000] > Session Rate[100] > SQL [Enabled] > > > The test is very simple: sipp dial 9999 that matches in my FS dialplan > and this is bridged to an other FS machine playing music on hold. > When I launch "top" I see after 30 to 40 s that FS consumes all > the CPU > ressources (with a mean of 50-60 % before), with 80 calls. > When I set 70 calls, I have to wait 70-80 s before seeing the same > issue. > > Presence is set to false on the 2 profile. > > I have the same issue with FS 1.0.2 that' s why I tried FS 11560. > > When I use the FS machine as a router to test the packet per second > performance, I'm reaching 100Mbps with 8000pps in each direction (from > vlan 55 to vlan56) with less than 12% CPU. So that I don't think > there's > an issue with the network. > > Here is an "mpstat -P ALL 1" to show you what's happening suddenly > with > 70 bridge calls: > 12:31:26 CPU %user %nice %sys %iowait %irq %soft > %steal %idle intr/s > 12:31:27 all 3,00 0,00 3,00 0,00 1,00 4,00 > 0,00 89,00 6241,00 > 12:31:27 0 3,00 0,00 3,00 0,00 1,00 4,00 > 0,00 89,00 6241,00 > > 12:31:27 CPU %user %nice %sys %iowait %irq %soft > %steal %idle intr/s > 12:31:28 all 14,14 0,00 56,57 0,00 2,02 5,05 > 0,00 22,22 6035,35 > 12:31:28 0 14,14 0,00 56,57 0,00 2,02 5,05 > 0,00 22,22 6035,35 > > 12:31:28 CPU %user %nice %sys %iowait %irq %soft > %steal %idle intr/s > 12:31:29 all 24,75 0,00 67,33 0,00 0,99 6,93 > 0,00 0,00 5483,17 > 12:31:29 0 24,75 0,00 67,33 0,00 0,99 6,93 > 0,00 0,00 5483,17 > > > The CPU is going from 89% idle to 0% in less than 2 seconds. > > I know that I don't have to expect too much from this kind of > hardware, > but it seems strange that the CPU power vanished so suddenly. > > Thanks a lot for the guys that have read this long mail :p > > kind regards, > rod > > > _______________________________________________ > Freeswitch-users mailing list > Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> > <mailto:Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org>> > http://lists.freeswitch.org/mailman/listinfo/freeswitch-users > UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users > http://www.freeswitch.org > > > > > -- > Anthony Minessale II > > FreeSWITCH http://www.freeswitch.org/ > ClueCon http://www.cluecon.com/ > > AIM: anthm > MSN:anthony_minessale@hotmail.com<MSN%3Aanthony_minessale@hotmail.com> <mailto:MSN%3Aanthony_minessale@hotmail.com<MSN%253Aanthony_minessale@hotmail.com>
> <mailto:MSN%3Aanthony_minessale@hotmail.com<MSN%253Aanthony_minessale@hotmail.com> <mailto:MSN%253Aanthony_minessale@hotmail.com<MSN%25253Aanthony_minessale@hotmail.com>
> GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com<PAYPAL%3Aanthony.minessale@gmail.com> <mailto:PAYPAL%3Aanthony.minessale@gmail.com<PAYPAL%253Aanthony.minessale@gmail.com>
> <mailto:PAYPAL%3Aanthony.minessale@gmail.com<PAYPAL%253Aanthony.minessale@gmail.com> <mailto:PAYPAL%253Aanthony.minessale@gmail.com<PAYPAL%25253Aanthony.minessale@gmail.com>
> IRC: irc.freenode.net <http://irc.freenode.net> <http://irc.freenode.net> #freeswitch > > FreeSWITCH Developer Conference > sip:888@conference.freeswitch.org<sip%3A888@conference.freeswitch.org> <mailto:sip%3A888@conference.freeswitch.org<sip%253A888@conference.freeswitch.org>
> <mailto:sip%3A888@conference.freeswitch.org<sip%253A888@conference.freeswitch.org> <mailto:sip%253A888@conference.freeswitch.org<sip%25253A888@conference.freeswitch.org>
> iax:guest@conference.freeswitch.org/888 <http://iax:guest@conference.freeswitch.org/888> > <http://iax:guest@conference.freeswitch.org/888> > googletalk:conf+888@conference.freeswitch.org<googletalk%3Aconf%2B888@conference.freeswitch.org> <mailto:googletalk%3Aconf%2B888@conference.freeswitch.org<googletalk%253Aconf%252B888@conference.freeswitch.org>
> <mailto:googletalk%3Aconf%2B888@conference.freeswitch.org<googletalk%253Aconf%252B888@conference.freeswitch.org> <mailto:googletalk%253Aconf%252B888@conference.freeswitch.org<googletalk%25253Aconf%25252B888@conference.freeswitch.org>
> pstn:213-799-1400 >
------------------------------------------------------------------------
> > _______________________________________________ > Freeswitch-users mailing list > Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> > http://lists.freeswitch.org/mailman/listinfo/freeswitch-users > UNSUBSCRIBE:
http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:
http://lists.freeswitch.org/mailman/options/freeswitch-users
------------------------------------------------------------------------
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Sincerely Jay
If you don't have to transcode, using proxy media mode will still save you some CPU time. This is 1/2 way between bypass media and the default media interactive mode. The other draw back to this mode is if you are using FS to clean up RTP and DTMF you loose those functions but they are not needed in most use cases. As far as the log level goes, I found that once I had things stable setting the loglevel to helped a good deal... Info is probably a bit too high of a loglevel I would probably go for CRIT or ERR (2 or 1 respectively) if you insist on leaving logging turned on... On a busy system these can and will generate a good deal of activity (and disk IO if using mod_logfile) Ken
From: rod <kawarod@laposte.net> Reply-To: <freeswitch-users@lists.freeswitch.org> Date: Mon, 02 Feb 2009 11:36:35 +0400 To: <freeswitch-users@lists.freeswitch.org> Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Ken,
1) I'd like to use FS to hide topology, so bypass media is not possible 2) done 3) done 4) not used 5) i'm using this ins switch.xml -> <param name="loglevel" value="info"/>, if you think an other log level is more suitable.
Regarding logging, I can see in console and in the freeswitch.log that there is still a lot of NOTICE logging, see below: 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8721 (sofia/internal/sipp@10.10.10.1:5060) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/internal/sipp@10.10.10.1:5060 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8722 (sofia/external/9998@10.10.20.100) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/external/9998@10.10.20.100 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] sofia.c:3164 sofia_handle_sip_i_state() Channel [sofia/external/9998@10.10.20.100] has been answered 2009-02-02 08:33:56 [WARNING] mod_sofia.c:740 sofia_read_frame() Changing codec ptime to 30. I bet you have a linksys/sipura =D
Do you have any idea where I can switch off this kind of logging. I thought it should be in /dialplan/internal.xml, but I see that in internal.xml -> <param name="debug" value="0"/>
thanks a lot for your suggestion.
regards, rod
Ken Rice wrote:
Dont forget there are several things you can do to increase performance...
1) where possible use bypass media or media proxy modes 2) mount freeswitch/db as a ram drive (if you are using voicemail with the internal FS DBs you'll need a way to make this persistant across reboots) 3) see the wiki for setting reasonable ulimits 4) (this is my oppinion others may vary) dont use mod_cdr_csv 5) turn off (or reduce logging) in switch.conf.xml
all of these thing can greatly improve performance.
On Mon, Feb 2, 2009 at 1:04 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net>> wrote:
Thanks Anthony,
the setup is like this:
sipp server ---- FS 1 ---- FS2
FS1 is the AMD CPU that has only one extension in dialplan that bridges 9999 to FS2. 9999 is the first extension in FS2 dialplan that plays moh, FS2 has no CPU pbm.
FS1 is maxing out at 60 bridged calls without your option -hp.
Using -hp, I'm now able to bridge 200 concurrent calls (a great improvement) and the system is still reactive. CPU load is high but not 100% and as the system responds well, I think that doesn't matter. The 2GB of memory are completely consumed (top command shows 700MB for FS process).
I understand that FS1 server is not the best hardware platform, and I'm waiting for new 4 cores server for testing. I will update those numbers when testing with the new hardware.
regards, rod.
Anthony Minessale wrote:
Which of the 2 machines has the load issue? You said it was one box calling the other.
You have 2 major things against you, single CPU and AMD, but you should at least be able to get in the vicinity of 800-1000 calls on a box like that.
Are you calling the default 9999? It's not really an appropriate extension for load testing. On the terminating box you should set up a manual extension that is the first one in the dial plan to play a wav file from preferably a ram disk or /tmp
If you do plan on using this in production accept nothing less than a multi-core intel machine with at least 4 cores, the more cores the better because that parallel processing is where FS gets it's atvantage.
On Fri, Jan 30, 2009 at 5:56 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net> <mailto:kawarod@laposte.net <mailto:kawarod@laposte.net>>> wrote:
Dear list,
I've been playing with freeswitch for some time (2 months) and the fact is that I'm very pleased with the functionnalities of this software.
I'd like to use FS as a SBC handling media and I'm doing some tests with sipp to load the machine but I'm unable to bridge more than 60 calls without seeing the CPU being loaded at 100%. I'm sure something is going wrong with my setup but I'm unable to see what.
The test machine has the following specs: Athlon XP 3500+ with 2GB of memory (I know this is not a high end machine :p)
Freeswitch:/opt/freeswitch/log# cat /proc/cpuinfo processor : 0 vendor_id : AuthenticAMD cpu family : 15 model : 95 model name : AMD Athlon(tm) 64 Processor 3500+ stepping : 2 cpu MHz : 2199.973 cache size : 512 KB fpu : yes fpu_exception : yes cpuid level : 1 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt rdtscp lm 3dnowext 3dnow up rep_good pni cx16 lahf_lm svm extapic cr8_legacy bogomips : 4402.97 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management: ts fid vid ttp tm stc
I installed FS on a fresh debian 64: Linux Freeswitch 2.6.26-1-amd64 #1 SMP Sat Jan 10 17:57:00 UTC 2009 x86_64 GNU/Linux
I set the ulimit parameters like those on the website: freeswitch@internal> ... Freeswitch:/opt/free-svn/bin# ulimit -a core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 999999 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) unlimited real-time priority (-r) 0 stack size (kbytes, -s) 244 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited
My network setup is the following:
SIPP machine (10.10.10.1/24)----------------vlan <http://10.10.10.1/24%29----------------vlan> <http://10.10.10.1/24%29----------------vlan> 55 ----------(10.10.10.254/24 <http://10.10.10.254/24> <http://10.10.10.254/24>) FS (10.10.20.254/24)-------------- <http://10.10.20.254/24%29--------------> <http://10.10.20.254/24%29--------------> vlan56 -------------------(10.10.20.100/24 <http://10.10.20.100/24> <http://10.10.20.100/24>) OTHER STOCK FS
I launched sipp with: sipp -sn uac_pcap -s 9999 -r 10 -l 80 -d 60000 -mi 10.10.10.1 -i 10.10.10.1 -mp 25000 10.10.10.254:5060 <http://10.10.10.254:5060> <http://10.10.10.254:5060>
The dialplan on FS is very simple: <?xml version="1.0" encoding="utf-8"?> <!-- http://wiki.freeswitch.org/wiki/Dialplan_XML --> <include> <context name="default">
<extension name="hold_music_bridge"> <condition field="destination_number" expression="^9999$"> <action application="answer"/> <action application="bridge" data="sofia/external/9999@10.10.20.100 <mailto:9999@10.10.20.100> <mailto:9999@10.10.20.100 <mailto:9999@10.10.20.100>>"/> </condition> </extension> </context>
</include>
FreeSWITCH Version 1.0.trunk (11560M) Started. Crash Protection [Disabled] Max Sessions[1000] Session Rate[100] SQL [Enabled]
The test is very simple: sipp dial 9999 that matches in my FS dialplan and this is bridged to an other FS machine playing music on hold. When I launch "top" I see after 30 to 40 s that FS consumes all the CPU ressources (with a mean of 50-60 % before), with 80 calls. When I set 70 calls, I have to wait 70-80 s before seeing the same issue.
Presence is set to false on the 2 profile.
I have the same issue with FS 1.0.2 that' s why I tried FS 11560.
When I use the FS machine as a router to test the packet per second performance, I'm reaching 100Mbps with 8000pps in each direction (from vlan 55 to vlan56) with less than 12% CPU. So that I don't think there's an issue with the network.
Here is an "mpstat -P ALL 1" to show you what's happening suddenly with 70 bridge calls: 12:31:26 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:27 all 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00 12:31:27 0 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00
12:31:27 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:28 all 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35 12:31:28 0 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35
12:31:28 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:29 all 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17 12:31:29 0 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17
The CPU is going from 89% idle to 0% in less than 2 seconds.
I know that I don't have to expect too much from this kind of hardware, but it seems strange that the CPU power vanished so suddenly.
Thanks a lot for the guys that have read this long mail :p
kind regards, rod
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> <mailto:Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
-- Anthony Minessale II
FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/
AIM: anthm MSN:anthony_minessale@hotmail.com
<mailto:MSN%3Aanthony_minessale@hotmail.com>
<mailto:MSN%3Aanthony_minessale@hotmail.com <mailto:MSN%253Aanthony_minessale@hotmail.com>> GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com <mailto:PAYPAL%3Aanthony.minessale@gmail.com> <mailto:PAYPAL%3Aanthony.minessale@gmail.com <mailto:PAYPAL%253Aanthony.minessale@gmail.com>> IRC: irc.freenode.net <http://irc.freenode.net> <http://irc.freenode.net> #freeswitch
FreeSWITCH Developer Conference sip:888@conference.freeswitch.org <mailto:sip%3A888@conference.freeswitch.org> <mailto:sip%3A888@conference.freeswitch.org <mailto:sip%253A888@conference.freeswitch.org>> iax:guest@conference.freeswitch.org/888 <http://iax:guest@conference.freeswitch.org/888> <http://iax:guest@conference.freeswitch.org/888> googletalk:conf+888@conference.freeswitch.org <mailto:googletalk%3Aconf%2B888@conference.freeswitch.org> <mailto:googletalk%3Aconf%2B888@conference.freeswitch.org <mailto:googletalk%253Aconf%252B888@conference.freeswitch.org>> pstn:213-799-1400
------------------------------------------------------------------------
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
------------------------------------------------------------------------
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Hi Ken, Jay, thanks for pointing to proxy media, I will test. Ken, you are right, I was brain damaged (a stupid mistake) when setting INFO cause this kind of level could be very verbose. I'm switching to CRIT or ERR. Thanks guys, rod. thanks for Ken Rice wrote:
If you don't have to transcode, using proxy media mode will still save you some CPU time. This is 1/2 way between bypass media and the default media interactive mode. The other draw back to this mode is if you are using FS to clean up RTP and DTMF you loose those functions but they are not needed in most use cases.
As far as the log level goes, I found that once I had things stable setting the loglevel to helped a good deal... Info is probably a bit too high of a loglevel I would probably go for CRIT or ERR (2 or 1 respectively) if you insist on leaving logging turned on... On a busy system these can and will generate a good deal of activity (and disk IO if using mod_logfile)
Ken
From: rod <kawarod@laposte.net> Reply-To: <freeswitch-users@lists.freeswitch.org> Date: Mon, 02 Feb 2009 11:36:35 +0400 To: <freeswitch-users@lists.freeswitch.org> Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Ken,
1) I'd like to use FS to hide topology, so bypass media is not possible 2) done 3) done 4) not used 5) i'm using this ins switch.xml -> <param name="loglevel" value="info"/>, if you think an other log level is more suitable.
Regarding logging, I can see in console and in the freeswitch.log that there is still a lot of NOTICE logging, see below: 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8721 (sofia/internal/sipp@10.10.10.1:5060) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/internal/sipp@10.10.10.1:5060 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8722 (sofia/external/9998@10.10.20.100) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/external/9998@10.10.20.100 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] sofia.c:3164 sofia_handle_sip_i_state() Channel [sofia/external/9998@10.10.20.100] has been answered 2009-02-02 08:33:56 [WARNING] mod_sofia.c:740 sofia_read_frame() Changing codec ptime to 30. I bet you have a linksys/sipura =D
Do you have any idea where I can switch off this kind of logging. I thought it should be in /dialplan/internal.xml, but I see that in internal.xml -> <param name="debug" value="0"/>
thanks a lot for your suggestion.
regards, rod
Ken Rice wrote:
Dont forget there are several things you can do to increase performance...
1) where possible use bypass media or media proxy modes 2) mount freeswitch/db as a ram drive (if you are using voicemail with the internal FS DBs you'll need a way to make this persistant across reboots) 3) see the wiki for setting reasonable ulimits 4) (this is my oppinion others may vary) dont use mod_cdr_csv 5) turn off (or reduce logging) in switch.conf.xml
all of these thing can greatly improve performance.
On Mon, Feb 2, 2009 at 1:04 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net>> wrote:
Thanks Anthony,
the setup is like this:
sipp server ---- FS 1 ---- FS2
FS1 is the AMD CPU that has only one extension in dialplan that bridges 9999 to FS2. 9999 is the first extension in FS2 dialplan that plays moh, FS2 has no CPU pbm.
FS1 is maxing out at 60 bridged calls without your option -hp.
Using -hp, I'm now able to bridge 200 concurrent calls (a great improvement) and the system is still reactive. CPU load is high but not 100% and as the system responds well, I think that doesn't matter. The 2GB of memory are completely consumed (top command shows 700MB for FS process).
I understand that FS1 server is not the best hardware platform, and I'm waiting for new 4 cores server for testing. I will update those numbers when testing with the new hardware.
regards, rod.
Anthony Minessale wrote:
Which of the 2 machines has the load issue? You said it was one box calling the other.
You have 2 major things against you, single CPU and AMD, but you should at least be able to get in the vicinity of 800-1000 calls
on a
box like that.
Are you calling the default 9999? It's not really an appropriate extension for load testing. On the terminating box you should set up a manual extension that is the first one in the dial plan to play a wav file from preferably a ram disk or /tmp
If you do plan on using this in production accept nothing less
than a
multi-core intel machine with at least 4 cores, the more cores the better because that parallel processing is where FS gets it's
atvantage.
On Fri, Jan 30, 2009 at 5:56 AM, rod <kawarod@laposte.net
<mailto:kawarod@laposte.net>
<mailto:kawarod@laposte.net <mailto:kawarod@laposte.net>>> wrote:
Dear list,
I've been playing with freeswitch for some time (2 months)
and the
fact is that I'm very pleased with the functionnalities of this
software.
I'd like to use FS as a SBC handling media and I'm doing some tests with sipp to load the machine but I'm unable to bridge more than
60 calls
without seeing the CPU being loaded at 100%. I'm sure
something is
going wrong with my setup but I'm unable to see what.
The test machine has the following specs: Athlon XP 3500+ with 2GB of memory (I know this is not a
high end
machine :p)
Freeswitch:/opt/freeswitch/log# cat /proc/cpuinfo processor : 0 vendor_id : AuthenticAMD cpu family : 15 model : 95 model name : AMD Athlon(tm) 64 Processor 3500+ stepping : 2 cpu MHz : 2199.973 cache size : 512 KB fpu : yes fpu_exception : yes cpuid level : 1 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic
sep mtrr pge
mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt rdtscp lm 3dnowext 3dnow up rep_good pni cx16 lahf_lm svm
extapic
cr8_legacy bogomips : 4402.97 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management: ts fid vid ttp tm stc
I installed FS on a fresh debian 64: Linux Freeswitch 2.6.26-1-amd64 #1 SMP Sat Jan 10 17:57:00
UTC 2009
x86_64 GNU/Linux
I set the ulimit parameters like those on the website: freeswitch@internal> ... Freeswitch:/opt/free-svn/bin# ulimit -a core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 999999 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) unlimited real-time priority (-r) 0 stack size (kbytes, -s) 244 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited
My network setup is the following:
SIPP machine (10.10.10.1/24)----------------vlan
<http://10.10.10.1/24%29----------------vlan>
<http://10.10.10.1/24%29----------------vlan> 55 ----------(10.10.10.254/24 <http://10.10.10.254/24>
(10.10.20.254/24)--------------
<http://10.10.20.254/24%29-------------->
<http://10.10.20.254/24%29--------------> vlan56 -------------------(10.10.20.100/24 <http://10.10.20.100/24>
OTHER STOCK FS
I launched sipp with: sipp -sn uac_pcap -s 9999 -r 10 -l 80 -d 60000 -mi
10.10.10.1 -i
10.10.10.1 -mp 25000 10.10.10.254:5060
<http://10.10.10.254:5060> <http://10.10.10.254:5060>
The dialplan on FS is very simple: <?xml version="1.0" encoding="utf-8"?> <!-- http://wiki.freeswitch.org/wiki/Dialplan_XML --> <include> <context name="default">
<extension name="hold_music_bridge"> <condition field="destination_number" expression="^9999$"> <action application="answer"/> <action application="bridge" data="sofia/external/9999@10.10.20.100
<mailto:9999@10.10.20.100> <mailto:9999@10.10.20.100 <mailto:9999@10.10.20.100>>"/>
</condition> </extension> </context>
</include>
FreeSWITCH Version 1.0.trunk (11560M) Started. Crash Protection [Disabled] Max Sessions[1000] Session Rate[100] SQL [Enabled]
The test is very simple: sipp dial 9999 that matches in my
FS dialplan
and this is bridged to an other FS machine playing music on
hold.
When I launch "top" I see after 30 to 40 s that FS consumes all the CPU ressources (with a mean of 50-60 % before), with 80 calls. When I set 70 calls, I have to wait 70-80 s before seeing
the same
issue.
Presence is set to false on the 2 profile.
I have the same issue with FS 1.0.2 that' s why I tried FS
11560.
When I use the FS machine as a router to test the packet per
second
performance, I'm reaching 100Mbps with 8000pps in each
direction (from
vlan 55 to vlan56) with less than 12% CPU. So that I don't think there's an issue with the network.
Here is an "mpstat -P ALL 1" to show you what's happening
suddenly
with 70 bridge calls: 12:31:26 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:27 all 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00 12:31:27 0 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00
12:31:27 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:28 all 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35 12:31:28 0 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35
12:31:28 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:29 all 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17 12:31:29 0 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17
The CPU is going from 89% idle to 0% in less than 2 seconds.
I know that I don't have to expect too much from this kind of hardware, but it seems strange that the CPU power vanished so suddenly.
Thanks a lot for the guys that have read this long mail :p
kind regards, rod
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>
<mailto:Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
-- Anthony Minessale II
FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/
AIM: anthm MSN:anthony_minessale@hotmail.com
<mailto:MSN%3Aanthony_minessale@hotmail.com>
<mailto:MSN%3Aanthony_minessale@hotmail.com
<mailto:MSN%253Aanthony_minessale@hotmail.com>>
GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com
<mailto:PAYPAL%3Aanthony.minessale@gmail.com>
<mailto:PAYPAL%3Aanthony.minessale@gmail.com
<mailto:PAYPAL%253Aanthony.minessale@gmail.com>>
IRC: irc.freenode.net <http://irc.freenode.net>
<http://irc.freenode.net> #freeswitch
FreeSWITCH Developer Conference sip:888@conference.freeswitch.org
<mailto:sip%3A888@conference.freeswitch.org>
<mailto:sip%3A888@conference.freeswitch.org
<mailto:sip%253A888@conference.freeswitch.org>>
iax:guest@conference.freeswitch.org/888
<http://iax:guest@conference.freeswitch.org/888>
<http://iax:guest@conference.freeswitch.org/888> googletalk:conf+888@conference.freeswitch.org
<mailto:googletalk%3Aconf%2B888@conference.freeswitch.org>
<mailto:googletalk%3Aconf%2B888@conference.freeswitch.org
<mailto:googletalk%253Aconf%252B888@conference.freeswitch.org>>
pstn:213-799-1400
------------------------------------------------------------------------
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
------------------------------------------------------------------------
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Hi Rod, Could you please share how you configured Sipp & FS to create a test environment? Especially the dial plan, sofia settings etc..., actually I am a newbie. I want to test it on a single FS machine. Kind Regards Saeed -----Original Message----- From: freeswitch-users-bounces@lists.freeswitch.org [mailto:freeswitch-users-bounces@lists.freeswitch.org] On Behalf Of rod Sent: Monday, February 02, 2009 11:00 AM To: freeswitch-users@lists.freeswitch.org Subject: Re: [Freeswitch-users] Strange Performance when using as SBC Hi Ken, Jay, thanks for pointing to proxy media, I will test. Ken, you are right, I was brain damaged (a stupid mistake) when setting INFO cause this kind of level could be very verbose. I'm switching to CRIT or ERR. Thanks guys, rod. thanks for Ken Rice wrote:
If you don't have to transcode, using proxy media mode will still save you some CPU time. This is 1/2 way between bypass media and the default media interactive mode. The other draw back to this mode is if you are using FS to clean up RTP and DTMF you loose those functions but they are not needed in most use cases.
As far as the log level goes, I found that once I had things stable setting the loglevel to helped a good deal... Info is probably a bit too high of a loglevel I would probably go for CRIT or ERR (2 or 1 respectively) if you insist on leaving logging turned on... On a busy system these can and will generate a good deal of activity (and disk IO if using mod_logfile)
Ken
From: rod <kawarod@laposte.net> Reply-To: <freeswitch-users@lists.freeswitch.org> Date: Mon, 02 Feb 2009 11:36:35 +0400 To: <freeswitch-users@lists.freeswitch.org> Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Ken,
1) I'd like to use FS to hide topology, so bypass media is not possible 2) done 3) done 4) not used 5) i'm using this ins switch.xml -> <param name="loglevel" value="info"/>, if you think an other log level is more suitable.
Regarding logging, I can see in console and in the freeswitch.log that there is still a lot of NOTICE logging, see below: 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8721 (sofia/internal/sipp@10.10.10.1:5060) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/internal/sipp@10.10.10.1:5060 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8722 (sofia/external/9998@10.10.20.100) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/external/9998@10.10.20.100 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] sofia.c:3164 sofia_handle_sip_i_state() Channel [sofia/external/9998@10.10.20.100] has been answered 2009-02-02 08:33:56 [WARNING] mod_sofia.c:740 sofia_read_frame() Changing codec ptime to 30. I bet you have a linksys/sipura =D
Do you have any idea where I can switch off this kind of logging. I thought it should be in /dialplan/internal.xml, but I see that in internal.xml -> <param name="debug" value="0"/>
thanks a lot for your suggestion.
regards, rod
Ken Rice wrote:
Dont forget there are several things you can do to increase performance...
1) where possible use bypass media or media proxy modes 2) mount freeswitch/db as a ram drive (if you are using voicemail with the internal FS DBs you'll need a way to make this persistant across reboots) 3) see the wiki for setting reasonable ulimits 4) (this is my oppinion others may vary) dont use mod_cdr_csv 5) turn off (or reduce logging) in switch.conf.xml
all of these thing can greatly improve performance.
On Mon, Feb 2, 2009 at 1:04 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net>> wrote:
Thanks Anthony,
the setup is like this:
sipp server ---- FS 1 ---- FS2
FS1 is the AMD CPU that has only one extension in dialplan that bridges 9999 to FS2. 9999 is the first extension in FS2 dialplan that plays moh, FS2 has no CPU pbm.
FS1 is maxing out at 60 bridged calls without your option -hp.
Using -hp, I'm now able to bridge 200 concurrent calls (a great improvement) and the system is still reactive. CPU load is high but not 100% and as the system responds well, I think that doesn't matter. The 2GB of memory are completely consumed (top command shows 700MB for FS process).
I understand that FS1 server is not the best hardware platform, and I'm waiting for new 4 cores server for testing. I will update those numbers when testing with the new hardware.
regards, rod.
Anthony Minessale wrote:
Which of the 2 machines has the load issue? You said it was one box calling the other.
You have 2 major things against you, single CPU and AMD, but you should at least be able to get in the vicinity of 800-1000 calls
on a
box like that.
Are you calling the default 9999? It's not really an appropriate extension for load testing. On the terminating box you should set up a manual extension that is the first one in the dial plan to play a wav file from preferably a ram disk or /tmp
If you do plan on using this in production accept nothing less
than a
multi-core intel machine with at least 4 cores, the more cores the better because that parallel processing is where FS gets it's
atvantage.
On Fri, Jan 30, 2009 at 5:56 AM, rod <kawarod@laposte.net
<mailto:kawarod@laposte.net>
<mailto:kawarod@laposte.net <mailto:kawarod@laposte.net>>> wrote:
Dear list,
I've been playing with freeswitch for some time (2 months)
and the
fact is that I'm very pleased with the functionnalities of this
software.
I'd like to use FS as a SBC handling media and I'm doing some tests with sipp to load the machine but I'm unable to bridge more than
60 calls
without seeing the CPU being loaded at 100%. I'm sure
something is
going wrong with my setup but I'm unable to see what.
The test machine has the following specs: Athlon XP 3500+ with 2GB of memory (I know this is not a
high end
machine :p)
Freeswitch:/opt/freeswitch/log# cat /proc/cpuinfo processor : 0 vendor_id : AuthenticAMD cpu family : 15 model : 95 model name : AMD Athlon(tm) 64 Processor 3500+ stepping : 2 cpu MHz : 2199.973 cache size : 512 KB fpu : yes fpu_exception : yes cpuid level : 1 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic
sep mtrr pge
mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt rdtscp lm 3dnowext 3dnow up rep_good pni cx16 lahf_lm svm
extapic
cr8_legacy bogomips : 4402.97 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management: ts fid vid ttp tm stc
I installed FS on a fresh debian 64: Linux Freeswitch 2.6.26-1-amd64 #1 SMP Sat Jan 10 17:57:00
UTC 2009
x86_64 GNU/Linux
I set the ulimit parameters like those on the website: freeswitch@internal> ... Freeswitch:/opt/free-svn/bin# ulimit -a core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 999999 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) unlimited real-time priority (-r) 0 stack size (kbytes, -s) 244 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited
My network setup is the following:
SIPP machine (10.10.10.1/24)----------------vlan
<http://10.10.10.1/24%29----------------vlan>
<http://10.10.10.1/24%29----------------vlan> 55 ----------(10.10.10.254/24 <http://10.10.10.254/24>
(10.10.20.254/24)--------------
<http://10.10.20.254/24%29-------------->
<http://10.10.20.254/24%29--------------> vlan56 -------------------(10.10.20.100/24 <http://10.10.20.100/24>
OTHER STOCK FS
I launched sipp with: sipp -sn uac_pcap -s 9999 -r 10 -l 80 -d 60000 -mi
10.10.10.1 -i
10.10.10.1 -mp 25000 10.10.10.254:5060
<http://10.10.10.254:5060> <http://10.10.10.254:5060>
The dialplan on FS is very simple: <?xml version="1.0" encoding="utf-8"?> <!-- http://wiki.freeswitch.org/wiki/Dialplan_XML --> <include> <context name="default">
<extension name="hold_music_bridge"> <condition field="destination_number" expression="^9999$"> <action application="answer"/> <action application="bridge" data="sofia/external/9999@10.10.20.100
<mailto:9999@10.10.20.100> <mailto:9999@10.10.20.100 <mailto:9999@10.10.20.100>>"/>
</condition> </extension> </context>
</include>
FreeSWITCH Version 1.0.trunk (11560M) Started. Crash Protection [Disabled] Max Sessions[1000] Session Rate[100] SQL [Enabled]
The test is very simple: sipp dial 9999 that matches in my
FS dialplan
and this is bridged to an other FS machine playing music on
hold.
When I launch "top" I see after 30 to 40 s that FS consumes all the CPU ressources (with a mean of 50-60 % before), with 80 calls. When I set 70 calls, I have to wait 70-80 s before seeing
the same
issue.
Presence is set to false on the 2 profile.
I have the same issue with FS 1.0.2 that' s why I tried FS
11560.
When I use the FS machine as a router to test the packet per
second
performance, I'm reaching 100Mbps with 8000pps in each
direction (from
vlan 55 to vlan56) with less than 12% CPU. So that I don't think there's an issue with the network.
Here is an "mpstat -P ALL 1" to show you what's happening
suddenly
with 70 bridge calls: 12:31:26 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:27 all 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00 12:31:27 0 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00
12:31:27 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:28 all 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35 12:31:28 0 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35
12:31:28 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:29 all 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17 12:31:29 0 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17
The CPU is going from 89% idle to 0% in less than 2 seconds.
I know that I don't have to expect too much from this kind of hardware, but it seems strange that the CPU power vanished so suddenly.
Thanks a lot for the guys that have read this long mail :p
kind regards, rod
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>
<mailto:Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
-- Anthony Minessale II
FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/
AIM: anthm MSN:anthony_minessale@hotmail.com
<mailto:MSN%3Aanthony_minessale@hotmail.com>
<mailto:MSN%3Aanthony_minessale@hotmail.com
<mailto:MSN%253Aanthony_minessale@hotmail.com>>
GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com
<mailto:PAYPAL%3Aanthony.minessale@gmail.com>
<mailto:PAYPAL%3Aanthony.minessale@gmail.com
<mailto:PAYPAL%253Aanthony.minessale@gmail.com>>
IRC: irc.freenode.net <http://irc.freenode.net>
<http://irc.freenode.net> #freeswitch
FreeSWITCH Developer Conference sip:888@conference.freeswitch.org
<mailto:sip%3A888@conference.freeswitch.org>
<mailto:sip%3A888@conference.freeswitch.org
<mailto:sip%253A888@conference.freeswitch.org>>
iax:guest@conference.freeswitch.org/888
<http://iax:guest@conference.freeswitch.org/888>
<http://iax:guest@conference.freeswitch.org/888> googletalk:conf+888@conference.freeswitch.org
<mailto:googletalk%3Aconf%2B888@conference.freeswitch.org>
<mailto:googletalk%3Aconf%2B888@conference.freeswitch.org
<mailto:googletalk%253Aconf%252B888@conference.freeswitch.org>>
pstn:213-799-1400
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
------------------------------------------------------------------------
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Hi Saeed, I just created an account to share my setup on the wiki. I will detail all the steps for a clean install of a debian64 lenny with FS used as a SBC (next step is to try the new LCR module :) )and what I'm doing do stress the server. I wrote nothing at this time so please be patient, I'm waiting for my new hardware so that I will detail as much as possible what I'll do. For beginning I suggest you reading the start page on the wiki, especially these pages: -http://wiki.freeswitch.org/wiki/Getting_Started_Guide -http://wiki.freeswitch.org/wiki/Dialplan_XML maybe you could tell more about the linux distribution you're using so that I can give you some pointers for sipp... regards. rod. Saeed Ahmed wrote:
Hi Rod,
Could you please share how you configured Sipp & FS to create a test environment? Especially the dial plan, sofia settings etc..., actually I am a newbie. I want to test it on a single FS machine.
Kind Regards Saeed -----Original Message----- From: freeswitch-users-bounces@lists.freeswitch.org [mailto:freeswitch-users-bounces@lists.freeswitch.org] On Behalf Of rod Sent: Monday, February 02, 2009 11:00 AM To: freeswitch-users@lists.freeswitch.org Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Ken, Jay,
thanks for pointing to proxy media, I will test.
Ken, you are right, I was brain damaged (a stupid mistake) when setting INFO cause this kind of level could be very verbose. I'm switching to CRIT or ERR.
Thanks guys, rod.
thanks for
Ken Rice wrote:
If you don't have to transcode, using proxy media mode will still save you some CPU time. This is 1/2 way between bypass media and the default media interactive mode. The other draw back to this mode is if you are using FS
to
clean up RTP and DTMF you loose those functions but they are not needed in most use cases.
As far as the log level goes, I found that once I had things stable
setting
the loglevel to helped a good deal... Info is probably a bit too high of a loglevel I would probably go for CRIT or ERR (2 or 1 respectively) if you insist on leaving logging turned on... On a busy system these can and will generate a good deal of activity (and disk IO if using mod_logfile)
Ken
From: rod <kawarod@laposte.net> Reply-To: <freeswitch-users@lists.freeswitch.org> Date: Mon, 02 Feb 2009 11:36:35 +0400 To: <freeswitch-users@lists.freeswitch.org> Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Ken,
1) I'd like to use FS to hide topology, so bypass media is not possible 2) done 3) done 4) not used 5) i'm using this ins switch.xml -> <param name="loglevel" value="info"/>, if you think an other log level is more suitable.
Regarding logging, I can see in console and in the freeswitch.log that there is still a lot of NOTICE logging, see below: 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8721 (sofia/internal/sipp@10.10.10.1:5060) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/internal/sipp@10.10.10.1:5060 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8722 (sofia/external/9998@10.10.20.100) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/external/9998@10.10.20.100 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] sofia.c:3164 sofia_handle_sip_i_state() Channel [sofia/external/9998@10.10.20.100] has been answered 2009-02-02 08:33:56 [WARNING] mod_sofia.c:740 sofia_read_frame() Changing codec ptime to 30. I bet you have a linksys/sipura =D
Do you have any idea where I can switch off this kind of logging. I thought it should be in /dialplan/internal.xml, but I see that in internal.xml -> <param name="debug" value="0"/>
thanks a lot for your suggestion.
regards, rod
Ken Rice wrote:
Dont forget there are several things you can do to increase
performance...
1) where possible use bypass media or media proxy modes 2) mount freeswitch/db as a ram drive (if you are using voicemail with the internal FS DBs you'll need a way to make this persistant across reboots) 3) see the wiki for setting reasonable ulimits 4) (this is my oppinion others may vary) dont use mod_cdr_csv 5) turn off (or reduce logging) in switch.conf.xml
all of these thing can greatly improve performance.
On Mon, Feb 2, 2009 at 1:04 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net>> wrote:
Thanks Anthony,
the setup is like this:
sipp server ---- FS 1 ---- FS2
FS1 is the AMD CPU that has only one extension in dialplan that bridges 9999 to FS2. 9999 is the first extension in FS2 dialplan that plays moh, FS2 has no CPU pbm.
FS1 is maxing out at 60 bridged calls without your option -hp.
Using -hp, I'm now able to bridge 200 concurrent calls (a great improvement) and the system is still reactive. CPU load is high but not 100% and as the system responds well, I think that doesn't matter.
The
2GB of memory are completely consumed (top command shows 700MB for
FS
process).
I understand that FS1 server is not the best hardware platform, and I'm waiting for new 4 cores server for testing. I will update those numbers when testing with the new hardware.
regards, rod.
Anthony Minessale wrote:
Which of the 2 machines has the load issue? You said it was one box calling the other.
You have 2 major things against you, single CPU and AMD, but you should at least be able to get in the vicinity of 800-1000 calls
on a
box like that.
Are you calling the default 9999? It's not really an appropriate extension for load testing. On the terminating box you should set up a manual extension that is the first one in the dial plan to play a wav file from preferably a ram disk or /tmp
If you do plan on using this in production accept nothing less
than a
multi-core intel machine with at least 4 cores, the more cores the better because that parallel processing is where FS gets it's
atvantage.
On Fri, Jan 30, 2009 at 5:56 AM, rod <kawarod@laposte.net
<mailto:kawarod@laposte.net>
<mailto:kawarod@laposte.net <mailto:kawarod@laposte.net>>> wrote:
Dear list,
I've been playing with freeswitch for some time (2 months)
and the
fact is that I'm very pleased with the functionnalities of this
software.
I'd like to use FS as a SBC handling media and I'm doing some tests with sipp to load the machine but I'm unable to bridge more than
60 calls
without seeing the CPU being loaded at 100%. I'm sure
something is
going wrong with my setup but I'm unable to see what.
The test machine has the following specs: Athlon XP 3500+ with 2GB of memory (I know this is not a
high end
machine :p)
Freeswitch:/opt/freeswitch/log# cat /proc/cpuinfo processor : 0 vendor_id : AuthenticAMD cpu family : 15 model : 95 model name : AMD Athlon(tm) 64 Processor 3500+ stepping : 2 cpu MHz : 2199.973 cache size : 512 KB fpu : yes fpu_exception : yes cpuid level : 1 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic
sep mtrr pge
mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt rdtscp lm 3dnowext 3dnow up rep_good pni cx16 lahf_lm svm
extapic
cr8_legacy bogomips : 4402.97 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management: ts fid vid ttp tm stc
I installed FS on a fresh debian 64: Linux Freeswitch 2.6.26-1-amd64 #1 SMP Sat Jan 10 17:57:00
UTC 2009
x86_64 GNU/Linux
I set the ulimit parameters like those on the website: freeswitch@internal> ... Freeswitch:/opt/free-svn/bin# ulimit -a core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 999999 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) unlimited real-time priority (-r) 0 stack size (kbytes, -s) 244 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited
My network setup is the following:
SIPP machine (10.10.10.1/24)----------------vlan
<http://10.10.10.1/24%29----------------vlan>
<http://10.10.10.1/24%29----------------vlan> 55 ----------(10.10.10.254/24 <http://10.10.10.254/24>
(10.10.20.254/24)--------------
<http://10.10.20.254/24%29-------------->
<http://10.10.20.254/24%29--------------> vlan56 -------------------(10.10.20.100/24 <http://10.10.20.100/24>
OTHER STOCK FS
I launched sipp with: sipp -sn uac_pcap -s 9999 -r 10 -l 80 -d 60000 -mi
10.10.10.1 -i
10.10.10.1 -mp 25000 10.10.10.254:5060
<http://10.10.10.254:5060> <http://10.10.10.254:5060>
The dialplan on FS is very simple: <?xml version="1.0" encoding="utf-8"?> <!-- http://wiki.freeswitch.org/wiki/Dialplan_XML --> <include> <context name="default">
<extension name="hold_music_bridge"> <condition field="destination_number" expression="^9999$"> <action application="answer"/> <action application="bridge" data="sofia/external/9999@10.10.20.100
<mailto:9999@10.10.20.100> <mailto:9999@10.10.20.100 <mailto:9999@10.10.20.100>>"/>
</condition> </extension> </context>
</include>
FreeSWITCH Version 1.0.trunk (11560M) Started. Crash Protection [Disabled] Max Sessions[1000] Session Rate[100] SQL [Enabled]
The test is very simple: sipp dial 9999 that matches in my
FS dialplan
and this is bridged to an other FS machine playing music on
hold.
When I launch "top" I see after 30 to 40 s that FS consumes all the CPU ressources (with a mean of 50-60 % before), with 80 calls. When I set 70 calls, I have to wait 70-80 s before seeing
the same
issue.
Presence is set to false on the 2 profile.
I have the same issue with FS 1.0.2 that' s why I tried FS
11560.
When I use the FS machine as a router to test the packet per
second
performance, I'm reaching 100Mbps with 8000pps in each
direction (from
vlan 55 to vlan56) with less than 12% CPU. So that I don't think there's an issue with the network.
Here is an "mpstat -P ALL 1" to show you what's happening
suddenly
with 70 bridge calls: 12:31:26 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:27 all 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00 12:31:27 0 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00
12:31:27 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:28 all 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35 12:31:28 0 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35
12:31:28 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:29 all 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17 12:31:29 0 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17
The CPU is going from 89% idle to 0% in less than 2 seconds.
I know that I don't have to expect too much from this kind of hardware, but it seems strange that the CPU power vanished so suddenly.
Thanks a lot for the guys that have read this long mail :p
kind regards, rod
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>
<mailto:Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
-- Anthony Minessale II
FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/
AIM: anthm MSN:anthony_minessale@hotmail.com
<mailto:MSN%3Aanthony_minessale@hotmail.com>
<mailto:MSN%3Aanthony_minessale@hotmail.com
<mailto:MSN%253Aanthony_minessale@hotmail.com>>
GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com
<mailto:PAYPAL%3Aanthony.minessale@gmail.com>
<mailto:PAYPAL%3Aanthony.minessale@gmail.com
<mailto:PAYPAL%253Aanthony.minessale@gmail.com>>
IRC: irc.freenode.net <http://irc.freenode.net>
<http://irc.freenode.net> #freeswitch
FreeSWITCH Developer Conference sip:888@conference.freeswitch.org
<mailto:sip%3A888@conference.freeswitch.org>
<mailto:sip%3A888@conference.freeswitch.org
<mailto:sip%253A888@conference.freeswitch.org>>
iax:guest@conference.freeswitch.org/888
<http://iax:guest@conference.freeswitch.org/888>
<http://iax:guest@conference.freeswitch.org/888> googletalk:conf+888@conference.freeswitch.org
<mailto:googletalk%3Aconf%2B888@conference.freeswitch.org>
<mailto:googletalk%3Aconf%2B888@conference.freeswitch.org
<mailto:googletalk%253Aconf%252B888@conference.freeswitch.org>>
pstn:213-799-1400
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
------------------------------------------------------------------------
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Thanks rod for a quick answer, FS is installed on Ubuntu Server. I am planning to replace Nextone SBC with FS, Later I'll also use openZAP to communicate with TDM but this all depends how much calls it can take, or maybe we can also do something in clustering environment ( I am not sure about it). But thanks again and any further help will be highly appreciated. Kind Regards Saeed Ahmed Tariq -----Original Message----- From: freeswitch-users-bounces@lists.freeswitch.org [mailto:freeswitch-users-bounces@lists.freeswitch.org] On Behalf Of rod Sent: Monday, February 02, 2009 1:53 PM To: freeswitch-users@lists.freeswitch.org Subject: Re: [Freeswitch-users] Strange Performance when using as SBC Hi Saeed, I just created an account to share my setup on the wiki. I will detail all the steps for a clean install of a debian64 lenny with FS used as a SBC (next step is to try the new LCR module :) )and what I'm doing do stress the server. I wrote nothing at this time so please be patient, I'm waiting for my new hardware so that I will detail as much as possible what I'll do. For beginning I suggest you reading the start page on the wiki, especially these pages: -http://wiki.freeswitch.org/wiki/Getting_Started_Guide -http://wiki.freeswitch.org/wiki/Dialplan_XML maybe you could tell more about the linux distribution you're using so that I can give you some pointers for sipp... regards. rod. Saeed Ahmed wrote:
Hi Rod,
Could you please share how you configured Sipp & FS to create a test environment? Especially the dial plan, sofia settings etc..., actually I am a newbie. I want to test it on a single FS machine.
Kind Regards Saeed -----Original Message----- From: freeswitch-users-bounces@lists.freeswitch.org [mailto:freeswitch-users-bounces@lists.freeswitch.org] On Behalf Of rod Sent: Monday, February 02, 2009 11:00 AM To: freeswitch-users@lists.freeswitch.org Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Ken, Jay,
thanks for pointing to proxy media, I will test.
Ken, you are right, I was brain damaged (a stupid mistake) when setting INFO cause this kind of level could be very verbose. I'm switching to CRIT or ERR.
Thanks guys, rod.
thanks for
Ken Rice wrote:
If you don't have to transcode, using proxy media mode will still save you some CPU time. This is 1/2 way between bypass media and the default media interactive mode. The other draw back to this mode is if you are using FS
to
clean up RTP and DTMF you loose those functions but they are not needed in most use cases.
As far as the log level goes, I found that once I had things stable
setting
the loglevel to helped a good deal... Info is probably a bit too high of a loglevel I would probably go for CRIT or ERR (2 or 1 respectively) if you insist on leaving logging turned on... On a busy system these can and will generate a good deal of activity (and disk IO if using mod_logfile)
Ken
From: rod <kawarod@laposte.net> Reply-To: <freeswitch-users@lists.freeswitch.org> Date: Mon, 02 Feb 2009 11:36:35 +0400 To: <freeswitch-users@lists.freeswitch.org> Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Ken,
1) I'd like to use FS to hide topology, so bypass media is not possible 2) done 3) done 4) not used 5) i'm using this ins switch.xml -> <param name="loglevel" value="info"/>, if you think an other log level is more suitable.
Regarding logging, I can see in console and in the freeswitch.log that there is still a lot of NOTICE logging, see below: 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8721 (sofia/internal/sipp@10.10.10.1:5060) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/internal/sipp@10.10.10.1:5060 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8722 (sofia/external/9998@10.10.20.100) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/external/9998@10.10.20.100 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] sofia.c:3164 sofia_handle_sip_i_state() Channel [sofia/external/9998@10.10.20.100] has been answered 2009-02-02 08:33:56 [WARNING] mod_sofia.c:740 sofia_read_frame() Changing codec ptime to 30. I bet you have a linksys/sipura =D
Do you have any idea where I can switch off this kind of logging. I thought it should be in /dialplan/internal.xml, but I see that in internal.xml -> <param name="debug" value="0"/>
thanks a lot for your suggestion.
regards, rod
Ken Rice wrote:
Dont forget there are several things you can do to increase
performance...
1) where possible use bypass media or media proxy modes 2) mount freeswitch/db as a ram drive (if you are using voicemail with the internal FS DBs you'll need a way to make this persistant across reboots) 3) see the wiki for setting reasonable ulimits 4) (this is my oppinion others may vary) dont use mod_cdr_csv 5) turn off (or reduce logging) in switch.conf.xml
all of these thing can greatly improve performance.
On Mon, Feb 2, 2009 at 1:04 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net>> wrote:
Thanks Anthony,
the setup is like this:
sipp server ---- FS 1 ---- FS2
FS1 is the AMD CPU that has only one extension in dialplan that bridges 9999 to FS2. 9999 is the first extension in FS2 dialplan that plays moh, FS2 has no CPU pbm.
FS1 is maxing out at 60 bridged calls without your option -hp.
Using -hp, I'm now able to bridge 200 concurrent calls (a great improvement) and the system is still reactive. CPU load is high but not 100% and as the system responds well, I think that doesn't matter.
The
2GB of memory are completely consumed (top command shows 700MB for
FS
process).
I understand that FS1 server is not the best hardware platform, and I'm waiting for new 4 cores server for testing. I will update those numbers when testing with the new hardware.
regards, rod.
Anthony Minessale wrote:
Which of the 2 machines has the load issue? You said it was one box calling the other.
You have 2 major things against you, single CPU and AMD, but you should at least be able to get in the vicinity of 800-1000 calls
on a
box like that.
Are you calling the default 9999? It's not really an appropriate extension for load testing. On the terminating box you should set up a manual extension that is the first one in the dial plan to play a wav file from preferably a ram disk or /tmp
If you do plan on using this in production accept nothing less
than a
multi-core intel machine with at least 4 cores, the more cores the better because that parallel processing is where FS gets it's
atvantage.
On Fri, Jan 30, 2009 at 5:56 AM, rod <kawarod@laposte.net
<mailto:kawarod@laposte.net>
<mailto:kawarod@laposte.net <mailto:kawarod@laposte.net>>> wrote:
Dear list,
I've been playing with freeswitch for some time (2 months)
and the
fact is that I'm very pleased with the functionnalities of this
software.
I'd like to use FS as a SBC handling media and I'm doing some tests with sipp to load the machine but I'm unable to bridge more than
60 calls
without seeing the CPU being loaded at 100%. I'm sure
something is
going wrong with my setup but I'm unable to see what.
The test machine has the following specs: Athlon XP 3500+ with 2GB of memory (I know this is not a
high end
machine :p)
Freeswitch:/opt/freeswitch/log# cat /proc/cpuinfo processor : 0 vendor_id : AuthenticAMD cpu family : 15 model : 95 model name : AMD Athlon(tm) 64 Processor 3500+ stepping : 2 cpu MHz : 2199.973 cache size : 512 KB fpu : yes fpu_exception : yes cpuid level : 1 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic
sep mtrr pge
mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt rdtscp lm 3dnowext 3dnow up rep_good pni cx16 lahf_lm svm
extapic
cr8_legacy bogomips : 4402.97 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management: ts fid vid ttp tm stc
I installed FS on a fresh debian 64: Linux Freeswitch 2.6.26-1-amd64 #1 SMP Sat Jan 10 17:57:00
UTC 2009
x86_64 GNU/Linux
I set the ulimit parameters like those on the website: freeswitch@internal> ... Freeswitch:/opt/free-svn/bin# ulimit -a core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 999999 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) unlimited real-time priority (-r) 0 stack size (kbytes, -s) 244 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited
My network setup is the following:
SIPP machine (10.10.10.1/24)----------------vlan
<http://10.10.10.1/24%29----------------vlan>
<http://10.10.10.1/24%29----------------vlan> 55 ----------(10.10.10.254/24 <http://10.10.10.254/24>
(10.10.20.254/24)--------------
<http://10.10.20.254/24%29-------------->
<http://10.10.20.254/24%29--------------> vlan56 -------------------(10.10.20.100/24 <http://10.10.20.100/24>
OTHER STOCK FS
I launched sipp with: sipp -sn uac_pcap -s 9999 -r 10 -l 80 -d 60000 -mi
10.10.10.1 -i
10.10.10.1 -mp 25000 10.10.10.254:5060
<http://10.10.10.254:5060> <http://10.10.10.254:5060>
The dialplan on FS is very simple: <?xml version="1.0" encoding="utf-8"?> <!-- http://wiki.freeswitch.org/wiki/Dialplan_XML --> <include> <context name="default">
<extension name="hold_music_bridge"> <condition field="destination_number" expression="^9999$"> <action application="answer"/> <action application="bridge" data="sofia/external/9999@10.10.20.100
<mailto:9999@10.10.20.100> <mailto:9999@10.10.20.100 <mailto:9999@10.10.20.100>>"/>
</condition> </extension> </context>
</include>
FreeSWITCH Version 1.0.trunk (11560M) Started. Crash Protection [Disabled] Max Sessions[1000] Session Rate[100] SQL [Enabled]
The test is very simple: sipp dial 9999 that matches in my
FS dialplan
and this is bridged to an other FS machine playing music on
hold.
When I launch "top" I see after 30 to 40 s that FS consumes all the CPU ressources (with a mean of 50-60 % before), with 80 calls. When I set 70 calls, I have to wait 70-80 s before seeing
the same
issue.
Presence is set to false on the 2 profile.
I have the same issue with FS 1.0.2 that' s why I tried FS
11560.
When I use the FS machine as a router to test the packet per
second
performance, I'm reaching 100Mbps with 8000pps in each
direction (from
vlan 55 to vlan56) with less than 12% CPU. So that I don't think there's an issue with the network.
Here is an "mpstat -P ALL 1" to show you what's happening
suddenly
with 70 bridge calls: 12:31:26 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:27 all 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00 12:31:27 0 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00
12:31:27 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:28 all 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35 12:31:28 0 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35
12:31:28 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:29 all 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17 12:31:29 0 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17
The CPU is going from 89% idle to 0% in less than 2 seconds.
I know that I don't have to expect too much from this kind of hardware, but it seems strange that the CPU power vanished so suddenly.
Thanks a lot for the guys that have read this long mail :p
kind regards, rod
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>
<mailto:Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
-- Anthony Minessale II
FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/
AIM: anthm MSN:anthony_minessale@hotmail.com
<mailto:MSN%3Aanthony_minessale@hotmail.com>
<mailto:MSN%3Aanthony_minessale@hotmail.com
<mailto:MSN%253Aanthony_minessale@hotmail.com>>
GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com
<mailto:PAYPAL%3Aanthony.minessale@gmail.com>
<mailto:PAYPAL%3Aanthony.minessale@gmail.com
<mailto:PAYPAL%253Aanthony.minessale@gmail.com>>
IRC: irc.freenode.net <http://irc.freenode.net>
<http://irc.freenode.net> #freeswitch
FreeSWITCH Developer Conference sip:888@conference.freeswitch.org
<mailto:sip%3A888@conference.freeswitch.org>
<mailto:sip%3A888@conference.freeswitch.org
<mailto:sip%253A888@conference.freeswitch.org>>
iax:guest@conference.freeswitch.org/888
<http://iax:guest@conference.freeswitch.org/888>
<http://iax:guest@conference.freeswitch.org/888> googletalk:conf+888@conference.freeswitch.org
<mailto:googletalk%3Aconf%2B888@conference.freeswitch.org>
<mailto:googletalk%3Aconf%2B888@conference.freeswitch.org
<mailto:googletalk%253Aconf%252B888@conference.freeswitch.org>>
pstn:213-799-1400
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
if you want to use ubuntu, be sure to use hardy and not intrepid. On Mon, Feb 2, 2009 at 7:03 AM, Saeed Ahmed <saeedahmad1981@gmail.com>wrote:
Thanks rod for a quick answer,
FS is installed on Ubuntu Server.
I am planning to replace Nextone SBC with FS, Later I'll also use openZAP to communicate with TDM but this all depends how much calls it can take, or maybe we can also do something in clustering environment ( I am not sure about it). But thanks again and any further help will be highly appreciated.
Kind Regards Saeed Ahmed Tariq
-----Original Message----- From: freeswitch-users-bounces@lists.freeswitch.org [mailto:freeswitch-users-bounces@lists.freeswitch.org] On Behalf Of rod Sent: Monday, February 02, 2009 1:53 PM To: freeswitch-users@lists.freeswitch.org Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Saeed,
I just created an account to share my setup on the wiki. I will detail all the steps for a clean install of a debian64 lenny with FS used as a SBC (next step is to try the new LCR module :) )and what I'm doing do stress the server.
I wrote nothing at this time so please be patient, I'm waiting for my new hardware so that I will detail as much as possible what I'll do.
For beginning I suggest you reading the start page on the wiki, especially these pages: -http://wiki.freeswitch.org/wiki/Getting_Started_Guide -http://wiki.freeswitch.org/wiki/Dialplan_XML
maybe you could tell more about the linux distribution you're using so that I can give you some pointers for sipp...
regards. rod.
Saeed Ahmed wrote:
Hi Rod,
Could you please share how you configured Sipp & FS to create a test environment? Especially the dial plan, sofia settings etc..., actually I am a newbie. I want to test it on a single FS machine.
Kind Regards Saeed -----Original Message----- From: freeswitch-users-bounces@lists.freeswitch.org [mailto:freeswitch-users-bounces@lists.freeswitch.org] On Behalf Of rod Sent: Monday, February 02, 2009 11:00 AM To: freeswitch-users@lists.freeswitch.org Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Ken, Jay,
thanks for pointing to proxy media, I will test.
Ken, you are right, I was brain damaged (a stupid mistake) when setting INFO cause this kind of level could be very verbose. I'm switching to CRIT or ERR.
Thanks guys, rod.
thanks for
Ken Rice wrote:
If you don't have to transcode, using proxy media mode will still save you some CPU time. This is 1/2 way between bypass media and the default media interactive mode. The other draw back to this mode is if you are using FS
to
clean up RTP and DTMF you loose those functions but they are not needed in most use cases.
As far as the log level goes, I found that once I had things stable
setting
the loglevel to helped a good deal... Info is probably a bit too high of a loglevel I would probably go for CRIT or ERR (2 or 1 respectively) if you insist on leaving logging turned on... On a busy system these can and will generate a good deal of activity (and disk IO if using mod_logfile)
Ken
From: rod <kawarod@laposte.net> Reply-To: <freeswitch-users@lists.freeswitch.org> Date: Mon, 02 Feb 2009 11:36:35 +0400 To: <freeswitch-users@lists.freeswitch.org> Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Ken,
1) I'd like to use FS to hide topology, so bypass media is not possible 2) done 3) done 4) not used 5) i'm using this ins switch.xml -> <param name="loglevel" value="info"/>, if you think an other log level is more suitable.
Regarding logging, I can see in console and in the freeswitch.log that there is still a lot of NOTICE logging, see below: 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8721 (sofia/internal/sipp@10.10.10.1:5060) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/internal/sipp@10.10.10.1:5060 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8722 (sofia/external/9998@10.10.20.100) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/external/9998@10.10.20.100 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] sofia.c:3164 sofia_handle_sip_i_state() Channel [sofia/external/9998@10.10.20.100] has been answered 2009-02-02 08:33:56 [WARNING] mod_sofia.c:740 sofia_read_frame() Changing codec ptime to 30. I bet you have a linksys/sipura =D
Do you have any idea where I can switch off this kind of logging. I thought it should be in /dialplan/internal.xml, but I see that in internal.xml -> <param name="debug" value="0"/>
thanks a lot for your suggestion.
regards, rod
Ken Rice wrote:
Dont forget there are several things you can do to increase
performance...
1) where possible use bypass media or media proxy modes 2) mount freeswitch/db as a ram drive (if you are using voicemail with the internal FS DBs you'll need a way to make this persistant across reboots) 3) see the wiki for setting reasonable ulimits 4) (this is my oppinion others may vary) dont use mod_cdr_csv 5) turn off (or reduce logging) in switch.conf.xml
all of these thing can greatly improve performance.
On Mon, Feb 2, 2009 at 1:04 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net>> wrote:
Thanks Anthony,
the setup is like this:
sipp server ---- FS 1 ---- FS2
FS1 is the AMD CPU that has only one extension in dialplan that bridges 9999 to FS2. 9999 is the first extension in FS2 dialplan that plays moh, FS2 has no CPU pbm.
FS1 is maxing out at 60 bridged calls without your option -hp.
Using -hp, I'm now able to bridge 200 concurrent calls (a great improvement) and the system is still reactive. CPU load is high but not 100% and as the system responds well, I think that doesn't matter.
The
2GB of memory are completely consumed (top command shows 700MB for
FS
process).
I understand that FS1 server is not the best hardware platform, and I'm waiting for new 4 cores server for testing. I will update those numbers when testing with the new hardware.
regards, rod.
Anthony Minessale wrote:
Which of the 2 machines has the load issue? You said it was one box calling the other.
You have 2 major things against you, single CPU and AMD, but you should at least be able to get in the vicinity of 800-1000 calls
on a
box like that.
Are you calling the default 9999? It's not really an appropriate extension for load testing. On the terminating box you should set up a manual extension that is the first one in the dial plan to play a wav file from preferably a ram disk or /tmp
If you do plan on using this in production accept nothing less
than a
multi-core intel machine with at least 4 cores, the more cores the better because that parallel processing is where FS gets it's
atvantage.
On Fri, Jan 30, 2009 at 5:56 AM, rod <kawarod@laposte.net
<mailto:kawarod@laposte.net>
<mailto:kawarod@laposte.net <mailto:kawarod@laposte.net>>> wrote:
Dear list,
I've been playing with freeswitch for some time (2 months)
and the
fact is that I'm very pleased with the functionnalities of this
software.
I'd like to use FS as a SBC handling media and I'm doing some tests with sipp to load the machine but I'm unable to bridge more than
60 calls
without seeing the CPU being loaded at 100%. I'm sure
something is
going wrong with my setup but I'm unable to see what.
The test machine has the following specs: Athlon XP 3500+ with 2GB of memory (I know this is not a
high end
machine :p)
Freeswitch:/opt/freeswitch/log# cat /proc/cpuinfo processor : 0 vendor_id : AuthenticAMD cpu family : 15 model : 95 model name : AMD Athlon(tm) 64 Processor 3500+ stepping : 2 cpu MHz : 2199.973 cache size : 512 KB fpu : yes fpu_exception : yes cpuid level : 1 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic
sep mtrr pge
mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt rdtscp lm 3dnowext 3dnow up rep_good pni cx16 lahf_lm svm
extapic
cr8_legacy bogomips : 4402.97 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management: ts fid vid ttp tm stc
I installed FS on a fresh debian 64: Linux Freeswitch 2.6.26-1-amd64 #1 SMP Sat Jan 10 17:57:00
UTC 2009
x86_64 GNU/Linux
I set the ulimit parameters like those on the website: freeswitch@internal> ... Freeswitch:/opt/free-svn/bin# ulimit -a core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 999999 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) unlimited real-time priority (-r) 0 stack size (kbytes, -s) 244 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited
My network setup is the following:
SIPP machine (10.10.10.1/24)----------------vlan<http://10.10.10.1/24%29----------------vlan>
<http://10.10.10.1/24%29----------------vlan>
<http://10.10.10.1/24%29----------------vlan> 55 ----------(10.10.10.254/24 <http://10.10.10.254/24>
(10.10.20.254/24)--------------<http://10.10.20.254/24%29-------------->
<http://10.10.20.254/24%29-------------->
<http://10.10.20.254/24%29--------------> vlan56 -------------------(10.10.20.100/24 <http://10.10.20.100/24>
OTHER STOCK FS
I launched sipp with: sipp -sn uac_pcap -s 9999 -r 10 -l 80 -d 60000 -mi
10.10.10.1 -i
10.10.10.1 -mp 25000 10.10.10.254:5060
<http://10.10.10.254:5060> <http://10.10.10.254:5060>
The dialplan on FS is very simple: <?xml version="1.0" encoding="utf-8"?> <!-- http://wiki.freeswitch.org/wiki/Dialplan_XML --> <include> <context name="default">
<extension name="hold_music_bridge"> <condition field="destination_number" expression="^9999$"> <action application="answer"/> <action application="bridge" data="sofia/external/9999@10.10.20.100
<mailto:9999@10.10.20.100> <mailto:9999@10.10.20.100 <mailto:9999@10.10.20.100>>"/>
</condition> </extension> </context>
</include>
FreeSWITCH Version 1.0.trunk (11560M) Started. Crash Protection [Disabled] Max Sessions[1000] Session Rate[100] SQL [Enabled]
The test is very simple: sipp dial 9999 that matches in my
FS dialplan
and this is bridged to an other FS machine playing music on
hold.
When I launch "top" I see after 30 to 40 s that FS consumes all the CPU ressources (with a mean of 50-60 % before), with 80 calls. When I set 70 calls, I have to wait 70-80 s before seeing
the same
issue.
Presence is set to false on the 2 profile.
I have the same issue with FS 1.0.2 that' s why I tried FS
11560.
When I use the FS machine as a router to test the packet per
second
performance, I'm reaching 100Mbps with 8000pps in each
direction (from
vlan 55 to vlan56) with less than 12% CPU. So that I don't think there's an issue with the network.
Here is an "mpstat -P ALL 1" to show you what's happening
suddenly
with 70 bridge calls: 12:31:26 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:27 all 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00 12:31:27 0 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00
12:31:27 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:28 all 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35 12:31:28 0 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35
12:31:28 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:29 all 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17 12:31:29 0 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17
The CPU is going from 89% idle to 0% in less than 2 seconds.
I know that I don't have to expect too much from this kind of hardware, but it seems strange that the CPU power vanished so suddenly.
Thanks a lot for the guys that have read this long mail :p
kind regards, rod
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>
<mailto:Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
-- Anthony Minessale II
FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/
AIM: anthm MSN:anthony_minessale@hotmail.com<MSN%3Aanthony_minessale@hotmail.com>
<mailto:MSN%3Aanthony_minessale@hotmail.com<MSN%253Aanthony_minessale@hotmail.com>
<mailto:MSN%3Aanthony_minessale@hotmail.com<MSN%253Aanthony_minessale@hotmail.com>
<mailto:MSN%253Aanthony_minessale@hotmail.com<MSN%25253Aanthony_minessale@hotmail.com>
GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com<PAYPAL%3Aanthony.minessale@gmail.com>
<mailto:PAYPAL%3Aanthony.minessale@gmail.com<PAYPAL%253Aanthony.minessale@gmail.com>
<mailto:PAYPAL%3Aanthony.minessale@gmail.com<PAYPAL%253Aanthony.minessale@gmail.com>
<mailto:PAYPAL%253Aanthony.minessale@gmail.com<PAYPAL%25253Aanthony.minessale@gmail.com>
IRC: irc.freenode.net <http://irc.freenode.net>
<http://irc.freenode.net> #freeswitch
FreeSWITCH Developer Conference sip:888@conference.freeswitch.org<sip%3A888@conference.freeswitch.org>
<mailto:sip%3A888@conference.freeswitch.org<sip%253A888@conference.freeswitch.org>
<mailto:sip%3A888@conference.freeswitch.org<sip%253A888@conference.freeswitch.org>
<mailto:sip%253A888@conference.freeswitch.org<sip%25253A888@conference.freeswitch.org>
iax:guest@conference.freeswitch.org/888
<http://iax:guest@conference.freeswitch.org/888>
<http://iax:guest@conference.freeswitch.org/888> googletalk:conf+888@conference.freeswitch.org<googletalk%3Aconf%2B888@conference.freeswitch.org>
<mailto:googletalk%3Aconf%2B888@conference.freeswitch.org<googletalk%253Aconf%252B888@conference.freeswitch.org>
<mailto:googletalk%3Aconf%2B888@conference.freeswitch.org<googletalk%253Aconf%252B888@conference.freeswitch.org>
<mailto:googletalk%253Aconf%252B888@conference.freeswitch.org<googletalk%25253Aconf%25252B888@conference.freeswitch.org>
pstn:213-799-1400
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Anthony Minessale II FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/ AIM: anthm MSN:anthony_minessale@hotmail.com <MSN%3Aanthony_minessale@hotmail.com> GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com<PAYPAL%3Aanthony.minessale@gmail.com> IRC: irc.freenode.net #freeswitch FreeSWITCH Developer Conference sip:888@conference.freeswitch.org <sip%3A888@conference.freeswitch.org> iax:guest@conference.freeswitch.org/888 googletalk:conf+888@conference.freeswitch.org<googletalk%3Aconf%2B888@conference.freeswitch.org> pstn:213-799-1400
Its Ubuntu 8.04 Hardy, 2.6.24-16 kernel. I hope it will be OK Kind Regards Saeed Ahmed Tariq _____ From: freeswitch-users-bounces@lists.freeswitch.org [mailto:freeswitch-users-bounces@lists.freeswitch.org] On Behalf Of Anthony Minessale Sent: Monday, February 02, 2009 2:58 PM To: freeswitch-users@lists.freeswitch.org Subject: Re: [Freeswitch-users] Strange Performance when using as SBC if you want to use ubuntu, be sure to use hardy and not intrepid. On Mon, Feb 2, 2009 at 7:03 AM, Saeed Ahmed <saeedahmad1981@gmail.com> wrote: Thanks rod for a quick answer, FS is installed on Ubuntu Server. I am planning to replace Nextone SBC with FS, Later I'll also use openZAP to communicate with TDM but this all depends how much calls it can take, or maybe we can also do something in clustering environment ( I am not sure about it). But thanks again and any further help will be highly appreciated. Kind Regards Saeed Ahmed Tariq -----Original Message----- From: freeswitch-users-bounces@lists.freeswitch.org [mailto:freeswitch-users-bounces@lists.freeswitch.org] On Behalf Of rod Sent: Monday, February 02, 2009 1:53 PM To: freeswitch-users@lists.freeswitch.org Subject: Re: [Freeswitch-users] Strange Performance when using as SBC Hi Saeed, I just created an account to share my setup on the wiki. I will detail all the steps for a clean install of a debian64 lenny with FS used as a SBC (next step is to try the new LCR module :) )and what I'm doing do stress the server. I wrote nothing at this time so please be patient, I'm waiting for my new hardware so that I will detail as much as possible what I'll do. For beginning I suggest you reading the start page on the wiki, especially these pages: -http://wiki.freeswitch.org/wiki/Getting_Started_Guide -http://wiki.freeswitch.org/wiki/Dialplan_XML maybe you could tell more about the linux distribution you're using so that I can give you some pointers for sipp... regards. rod. Saeed Ahmed wrote:
Hi Rod,
Could you please share how you configured Sipp & FS to create a test environment? Especially the dial plan, sofia settings etc..., actually I am a newbie. I want to test it on a single FS machine.
Kind Regards Saeed -----Original Message----- From: freeswitch-users-bounces@lists.freeswitch.org [mailto:freeswitch-users-bounces@lists.freeswitch.org] On Behalf Of rod Sent: Monday, February 02, 2009 11:00 AM To: freeswitch-users@lists.freeswitch.org Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Ken, Jay,
thanks for pointing to proxy media, I will test.
Ken, you are right, I was brain damaged (a stupid mistake) when setting INFO cause this kind of level could be very verbose. I'm switching to CRIT or ERR.
Thanks guys, rod.
thanks for
Ken Rice wrote:
If you don't have to transcode, using proxy media mode will still save you some CPU time. This is 1/2 way between bypass media and the default media interactive mode. The other draw back to this mode is if you are using FS
to
clean up RTP and DTMF you loose those functions but they are not needed in most use cases.
As far as the log level goes, I found that once I had things stable
setting
the loglevel to helped a good deal... Info is probably a bit too high of a loglevel I would probably go for CRIT or ERR (2 or 1 respectively) if you insist on leaving logging turned on... On a busy system these can and will generate a good deal of activity (and disk IO if using mod_logfile)
Ken
From: rod <kawarod@laposte.net> Reply-To: <freeswitch-users@lists.freeswitch.org> Date: Mon, 02 Feb 2009 11:36:35 +0400 To: <freeswitch-users@lists.freeswitch.org> Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Ken,
1) I'd like to use FS to hide topology, so bypass media is not possible 2) done 3) done 4) not used 5) i'm using this ins switch.xml -> <param name="loglevel" value="info"/>, if you think an other log level is more suitable.
Regarding logging, I can see in console and in the freeswitch.log that there is still a lot of NOTICE logging, see below: 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8721 (sofia/internal/sipp@10.10.10.1:5060) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/internal/sipp@10.10.10.1:5060 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8722 (sofia/external/9998@10.10.20.100) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/external/9998@10.10.20.100 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] sofia.c:3164 sofia_handle_sip_i_state() Channel [sofia/external/9998@10.10.20.100] has been answered 2009-02-02 08:33:56 [WARNING] mod_sofia.c:740 sofia_read_frame() Changing codec ptime to 30. I bet you have a linksys/sipura =D
Do you have any idea where I can switch off this kind of logging. I thought it should be in /dialplan/internal.xml, but I see that in internal.xml -> <param name="debug" value="0"/>
thanks a lot for your suggestion.
regards, rod
Ken Rice wrote:
Dont forget there are several things you can do to increase
performance...
1) where possible use bypass media or media proxy modes 2) mount freeswitch/db as a ram drive (if you are using voicemail with the internal FS DBs you'll need a way to make this persistant across reboots) 3) see the wiki for setting reasonable ulimits 4) (this is my oppinion others may vary) dont use mod_cdr_csv 5) turn off (or reduce logging) in switch.conf.xml
all of these thing can greatly improve performance.
On Mon, Feb 2, 2009 at 1:04 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net>> wrote:
Thanks Anthony,
the setup is like this:
sipp server ---- FS 1 ---- FS2
FS1 is the AMD CPU that has only one extension in dialplan that bridges 9999 to FS2. 9999 is the first extension in FS2 dialplan that plays moh, FS2 has no CPU pbm.
FS1 is maxing out at 60 bridged calls without your option -hp.
Using -hp, I'm now able to bridge 200 concurrent calls (a great improvement) and the system is still reactive. CPU load is high but not 100% and as the system responds well, I think that doesn't matter.
The
2GB of memory are completely consumed (top command shows 700MB for
FS
process).
I understand that FS1 server is not the best hardware platform, and I'm waiting for new 4 cores server for testing. I will update those numbers when testing with the new hardware.
regards, rod.
Anthony Minessale wrote:
Which of the 2 machines has the load issue? You said it was one box calling the other.
You have 2 major things against you, single CPU and AMD, but you should at least be able to get in the vicinity of 800-1000 calls
on a
box like that.
Are you calling the default 9999? It's not really an appropriate extension for load testing. On the terminating box you should set up a manual extension that is the first one in the dial plan to play a wav file from preferably a ram disk or /tmp
If you do plan on using this in production accept nothing less
than a
multi-core intel machine with at least 4 cores, the more cores the better because that parallel processing is where FS gets it's
atvantage.
On Fri, Jan 30, 2009 at 5:56 AM, rod <kawarod@laposte.net
<mailto:kawarod@laposte.net>
<mailto:kawarod@laposte.net <mailto:kawarod@laposte.net>>> wrote:
Dear list,
I've been playing with freeswitch for some time (2 months)
and the
fact is that I'm very pleased with the functionnalities of this
software.
I'd like to use FS as a SBC handling media and I'm doing some tests with sipp to load the machine but I'm unable to bridge more than
60 calls
without seeing the CPU being loaded at 100%. I'm sure
something is
going wrong with my setup but I'm unable to see what.
The test machine has the following specs: Athlon XP 3500+ with 2GB of memory (I know this is not a
high end
machine :p)
Freeswitch:/opt/freeswitch/log# cat /proc/cpuinfo processor : 0 vendor_id : AuthenticAMD cpu family : 15 model : 95 model name : AMD Athlon(tm) 64 Processor 3500+ stepping : 2 cpu MHz : 2199.973 cache size : 512 KB fpu : yes fpu_exception : yes cpuid level : 1 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic
sep mtrr pge
mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt rdtscp lm 3dnowext 3dnow up rep_good pni cx16 lahf_lm svm
extapic
cr8_legacy bogomips : 4402.97 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management: ts fid vid ttp tm stc
I installed FS on a fresh debian 64: Linux Freeswitch 2.6.26-1-amd64 #1 SMP Sat Jan 10 17:57:00
UTC 2009
x86_64 GNU/Linux
I set the ulimit parameters like those on the website: freeswitch@internal> ... Freeswitch:/opt/free-svn/bin# ulimit -a core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 999999 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) unlimited real-time priority (-r) 0 stack size (kbytes, -s) 244 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited
My network setup is the following:
SIPP machine (10.10.10.1/24)----------------vlan
<http://10.10.10.1/24%29----------------vlan>
<http://10.10.10.1/24%29----------------vlan>
<http://10.10.10.1/24%29----------------vlan> 55 ----------(10.10.10.254/24 <http://10.10.10.254/24>
(10.10.20.254/24)--------------
<http://10.10.20.254/24%29-------------->
<http://10.10.20.254/24%29-------------->
<http://10.10.20.254/24%29--------------> vlan56 -------------------(10.10.20.100/24 <http://10.10.20.100/24>
OTHER STOCK FS
I launched sipp with: sipp -sn uac_pcap -s 9999 -r 10 -l 80 -d 60000 -mi
10.10.10.1 -i
10.10.10.1 -mp 25000 10.10.10.254:5060
<http://10.10.10.254:5060> <http://10.10.10.254:5060>
The dialplan on FS is very simple: <?xml version="1.0" encoding="utf-8"?> <!-- http://wiki.freeswitch.org/wiki/Dialplan_XML --> <include> <context name="default">
<extension name="hold_music_bridge"> <condition field="destination_number" expression="^9999$"> <action application="answer"/> <action application="bridge" data="sofia/external/9999@10.10.20.100
<mailto:9999@10.10.20.100> <mailto:9999@10.10.20.100 <mailto:9999@10.10.20.100>>"/>
</condition> </extension> </context>
</include>
FreeSWITCH Version 1.0.trunk (11560M) Started. Crash Protection [Disabled] Max Sessions[1000] Session Rate[100] SQL [Enabled]
The test is very simple: sipp dial 9999 that matches in my
FS dialplan
and this is bridged to an other FS machine playing music on
hold.
When I launch "top" I see after 30 to 40 s that FS consumes all the CPU ressources (with a mean of 50-60 % before), with 80 calls. When I set 70 calls, I have to wait 70-80 s before seeing
the same
issue.
Presence is set to false on the 2 profile.
I have the same issue with FS 1.0.2 that' s why I tried FS
11560.
When I use the FS machine as a router to test the packet per
second
performance, I'm reaching 100Mbps with 8000pps in each
direction (from
vlan 55 to vlan56) with less than 12% CPU. So that I don't think there's an issue with the network.
Here is an "mpstat -P ALL 1" to show you what's happening
suddenly
with 70 bridge calls: 12:31:26 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:27 all 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00 12:31:27 0 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00
12:31:27 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:28 all 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35 12:31:28 0 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35
12:31:28 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:29 all 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17 12:31:29 0 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17
The CPU is going from 89% idle to 0% in less than 2 seconds.
I know that I don't have to expect too much from this kind of hardware, but it seems strange that the CPU power vanished so suddenly.
Thanks a lot for the guys that have read this long mail :p
kind regards, rod
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>
<mailto:Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
-- Anthony Minessale II
FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/
AIM: anthm MSN:anthony_minessale@hotmail.com
<mailto:MSN%3Aanthony_minessale@hotmail.com>
<mailto:MSN%3Aanthony_minessale@hotmail.com <mailto:MSN%253Aanthony_minessale@hotmail.com> >
<mailto:MSN%3Aanthony_minessale@hotmail.com <mailto:MSN%253Aanthony_minessale@hotmail.com>
<mailto:MSN%253Aanthony_minessale@hotmail.com <mailto:MSN%25253Aanthony_minessale@hotmail.com> >>
GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com <mailto:PAYPAL%3Aanthony.minessale@gmail.com>
<mailto:PAYPAL%3Aanthony.minessale@gmail.com <mailto:PAYPAL%253Aanthony.minessale@gmail.com> >
<mailto:PAYPAL%3Aanthony.minessale@gmail.com <mailto:PAYPAL%253Aanthony.minessale@gmail.com>
<mailto:PAYPAL%253Aanthony.minessale@gmail.com <mailto:PAYPAL%25253Aanthony.minessale@gmail.com> >>
IRC: irc.freenode.net <http://irc.freenode.net>
<http://irc.freenode.net> #freeswitch
FreeSWITCH Developer Conference sip:888@conference.freeswitch.org <mailto:sip%3A888@conference.freeswitch.org>
<mailto:sip%3A888@conference.freeswitch.org <mailto:sip%253A888@conference.freeswitch.org> >
<mailto:sip%3A888@conference.freeswitch.org <mailto:sip%253A888@conference.freeswitch.org>
<mailto:sip%253A888@conference.freeswitch.org <mailto:sip%25253A888@conference.freeswitch.org> >>
iax:guest@conference.freeswitch.org/888
<http://iax:guest@conference.freeswitch.org/888>
<http://iax:guest@conference.freeswitch.org/888> googletalk:conf+888@conference.freeswitch.org <mailto:googletalk%3Aconf%2B888@conference.freeswitch.org>
<mailto:googletalk%3Aconf%2B888@conference.freeswitch.org <mailto:googletalk%253Aconf%252B888@conference.freeswitch.org> >
<mailto:googletalk%3Aconf%2B888@conference.freeswitch.org <mailto:googletalk%253Aconf%252B888@conference.freeswitch.org>
<mailto:googletalk%253Aconf%252B888@conference.freeswitch.org <mailto:googletalk%25253Aconf%25252B888@conference.freeswitch.org> >>
pstn:213-799-1400
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org _______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org -- Anthony Minessale II FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/ AIM: anthm MSN:anthony_minessale@hotmail.com <mailto:MSN%3Aanthony_minessale@hotmail.com> GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com <mailto:PAYPAL%3Aanthony.minessale@gmail.com> IRC: irc.freenode.net #freeswitch FreeSWITCH Developer Conference sip:888@conference.freeswitch.org <mailto:sip%3A888@conference.freeswitch.org> iax:guest@conference.freeswitch.org/888 googletalk:conf+888@conference.freeswitch.org <mailto:googletalk%3Aconf%2B888@conference.freeswitch.org> pstn:213-799-1400
What is wrong with Intrepid? Anthony Minessale wrote:
if you want to use ubuntu, be sure to use hardy and not intrepid.
On Mon, Feb 2, 2009 at 7:03 AM, Saeed Ahmed <saeedahmad1981@gmail.com <mailto:saeedahmad1981@gmail.com>> wrote:
Thanks rod for a quick answer,
FS is installed on Ubuntu Server.
I am planning to replace Nextone SBC with FS, Later I'll also use openZAP to communicate with TDM but this all depends how much calls it can take, or maybe we can also do something in clustering environment ( I am not sure about it). But thanks again and any further help will be highly appreciated.
Kind Regards Saeed Ahmed Tariq
-----Original Message----- From: freeswitch-users-bounces@lists.freeswitch.org <mailto:freeswitch-users-bounces@lists.freeswitch.org> [mailto:freeswitch-users-bounces@lists.freeswitch.org <mailto:freeswitch-users-bounces@lists.freeswitch.org>] On Behalf Of rod Sent: Monday, February 02, 2009 1:53 PM To: freeswitch-users@lists.freeswitch.org <mailto:freeswitch-users@lists.freeswitch.org> Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Saeed,
I just created an account to share my setup on the wiki. I will detail all the steps for a clean install of a debian64 lenny with FS used as a SBC (next step is to try the new LCR module :) )and what I'm doing do stress the server.
I wrote nothing at this time so please be patient, I'm waiting for my new hardware so that I will detail as much as possible what I'll do.
For beginning I suggest you reading the start page on the wiki, especially these pages: -http://wiki.freeswitch.org/wiki/Getting_Started_Guide -http://wiki.freeswitch.org/wiki/Dialplan_XML
maybe you could tell more about the linux distribution you're using so that I can give you some pointers for sipp...
regards. rod.
Saeed Ahmed wrote: > Hi Rod, > > Could you please share how you configured Sipp & FS to create a test > environment? Especially the dial plan, sofia settings etc..., actually I am > a newbie. I want to test it on a single FS machine. > > Kind Regards > Saeed > -----Original Message----- > From: freeswitch-users-bounces@lists.freeswitch.org <mailto:freeswitch-users-bounces@lists.freeswitch.org> > [mailto:freeswitch-users-bounces@lists.freeswitch.org <mailto:freeswitch-users-bounces@lists.freeswitch.org>] On Behalf Of rod > Sent: Monday, February 02, 2009 11:00 AM > To: freeswitch-users@lists.freeswitch.org <mailto:freeswitch-users@lists.freeswitch.org> > Subject: Re: [Freeswitch-users] Strange Performance when using as SBC > > Hi Ken, Jay, > > thanks for pointing to proxy media, I will test. > > Ken, you are right, I was brain damaged (a stupid mistake) when setting > INFO cause this kind of level could be very verbose. I'm switching to > CRIT or ERR. > > Thanks guys, > rod. > > thanks for > > Ken Rice wrote: > >> If you don't have to transcode, using proxy media mode will still save you >> some CPU time. This is 1/2 way between bypass media and the default media >> interactive mode. The other draw back to this mode is if you are using FS >> > to > >> clean up RTP and DTMF you loose those functions but they are not needed in >> most use cases. >> >> As far as the log level goes, I found that once I had things stable >> > setting > >> the loglevel to helped a good deal... Info is probably a bit too high of a >> loglevel I would probably go for CRIT or ERR (2 or 1 respectively) if you >> insist on leaving logging turned on... On a busy system these can and will >> generate a good deal of activity (and disk IO if using mod_logfile) >> >> Ken >> >> >> >> >>> From: rod <kawarod@laposte.net <mailto:kawarod@laposte.net>> >>> Reply-To: <freeswitch-users@lists.freeswitch.org <mailto:freeswitch-users@lists.freeswitch.org>> >>> Date: Mon, 02 Feb 2009 11:36:35 +0400 >>> To: <freeswitch-users@lists.freeswitch.org <mailto:freeswitch-users@lists.freeswitch.org>> >>> Subject: Re: [Freeswitch-users] Strange Performance when using as SBC >>> >>> Hi Ken, >>> >>> 1) I'd like to use FS to hide topology, so bypass media is not possible >>> 2) done >>> 3) done >>> 4) not used >>> 5) i'm using this ins switch.xml -> <param name="loglevel" >>> value="info"/>, if you think an other log level is more suitable. >>> >>> Regarding logging, I can see in console and in the freeswitch.log that >>> there is still a lot of NOTICE logging, see below: >>> 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 >>> switch_core_session_thread() Session 8721 >>> (sofia/internal/sipp@10.10.10.1:5060 <http://sipp@10.10.10.1:5060>) Ended >>> 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 >>> switch_core_session_thread() Close Channel >>> sofia/internal/sipp@10.10.10.1:5060 <http://sipp@10.10.10.1:5060> [CS_HANGUP] >>> 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 >>> switch_core_session_thread() Session 8722 >>> (sofia/external/9998@10.10.20.100 <mailto:9998@10.10.20.100>) Ended >>> 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 >>> switch_core_session_thread() Close Channel >>> sofia/external/9998@10.10.20.100 <mailto:9998@10.10.20.100> [CS_HANGUP] >>> 2009-02-02 08:33:56 [NOTICE] sofia.c:3164 sofia_handle_sip_i_state() >>> Channel [sofia/external/9998@10.10.20.100 <mailto:9998@10.10.20.100>] has been answered >>> 2009-02-02 08:33:56 [WARNING] mod_sofia.c:740 sofia_read_frame() >>> Changing codec ptime to 30. I bet you have a linksys/sipura =D >>> >>> Do you have any idea where I can switch off this kind of logging. I >>> thought it should be in /dialplan/internal.xml, but I see that in >>> internal.xml -> <param name="debug" value="0"/> >>> >>> thanks a lot for your suggestion. >>> >>> regards, >>> rod >>> >>> Ken Rice wrote: >>> >>> >>>> Dont forget there are several things you can do to increase >>>> > performance... > >>>> 1) where possible use bypass media or media proxy modes >>>> 2) mount freeswitch/db as a ram drive (if you are using voicemail with >>>> the internal FS DBs you'll need a way to make this persistant across >>>> reboots) >>>> 3) see the wiki for setting reasonable ulimits >>>> 4) (this is my oppinion others may vary) dont use mod_cdr_csv >>>> 5) turn off (or reduce logging) in switch.conf.xml >>>> >>>> all of these thing can greatly improve performance. >>>> >>>> On Mon, Feb 2, 2009 at 1:04 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net> >>>> <mailto:kawarod@laposte.net <mailto:kawarod@laposte.net>>> wrote: >>>> >>>> Thanks Anthony, >>>> >>>> the setup is like this: >>>> >>>> sipp server ---- FS 1 ---- FS2 >>>> >>>> FS1 is the AMD CPU that has only one extension in dialplan that >>>> bridges >>>> 9999 to FS2. 9999 is the first extension in FS2 dialplan that >>>> plays moh, >>>> FS2 has no CPU pbm. >>>> >>>> FS1 is maxing out at 60 bridged calls without your option -hp. >>>> >>>> Using -hp, I'm now able to bridge 200 concurrent calls (a great >>>> improvement) and the system is still reactive. CPU load is high >>>> but not >>>> 100% and as the system responds well, I think that doesn't matter. >>>> > The > >>>> 2GB of memory are completely consumed (top command shows 700MB for >>>> > FS > >>>> process). >>>> >>>> I understand that FS1 server is not the best hardware platform, >>>> and I'm >>>> waiting for new 4 cores server for testing. >>>> I will update those numbers when testing with the new hardware. >>>> >>>> regards, >>>> rod. >>>> >>>> Anthony Minessale wrote: >>>> >>>> >>>>> Which of the 2 machines has the load issue? You said it was one box >>>>> calling the other. >>>>> >>>>> You have 2 major things against you, single CPU and AMD, but you >>>>> should at least be able to get in the vicinity of 800-1000 calls >>>>> >>>>> >>>> on a >>>> >>>> >>>>> box like that. >>>>> >>>>> Are you calling the default 9999? It's not really an appropriate >>>>> extension for load testing. >>>>> On the terminating box you should set up a manual extension that is >>>>> the first one in the dial plan >>>>> to play a wav file from preferably a ram disk or /tmp >>>>> >>>>> If you do plan on using this in production accept nothing less >>>>> >>>>> >>>> than a >>>> >>>> >>>>> multi-core intel machine with at least 4 cores, the more cores the >>>>> better because that parallel processing is where FS gets it's >>>>> >>>>> >>>> atvantage. >>>> >>>> >>>>> On Fri, Jan 30, 2009 at 5:56 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net> >>>>> >>>>> >>>> <mailto:kawarod@laposte.net <mailto:kawarod@laposte.net>> >>>> >>>> >>>>> <mailto:kawarod@laposte.net <mailto:kawarod@laposte.net> <mailto:kawarod@laposte.net <mailto:kawarod@laposte.net>>>> wrote: >>>>> >>>>> Dear list, >>>>> >>>>> I've been playing with freeswitch for some time (2 months) >>>>> >>>>> >>>> and the >>>> >>>> >>>>> fact >>>>> is that I'm very pleased with the functionnalities of this >>>>> >>>>> >>>> software. >>>> >>>> >>>>> I'd like to use FS as a SBC handling media and I'm doing some >>>>> tests with >>>>> sipp to load the machine but I'm unable to bridge more than >>>>> >>>>> >>>> 60 calls >>>> >>>> >>>>> without seeing the CPU being loaded at 100%. I'm sure >>>>> >>>>> >>>> something is >>>> >>>> >>>>> going >>>>> wrong with my setup but I'm unable to see what. >>>>> >>>>> The test machine has the following specs: >>>>> Athlon XP 3500+ with 2GB of memory (I know this is not a >>>>> >>>>> >>>> high end >>>> >>>> >>>>> machine :p) >>>>> >>>>> Freeswitch:/opt/freeswitch/log# cat /proc/cpuinfo >>>>> processor : 0 >>>>> vendor_id : AuthenticAMD >>>>> cpu family : 15 >>>>> model : 95 >>>>> model name : AMD Athlon(tm) 64 Processor 3500+ >>>>> stepping : 2 >>>>> cpu MHz : 2199.973 >>>>> cache size : 512 KB >>>>> fpu : yes >>>>> fpu_exception : yes >>>>> cpuid level : 1 >>>>> wp : yes >>>>> flags : fpu vme de pse tsc msr pae mce cx8 apic >>>>> >>>>> >>>> sep mtrr pge >>>> >>>> >>>>> mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext >>>>> fxsr_opt >>>>> rdtscp lm 3dnowext 3dnow up rep_good pni cx16 lahf_lm svm >>>>> >>>>> >>>> extapic >>>> >>>> >>>>> cr8_legacy >>>>> bogomips : 4402.97 >>>>> TLB size : 1024 4K pages >>>>> clflush size : 64 >>>>> cache_alignment : 64 >>>>> address sizes : 40 bits physical, 48 bits virtual >>>>> power management: ts fid vid ttp tm stc >>>>> >>>>> I installed FS on a fresh debian 64: >>>>> Linux Freeswitch 2.6.26-1-amd64 #1 SMP Sat Jan 10 17:57:00 >>>>> >>>>> >>>> UTC 2009 >>>> >>>> >>>>> x86_64 GNU/Linux >>>>> >>>>> I set the ulimit parameters like those on the website: >>>>> freeswitch@internal> ... >>>>> Freeswitch:/opt/free-svn/bin# ulimit -a >>>>> core file size (blocks, -c) unlimited >>>>> data seg size (kbytes, -d) unlimited >>>>> scheduling priority (-e) 0 >>>>> file size (blocks, -f) unlimited >>>>> pending signals (-i) unlimited >>>>> max locked memory (kbytes, -l) unlimited >>>>> max memory size (kbytes, -m) unlimited >>>>> open files (-n) 999999 >>>>> pipe size (512 bytes, -p) 8 >>>>> POSIX message queues (bytes, -q) unlimited >>>>> real-time priority (-r) 0 >>>>> stack size (kbytes, -s) 244 >>>>> cpu time (seconds, -t) unlimited >>>>> max user processes (-u) unlimited >>>>> virtual memory (kbytes, -v) unlimited >>>>> file locks (-x) unlimited >>>>> >>>>> >>>>> My network setup is the following: >>>>> >>>>> SIPP machine (10.10.10.1/24)----------------vlan <http://10.10.10.1/24%29----------------vlan> >>>>> >>>>> >>>> <http://10.10.10.1/24%29----------------vlan> >>>> >>>> >>>>> <http://10.10.10.1/24%29----------------vlan> 55 >>>>> ----------(10.10.10.254/24 <http://10.10.10.254/24> <http://10.10.10.254/24> >>>>> >>>>> >>>> <http://10.10.10.254/24>) FS >>>> >>>> >>>>> (10.10.20.254/24)-------------- <http://10.10.20.254/24%29--------------> >>>>> >>>>> >>>> <http://10.10.20.254/24%29--------------> >>>> >>>> >>>>> <http://10.10.20.254/24%29--------------> vlan56 >>>>> -------------------(10.10.20.100/24 <http://10.10.20.100/24> <http://10.10.20.100/24> >>>>> >>>>> >>>> <http://10.10.20.100/24>) >>>> >>>> >>>>> OTHER STOCK FS >>>>> >>>>> >>>>> I launched sipp with: >>>>> sipp -sn uac_pcap -s 9999 -r 10 -l 80 -d 60000 -mi >>>>> >>>>> >>>> 10.10.10.1 -i >>>> >>>> >>>>> 10.10.10.1 -mp 25000 10.10.10.254:5060 <http://10.10.10.254:5060> >>>>> >>>>> >>>> <http://10.10.10.254:5060> <http://10.10.10.254:5060> >>>> >>>> >>>>> The dialplan on FS is very simple: >>>>> <?xml version="1.0" encoding="utf-8"?> >>>>> <!-- http://wiki.freeswitch.org/wiki/Dialplan_XML --> >>>>> <include> >>>>> <context name="default"> >>>>> >>>>> <extension name="hold_music_bridge"> >>>>> <condition field="destination_number" expression="^9999$"> >>>>> <action application="answer"/> >>>>> <action application="bridge" >>>>> data="sofia/external/9999@10.10.20.100 <mailto:9999@10.10.20.100> >>>>> >>>>> >>>> <mailto:9999@10.10.20.100 <mailto:9999@10.10.20.100>> <mailto:9999@10.10.20.100 <mailto:9999@10.10.20.100> >>>> <mailto:9999@10.10.20.100 <mailto:9999@10.10.20.100>>>"/> >>>> >>>> >>>>> </condition> >>>>> </extension> >>>>> </context> >>>>> >>>>> </include> >>>>> >>>>> FreeSWITCH Version 1.0.trunk (11560M) Started. >>>>> Crash Protection [Disabled] >>>>> Max Sessions[1000] >>>>> Session Rate[100] >>>>> SQL [Enabled] >>>>> >>>>> >>>>> The test is very simple: sipp dial 9999 that matches in my >>>>> >>>>> >>>> FS dialplan >>>> >>>> >>>>> and this is bridged to an other FS machine playing music on >>>>> >>>>> >>>> hold. >>>> >>>> >>>>> When I launch "top" I see after 30 to 40 s that FS consumes all >>>>> the CPU >>>>> ressources (with a mean of 50-60 % before), with 80 calls. >>>>> When I set 70 calls, I have to wait 70-80 s before seeing >>>>> >>>>> >>>> the same >>>> >>>> >>>>> issue. >>>>> >>>>> Presence is set to false on the 2 profile. >>>>> >>>>> I have the same issue with FS 1.0.2 that' s why I tried FS >>>>> >>>>> >>>> 11560. >>>> >>>> >>>>> When I use the FS machine as a router to test the packet per >>>>> >>>>> >>>> second >>>> >>>> >>>>> performance, I'm reaching 100Mbps with 8000pps in each >>>>> >>>>> >>>> direction (from >>>> >>>> >>>>> vlan 55 to vlan56) with less than 12% CPU. So that I don't think >>>>> there's >>>>> an issue with the network. >>>>> >>>>> Here is an "mpstat -P ALL 1" to show you what's happening >>>>> >>>>> >>>> suddenly >>>> >>>> >>>>> with >>>>> 70 bridge calls: >>>>> 12:31:26 CPU %user %nice %sys %iowait %irq %soft >>>>> %steal %idle intr/s >>>>> 12:31:27 all 3,00 0,00 3,00 0,00 1,00 4,00 >>>>> 0,00 89,00 6241,00 >>>>> 12:31:27 0 3,00 0,00 3,00 0,00 1,00 4,00 >>>>> 0,00 89,00 6241,00 >>>>> >>>>> 12:31:27 CPU %user %nice %sys %iowait %irq %soft >>>>> %steal %idle intr/s >>>>> 12:31:28 all 14,14 0,00 56,57 0,00 2,02 5,05 >>>>> 0,00 22,22 6035,35 >>>>> 12:31:28 0 14,14 0,00 56,57 0,00 2,02 5,05 >>>>> 0,00 22,22 6035,35 >>>>> >>>>> 12:31:28 CPU %user %nice %sys %iowait %irq %soft >>>>> %steal %idle intr/s >>>>> 12:31:29 all 24,75 0,00 67,33 0,00 0,99 6,93 >>>>> 0,00 0,00 5483,17 >>>>> 12:31:29 0 24,75 0,00 67,33 0,00 0,99 6,93 >>>>> 0,00 0,00 5483,17 >>>>> >>>>> >>>>> The CPU is going from 89% idle to 0% in less than 2 seconds. >>>>> >>>>> I know that I don't have to expect too much from this kind of >>>>> hardware, >>>>> but it seems strange that the CPU power vanished so suddenly. >>>>> >>>>> Thanks a lot for the guys that have read this long mail :p >>>>> >>>>> kind regards, >>>>> rod >>>>> >>>>> >>>>> _______________________________________________ >>>>> Freeswitch-users mailing list >>>>> Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> >>>>> >>>>> >>>> <mailto:Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org>> >>>> >>>> >>>>> <mailto:Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> >>>>> >>>>> >>>> <mailto:Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org>>> >>>> >>>> >>>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users >>>>> >>>>> >>>>> > UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users > >>>> >>>> >>>>> http://www.freeswitch.org >>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> Anthony Minessale II >>>>> >>>>> FreeSWITCH http://www.freeswitch.org/ >>>>> ClueCon http://www.cluecon.com/ >>>>> >>>>> AIM: anthm >>>>> MSN:anthony_minessale@hotmail.com <mailto:MSN%3Aanthony_minessale@hotmail.com> >>>>> >>>>> >>>> <mailto:MSN%3Aanthony_minessale@hotmail.com <mailto:MSN%253Aanthony_minessale@hotmail.com>> >>>> >>>> >>>>> <mailto:MSN%3Aanthony_minessale@hotmail.com <mailto:MSN%253Aanthony_minessale@hotmail.com> >>>>> >>>>> >>>> <mailto:MSN%253Aanthony_minessale@hotmail.com <mailto:MSN%25253Aanthony_minessale@hotmail.com>>> >>>> >>>> >>>>> GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com <mailto:PAYPAL%3Aanthony.minessale@gmail.com> >>>>> >>>>> >>>> <mailto:PAYPAL%3Aanthony.minessale@gmail.com <mailto:PAYPAL%253Aanthony.minessale@gmail.com>> >>>> >>>> >>>>> <mailto:PAYPAL%3Aanthony.minessale@gmail.com <mailto:PAYPAL%253Aanthony.minessale@gmail.com> >>>>> >>>>> >>>> <mailto:PAYPAL%253Aanthony.minessale@gmail.com <mailto:PAYPAL%25253Aanthony.minessale@gmail.com>>> >>>> >>>> >>>>> IRC: irc.freenode.net <http://irc.freenode.net> <http://irc.freenode.net> >>>>> >>>>> >>>> <http://irc.freenode.net> #freeswitch >>>> >>>> >>>>> FreeSWITCH Developer Conference >>>>> sip:888@conference.freeswitch.org <mailto:sip%3A888@conference.freeswitch.org> >>>>> >>>>> >>>> <mailto:sip%3A888@conference.freeswitch.org <mailto:sip%253A888@conference.freeswitch.org>> >>>> >>>> >>>>> <mailto:sip%3A888@conference.freeswitch.org <mailto:sip%253A888@conference.freeswitch.org> >>>>> >>>>> >>>> <mailto:sip%253A888@conference.freeswitch.org <mailto:sip%25253A888@conference.freeswitch.org>>> >>>> >>>> >>>>> iax:guest@conference.freeswitch.org/888 <http://iax:guest@conference.freeswitch.org/888> >>>>> >>>>> >>>> <http://iax:guest@conference.freeswitch.org/888> >>>> >>>> >>>>> <http://iax:guest@conference.freeswitch.org/888> >>>>> googletalk:conf+888@conference.freeswitch.org <mailto:googletalk%3Aconf%2B888@conference.freeswitch.org> >>>>> >>>>> >>>> <mailto:googletalk%3Aconf%2B888@conference.freeswitch.org <mailto:googletalk%253Aconf%252B888@conference.freeswitch.org>> >>>> >>>> >>>>> <mailto:googletalk%3Aconf%2B888@conference.freeswitch.org <mailto:googletalk%253Aconf%252B888@conference.freeswitch.org> >>>>> >>>>> >>>> <mailto:googletalk%253Aconf%252B888@conference.freeswitch.org <mailto:googletalk%25253Aconf%25252B888@conference.freeswitch.org>>> >>>> >>>> >>>>> pstn:213-799-1400 >>>>> >>>>> >>>>> > ------------------------------------------------------------------------ > >>>> >>>> >>>>> _______________________________________________ >>>>> Freeswitch-users mailing list >>>>> Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> >>>>> >>>>> >>>> <mailto:Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org>> >>>> >>>> >>>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users >>>>> >>>>> >>>>> > UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users > >>>> >>>> >>>>> http://www.freeswitch.org >>>>> >>>>> >>>>> >>>> _______________________________________________ >>>> Freeswitch-users mailing list >>>> Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> >>>> <mailto:Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org>> >>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users >>>> >>>> > UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users > >>>> http://www.freeswitch.org >>>> >>>> >>>> ------------------------------------------------------------------------ >>>> >>>> _______________________________________________ >>>> Freeswitch-users mailing list >>>> Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> >>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users >>>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users >>>> http://www.freeswitch.org >>>> >>>> >>>> >>> _______________________________________________ >>> Freeswitch-users mailing list >>> Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> >>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users >>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users >>> http://www.freeswitch.org >>> >>> >> >> _______________________________________________ >> Freeswitch-users mailing list >> Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> >> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users >> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users >> http://www.freeswitch.org >> >> >> >> > > _______________________________________________ > Freeswitch-users mailing list > Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> > http://lists.freeswitch.org/mailman/listinfo/freeswitch-users > UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users > http://www.freeswitch.org > > > _______________________________________________ > Freeswitch-users mailing list > Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> > http://lists.freeswitch.org/mailman/listinfo/freeswitch-users > UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users > http://www.freeswitch.org > > >
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Anthony Minessale II
FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/
AIM: anthm MSN:anthony_minessale@hotmail.com <mailto:MSN%3Aanthony_minessale@hotmail.com> GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com <mailto:PAYPAL%3Aanthony.minessale@gmail.com> IRC: irc.freenode.net <http://irc.freenode.net> #freeswitch
FreeSWITCH Developer Conference sip:888@conference.freeswitch.org <mailto:sip%3A888@conference.freeswitch.org> iax:guest@conference.freeswitch.org/888 <http://iax:guest@conference.freeswitch.org/888> googletalk:conf+888@conference.freeswitch.org <mailto:googletalk%3Aconf%2B888@conference.freeswitch.org> pstn:213-799-1400
------------------------------------------------------------------------
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Yes, that's exactly the issue: libtool. Provided that you use libtool 1.5.22-4 or some other 1.5.x version, FS seems to work fine with Intrepid. -- Raul On Mon, 2009-02-02 at 14:10 -0600, Brian West wrote:
Its too bleeding edge and you had better know what you're doing if you use it. It comes with libtool 2.2 which you can't use to build FreeSWITCH.
/b
On Feb 2, 2009, at 2:01 PM, peder@networkoblivion.com wrote:
What is wrong with Intrepid?
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
In addition to libtool, you may have issues with the latest packages of gcc and some other tools that FS will need. In any case, it's better to not use Intrepid at all ;-) Use Hardy as suggested and you will be happy. On Mon, 2009-02-02 at 14:10 -0600, Brian West wrote:
Its too bleeding edge and you had better know what you're doing if you use it. It comes with libtool 2.2 which you can't use to build FreeSWITCH.
/b
On Feb 2, 2009, at 2:01 PM, peder@networkoblivion.com wrote:
What is wrong with Intrepid?
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
On Tue, 03 Feb 2009 09:48:14 Raul Fragoso wrote:
In addition to libtool, you may have issues with the latest packages of gcc and some other tools that FS will need. In any case, it's better to not use Intrepid at all ;-) Use Hardy as suggested and you will be happy.
You shouldn't have any issues. I've used Intrepid on a VM to compile and test FreeSWITCH quite a bit and haven't run across any issues at all after downgrading libtool. That said I would also recommend Hardy LTS for production servers. hads -- http://nicegear.co.nz VoIP, DVB and other Linux compatible hardware.
gcc 4.3.2 caused a segfault to appear in openzap due to over optimization... so yes it can bite you. :) /b On Feb 2, 2009, at 3:02 PM, Hadley Rich wrote:
You shouldn't have any issues. I've used Intrepid on a VM to compile and test FreeSWITCH quite a bit and haven't run across any issues at all after downgrading libtool.
That said I would also recommend Hardy LTS for production servers.
hads
Hi Saeed, Here is a first draft of what I did to install FS on my server. Configuration are not present, they'll be in a next release :p http://wiki.freeswitch.org/wiki/SBC_Setup My aim is to setup FS as a SBC, I hope this page could be a great startup point for others. I will update regularly based on what I did. Saeed, why are you replacing your Nextone, it's said to be one of the best commercial SBC on the market. regards. Saeed Ahmed wrote:
Thanks rod for a quick answer,
FS is installed on Ubuntu Server.
I am planning to replace Nextone SBC with FS, Later I'll also use openZAP to communicate with TDM but this all depends how much calls it can take, or maybe we can also do something in clustering environment ( I am not sure about it). But thanks again and any further help will be highly appreciated.
Kind Regards Saeed Ahmed Tariq
-----Original Message----- From: freeswitch-users-bounces@lists.freeswitch.org [mailto:freeswitch-users-bounces@lists.freeswitch.org] On Behalf Of rod Sent: Monday, February 02, 2009 1:53 PM To: freeswitch-users@lists.freeswitch.org Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Saeed,
I just created an account to share my setup on the wiki. I will detail all the steps for a clean install of a debian64 lenny with FS used as a SBC (next step is to try the new LCR module :) )and what I'm doing do stress the server.
I wrote nothing at this time so please be patient, I'm waiting for my new hardware so that I will detail as much as possible what I'll do.
For beginning I suggest you reading the start page on the wiki, especially these pages: -http://wiki.freeswitch.org/wiki/Getting_Started_Guide -http://wiki.freeswitch.org/wiki/Dialplan_XML
maybe you could tell more about the linux distribution you're using so that I can give you some pointers for sipp...
regards. rod.
Saeed Ahmed wrote:
Hi Rod,
Could you please share how you configured Sipp & FS to create a test environment? Especially the dial plan, sofia settings etc..., actually I
am
a newbie. I want to test it on a single FS machine.
Kind Regards Saeed -----Original Message----- From: freeswitch-users-bounces@lists.freeswitch.org [mailto:freeswitch-users-bounces@lists.freeswitch.org] On Behalf Of rod Sent: Monday, February 02, 2009 11:00 AM To: freeswitch-users@lists.freeswitch.org Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Ken, Jay,
thanks for pointing to proxy media, I will test.
Ken, you are right, I was brain damaged (a stupid mistake) when setting INFO cause this kind of level could be very verbose. I'm switching to CRIT or ERR.
Thanks guys, rod.
thanks for
Ken Rice wrote:
If you don't have to transcode, using proxy media mode will still save
you
some CPU time. This is 1/2 way between bypass media and the default media interactive mode. The other draw back to this mode is if you are using FS
to
clean up RTP and DTMF you loose those functions but they are not needed
in
most use cases.
As far as the log level goes, I found that once I had things stable
setting
the loglevel to helped a good deal... Info is probably a bit too high of
a
loglevel I would probably go for CRIT or ERR (2 or 1 respectively) if you insist on leaving logging turned on... On a busy system these can and
will
generate a good deal of activity (and disk IO if using mod_logfile)
Ken
From: rod <kawarod@laposte.net> Reply-To: <freeswitch-users@lists.freeswitch.org> Date: Mon, 02 Feb 2009 11:36:35 +0400 To: <freeswitch-users@lists.freeswitch.org> Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Ken,
1) I'd like to use FS to hide topology, so bypass media is not possible 2) done 3) done 4) not used 5) i'm using this ins switch.xml -> <param name="loglevel" value="info"/>, if you think an other log level is more suitable.
Regarding logging, I can see in console and in the freeswitch.log that there is still a lot of NOTICE logging, see below: 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8721 (sofia/internal/sipp@10.10.10.1:5060) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/internal/sipp@10.10.10.1:5060 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8722 (sofia/external/9998@10.10.20.100) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/external/9998@10.10.20.100 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] sofia.c:3164 sofia_handle_sip_i_state() Channel [sofia/external/9998@10.10.20.100] has been answered 2009-02-02 08:33:56 [WARNING] mod_sofia.c:740 sofia_read_frame() Changing codec ptime to 30. I bet you have a linksys/sipura =D
Do you have any idea where I can switch off this kind of logging. I thought it should be in /dialplan/internal.xml, but I see that in internal.xml -> <param name="debug" value="0"/>
thanks a lot for your suggestion.
regards, rod
Ken Rice wrote:
Dont forget there are several things you can do to increase
performance...
1) where possible use bypass media or media proxy modes 2) mount freeswitch/db as a ram drive (if you are using voicemail with the internal FS DBs you'll need a way to make this persistant across reboots) 3) see the wiki for setting reasonable ulimits 4) (this is my oppinion others may vary) dont use mod_cdr_csv 5) turn off (or reduce logging) in switch.conf.xml
all of these thing can greatly improve performance.
On Mon, Feb 2, 2009 at 1:04 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net>> wrote:
Thanks Anthony,
the setup is like this:
sipp server ---- FS 1 ---- FS2
FS1 is the AMD CPU that has only one extension in dialplan that bridges 9999 to FS2. 9999 is the first extension in FS2 dialplan that plays moh, FS2 has no CPU pbm.
FS1 is maxing out at 60 bridged calls without your option -hp.
Using -hp, I'm now able to bridge 200 concurrent calls (a great improvement) and the system is still reactive. CPU load is high but not 100% and as the system responds well, I think that doesn't matter.
The
2GB of memory are completely consumed (top command shows 700MB for
FS
process).
I understand that FS1 server is not the best hardware platform, and I'm waiting for new 4 cores server for testing. I will update those numbers when testing with the new hardware.
regards, rod.
Anthony Minessale wrote:
Which of the 2 machines has the load issue? You said it was one box calling the other.
You have 2 major things against you, single CPU and AMD, but you should at least be able to get in the vicinity of 800-1000 calls
on a
box like that.
Are you calling the default 9999? It's not really an appropriate extension for load testing. On the terminating box you should set up a manual extension that is the first one in the dial plan to play a wav file from preferably a ram disk or /tmp
If you do plan on using this in production accept nothing less
than a
multi-core intel machine with at least 4 cores, the more cores the better because that parallel processing is where FS gets it's
atvantage.
On Fri, Jan 30, 2009 at 5:56 AM, rod <kawarod@laposte.net
<mailto:kawarod@laposte.net>
<mailto:kawarod@laposte.net <mailto:kawarod@laposte.net>>> wrote:
Dear list,
I've been playing with freeswitch for some time (2 months)
and the
fact is that I'm very pleased with the functionnalities of this
software.
I'd like to use FS as a SBC handling media and I'm doing some tests with sipp to load the machine but I'm unable to bridge more than
60 calls
without seeing the CPU being loaded at 100%. I'm sure
something is
going wrong with my setup but I'm unable to see what.
The test machine has the following specs: Athlon XP 3500+ with 2GB of memory (I know this is not a
high end
machine :p)
Freeswitch:/opt/freeswitch/log# cat /proc/cpuinfo processor : 0 vendor_id : AuthenticAMD cpu family : 15 model : 95 model name : AMD Athlon(tm) 64 Processor 3500+ stepping : 2 cpu MHz : 2199.973 cache size : 512 KB fpu : yes fpu_exception : yes cpuid level : 1 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic
sep mtrr pge
mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt rdtscp lm 3dnowext 3dnow up rep_good pni cx16 lahf_lm svm
extapic
cr8_legacy bogomips : 4402.97 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management: ts fid vid ttp tm stc
I installed FS on a fresh debian 64: Linux Freeswitch 2.6.26-1-amd64 #1 SMP Sat Jan 10 17:57:00
UTC 2009
x86_64 GNU/Linux
I set the ulimit parameters like those on the website: freeswitch@internal> ... Freeswitch:/opt/free-svn/bin# ulimit -a core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 999999 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) unlimited real-time priority (-r) 0 stack size (kbytes, -s) 244 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited
My network setup is the following:
SIPP machine (10.10.10.1/24)----------------vlan
<http://10.10.10.1/24%29----------------vlan>
<http://10.10.10.1/24%29----------------vlan> 55 ----------(10.10.10.254/24 <http://10.10.10.254/24>
(10.10.20.254/24)--------------
<http://10.10.20.254/24%29-------------->
<http://10.10.20.254/24%29--------------> vlan56 -------------------(10.10.20.100/24 <http://10.10.20.100/24>
OTHER STOCK FS
I launched sipp with: sipp -sn uac_pcap -s 9999 -r 10 -l 80 -d 60000 -mi
10.10.10.1 -i
10.10.10.1 -mp 25000 10.10.10.254:5060
<http://10.10.10.254:5060> <http://10.10.10.254:5060>
The dialplan on FS is very simple: <?xml version="1.0" encoding="utf-8"?> <!-- http://wiki.freeswitch.org/wiki/Dialplan_XML --> <include> <context name="default">
<extension name="hold_music_bridge"> <condition field="destination_number" expression="^9999$"> <action application="answer"/> <action application="bridge" data="sofia/external/9999@10.10.20.100
<mailto:9999@10.10.20.100> <mailto:9999@10.10.20.100 <mailto:9999@10.10.20.100>>"/>
</condition> </extension> </context>
</include>
FreeSWITCH Version 1.0.trunk (11560M) Started. Crash Protection [Disabled] Max Sessions[1000] Session Rate[100] SQL [Enabled]
The test is very simple: sipp dial 9999 that matches in my
FS dialplan
and this is bridged to an other FS machine playing music on
hold.
When I launch "top" I see after 30 to 40 s that FS consumes all the CPU ressources (with a mean of 50-60 % before), with 80 calls. When I set 70 calls, I have to wait 70-80 s before seeing
the same
issue.
Presence is set to false on the 2 profile.
I have the same issue with FS 1.0.2 that' s why I tried FS
11560.
When I use the FS machine as a router to test the packet per
second
performance, I'm reaching 100Mbps with 8000pps in each
direction (from
vlan 55 to vlan56) with less than 12% CPU. So that I don't think there's an issue with the network.
Here is an "mpstat -P ALL 1" to show you what's happening
suddenly
with 70 bridge calls: 12:31:26 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:27 all 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00 12:31:27 0 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00
12:31:27 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:28 all 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35 12:31:28 0 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35
12:31:28 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:29 all 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17 12:31:29 0 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17
The CPU is going from 89% idle to 0% in less than 2 seconds.
I know that I don't have to expect too much from this kind of hardware, but it seems strange that the CPU power vanished so suddenly.
Thanks a lot for the guys that have read this long mail :p
kind regards, rod
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>
<mailto:Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
-- Anthony Minessale II
FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/
AIM: anthm MSN:anthony_minessale@hotmail.com
<mailto:MSN%3Aanthony_minessale@hotmail.com>
<mailto:MSN%3Aanthony_minessale@hotmail.com
<mailto:MSN%253Aanthony_minessale@hotmail.com>>
GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com
<mailto:PAYPAL%3Aanthony.minessale@gmail.com>
<mailto:PAYPAL%3Aanthony.minessale@gmail.com
<mailto:PAYPAL%253Aanthony.minessale@gmail.com>>
IRC: irc.freenode.net <http://irc.freenode.net>
<http://irc.freenode.net> #freeswitch
FreeSWITCH Developer Conference sip:888@conference.freeswitch.org
<mailto:sip%3A888@conference.freeswitch.org>
<mailto:sip%3A888@conference.freeswitch.org
<mailto:sip%253A888@conference.freeswitch.org>>
iax:guest@conference.freeswitch.org/888
<http://iax:guest@conference.freeswitch.org/888>
<http://iax:guest@conference.freeswitch.org/888> googletalk:conf+888@conference.freeswitch.org
<mailto:googletalk%3Aconf%2B888@conference.freeswitch.org>
<mailto:googletalk%3Aconf%2B888@conference.freeswitch.org
<mailto:googletalk%253Aconf%252B888@conference.freeswitch.org>>
pstn:213-799-1400
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Thanks Rod, Its really helpful contribution. @Nextone: I don't want to say much about it, but simply I am not happy with it, have you heard someone satisfied with NX who also owns it? Kind Regards Saeed Ahmed Tariq -----Original Message----- From: freeswitch-users-bounces@lists.freeswitch.org [mailto:freeswitch-users-bounces@lists.freeswitch.org] On Behalf Of rod Sent: Monday, February 02, 2009 3:33 PM To: freeswitch-users@lists.freeswitch.org Subject: Re: [Freeswitch-users] Strange Performance when using as SBC Hi Saeed, Here is a first draft of what I did to install FS on my server. Configuration are not present, they'll be in a next release :p http://wiki.freeswitch.org/wiki/SBC_Setup My aim is to setup FS as a SBC, I hope this page could be a great startup point for others. I will update regularly based on what I did. Saeed, why are you replacing your Nextone, it's said to be one of the best commercial SBC on the market. regards. Saeed Ahmed wrote:
Thanks rod for a quick answer,
FS is installed on Ubuntu Server.
I am planning to replace Nextone SBC with FS, Later I'll also use openZAP to communicate with TDM but this all depends how much calls it can take, or maybe we can also do something in clustering environment ( I am not sure about it). But thanks again and any further help will be highly appreciated.
Kind Regards Saeed Ahmed Tariq
-----Original Message----- From: freeswitch-users-bounces@lists.freeswitch.org [mailto:freeswitch-users-bounces@lists.freeswitch.org] On Behalf Of rod Sent: Monday, February 02, 2009 1:53 PM To: freeswitch-users@lists.freeswitch.org Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Saeed,
I just created an account to share my setup on the wiki. I will detail all the steps for a clean install of a debian64 lenny with FS used as a SBC (next step is to try the new LCR module :) )and what I'm doing do stress the server.
I wrote nothing at this time so please be patient, I'm waiting for my new hardware so that I will detail as much as possible what I'll do.
For beginning I suggest you reading the start page on the wiki, especially these pages: -http://wiki.freeswitch.org/wiki/Getting_Started_Guide -http://wiki.freeswitch.org/wiki/Dialplan_XML
maybe you could tell more about the linux distribution you're using so that I can give you some pointers for sipp...
regards. rod.
Saeed Ahmed wrote:
Hi Rod,
Could you please share how you configured Sipp & FS to create a test environment? Especially the dial plan, sofia settings etc..., actually I
am
a newbie. I want to test it on a single FS machine.
Kind Regards Saeed -----Original Message----- From: freeswitch-users-bounces@lists.freeswitch.org [mailto:freeswitch-users-bounces@lists.freeswitch.org] On Behalf Of rod Sent: Monday, February 02, 2009 11:00 AM To: freeswitch-users@lists.freeswitch.org Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Ken, Jay,
thanks for pointing to proxy media, I will test.
Ken, you are right, I was brain damaged (a stupid mistake) when setting INFO cause this kind of level could be very verbose. I'm switching to CRIT or ERR.
Thanks guys, rod.
thanks for
Ken Rice wrote:
If you don't have to transcode, using proxy media mode will still save
you
some CPU time. This is 1/2 way between bypass media and the default media interactive mode. The other draw back to this mode is if you are using FS
to
clean up RTP and DTMF you loose those functions but they are not needed
in
most use cases.
As far as the log level goes, I found that once I had things stable
setting
the loglevel to helped a good deal... Info is probably a bit too high of
a
loglevel I would probably go for CRIT or ERR (2 or 1 respectively) if you insist on leaving logging turned on... On a busy system these can and
will
generate a good deal of activity (and disk IO if using mod_logfile)
Ken
From: rod <kawarod@laposte.net> Reply-To: <freeswitch-users@lists.freeswitch.org> Date: Mon, 02 Feb 2009 11:36:35 +0400 To: <freeswitch-users@lists.freeswitch.org> Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Ken,
1) I'd like to use FS to hide topology, so bypass media is not possible 2) done 3) done 4) not used 5) i'm using this ins switch.xml -> <param name="loglevel" value="info"/>, if you think an other log level is more suitable.
Regarding logging, I can see in console and in the freeswitch.log that there is still a lot of NOTICE logging, see below: 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8721 (sofia/internal/sipp@10.10.10.1:5060) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/internal/sipp@10.10.10.1:5060 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8722 (sofia/external/9998@10.10.20.100) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/external/9998@10.10.20.100 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] sofia.c:3164 sofia_handle_sip_i_state() Channel [sofia/external/9998@10.10.20.100] has been answered 2009-02-02 08:33:56 [WARNING] mod_sofia.c:740 sofia_read_frame() Changing codec ptime to 30. I bet you have a linksys/sipura =D
Do you have any idea where I can switch off this kind of logging. I thought it should be in /dialplan/internal.xml, but I see that in internal.xml -> <param name="debug" value="0"/>
thanks a lot for your suggestion.
regards, rod
Ken Rice wrote:
Dont forget there are several things you can do to increase
performance...
1) where possible use bypass media or media proxy modes 2) mount freeswitch/db as a ram drive (if you are using voicemail with the internal FS DBs you'll need a way to make this persistant across reboots) 3) see the wiki for setting reasonable ulimits 4) (this is my oppinion others may vary) dont use mod_cdr_csv 5) turn off (or reduce logging) in switch.conf.xml
all of these thing can greatly improve performance.
On Mon, Feb 2, 2009 at 1:04 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net>> wrote:
Thanks Anthony,
the setup is like this:
sipp server ---- FS 1 ---- FS2
FS1 is the AMD CPU that has only one extension in dialplan that bridges 9999 to FS2. 9999 is the first extension in FS2 dialplan that plays moh, FS2 has no CPU pbm.
FS1 is maxing out at 60 bridged calls without your option -hp.
Using -hp, I'm now able to bridge 200 concurrent calls (a great improvement) and the system is still reactive. CPU load is high but not 100% and as the system responds well, I think that doesn't matter.
The
2GB of memory are completely consumed (top command shows 700MB for
FS
process).
I understand that FS1 server is not the best hardware platform, and I'm waiting for new 4 cores server for testing. I will update those numbers when testing with the new hardware.
regards, rod.
Anthony Minessale wrote:
Which of the 2 machines has the load issue? You said it was one box calling the other.
You have 2 major things against you, single CPU and AMD, but you should at least be able to get in the vicinity of 800-1000 calls
on a
box like that.
Are you calling the default 9999? It's not really an appropriate extension for load testing. On the terminating box you should set up a manual extension that is the first one in the dial plan to play a wav file from preferably a ram disk or /tmp
If you do plan on using this in production accept nothing less
than a
multi-core intel machine with at least 4 cores, the more cores the better because that parallel processing is where FS gets it's
atvantage.
On Fri, Jan 30, 2009 at 5:56 AM, rod <kawarod@laposte.net
<mailto:kawarod@laposte.net>
<mailto:kawarod@laposte.net <mailto:kawarod@laposte.net>>> wrote:
Dear list,
I've been playing with freeswitch for some time (2 months)
and the
fact is that I'm very pleased with the functionnalities of this
software.
I'd like to use FS as a SBC handling media and I'm doing some tests with sipp to load the machine but I'm unable to bridge more than
60 calls
without seeing the CPU being loaded at 100%. I'm sure
something is
going wrong with my setup but I'm unable to see what.
The test machine has the following specs: Athlon XP 3500+ with 2GB of memory (I know this is not a
high end
machine :p)
Freeswitch:/opt/freeswitch/log# cat /proc/cpuinfo processor : 0 vendor_id : AuthenticAMD cpu family : 15 model : 95 model name : AMD Athlon(tm) 64 Processor 3500+ stepping : 2 cpu MHz : 2199.973 cache size : 512 KB fpu : yes fpu_exception : yes cpuid level : 1 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic
sep mtrr pge
mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt rdtscp lm 3dnowext 3dnow up rep_good pni cx16 lahf_lm svm
extapic
cr8_legacy bogomips : 4402.97 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management: ts fid vid ttp tm stc
I installed FS on a fresh debian 64: Linux Freeswitch 2.6.26-1-amd64 #1 SMP Sat Jan 10 17:57:00
UTC 2009
x86_64 GNU/Linux
I set the ulimit parameters like those on the website: freeswitch@internal> ... Freeswitch:/opt/free-svn/bin# ulimit -a core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 999999 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) unlimited real-time priority (-r) 0 stack size (kbytes, -s) 244 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited
My network setup is the following:
SIPP machine (10.10.10.1/24)----------------vlan
<http://10.10.10.1/24%29----------------vlan>
<http://10.10.10.1/24%29----------------vlan> 55 ----------(10.10.10.254/24 <http://10.10.10.254/24>
(10.10.20.254/24)--------------
<http://10.10.20.254/24%29-------------->
<http://10.10.20.254/24%29--------------> vlan56 -------------------(10.10.20.100/24 <http://10.10.20.100/24>
OTHER STOCK FS
I launched sipp with: sipp -sn uac_pcap -s 9999 -r 10 -l 80 -d 60000 -mi
10.10.10.1 -i
10.10.10.1 -mp 25000 10.10.10.254:5060
<http://10.10.10.254:5060> <http://10.10.10.254:5060>
The dialplan on FS is very simple: <?xml version="1.0" encoding="utf-8"?> <!-- http://wiki.freeswitch.org/wiki/Dialplan_XML --> <include> <context name="default">
<extension name="hold_music_bridge"> <condition field="destination_number" expression="^9999$"> <action application="answer"/> <action application="bridge" data="sofia/external/9999@10.10.20.100
<mailto:9999@10.10.20.100> <mailto:9999@10.10.20.100 <mailto:9999@10.10.20.100>>"/>
</condition> </extension> </context>
</include>
FreeSWITCH Version 1.0.trunk (11560M) Started. Crash Protection [Disabled] Max Sessions[1000] Session Rate[100] SQL [Enabled]
The test is very simple: sipp dial 9999 that matches in my
FS dialplan
and this is bridged to an other FS machine playing music on
hold.
When I launch "top" I see after 30 to 40 s that FS consumes all the CPU ressources (with a mean of 50-60 % before), with 80 calls. When I set 70 calls, I have to wait 70-80 s before seeing
the same
issue.
Presence is set to false on the 2 profile.
I have the same issue with FS 1.0.2 that' s why I tried FS
11560.
When I use the FS machine as a router to test the packet per
second
performance, I'm reaching 100Mbps with 8000pps in each
direction (from
vlan 55 to vlan56) with less than 12% CPU. So that I don't think there's an issue with the network.
Here is an "mpstat -P ALL 1" to show you what's happening
suddenly
with 70 bridge calls: 12:31:26 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:27 all 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00 12:31:27 0 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00
12:31:27 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:28 all 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35 12:31:28 0 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35
12:31:28 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:29 all 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17 12:31:29 0 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17
The CPU is going from 89% idle to 0% in less than 2 seconds.
I know that I don't have to expect too much from this kind of hardware, but it seems strange that the CPU power vanished so suddenly.
Thanks a lot for the guys that have read this long mail :p
kind regards, rod
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>
<mailto:Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
-- Anthony Minessale II
FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/
AIM: anthm MSN:anthony_minessale@hotmail.com
<mailto:MSN%3Aanthony_minessale@hotmail.com>
<mailto:MSN%3Aanthony_minessale@hotmail.com
<mailto:MSN%253Aanthony_minessale@hotmail.com>>
GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com
<mailto:PAYPAL%3Aanthony.minessale@gmail.com>
<mailto:PAYPAL%3Aanthony.minessale@gmail.com
<mailto:PAYPAL%253Aanthony.minessale@gmail.com>>
IRC: irc.freenode.net <http://irc.freenode.net>
<http://irc.freenode.net> #freeswitch
FreeSWITCH Developer Conference sip:888@conference.freeswitch.org
<mailto:sip%3A888@conference.freeswitch.org>
<mailto:sip%3A888@conference.freeswitch.org
<mailto:sip%253A888@conference.freeswitch.org>>
iax:guest@conference.freeswitch.org/888
<http://iax:guest@conference.freeswitch.org/888>
<http://iax:guest@conference.freeswitch.org/888> googletalk:conf+888@conference.freeswitch.org
<mailto:googletalk%3Aconf%2B888@conference.freeswitch.org>
<mailto:googletalk%3Aconf%2B888@conference.freeswitch.org
<mailto:googletalk%253Aconf%252B888@conference.freeswitch.org>>
pstn:213-799-1400
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Rod, that wiki article is Awesome ! real good to see guides with start to finish steps. cant wait to see the next installment of your guide :) Jay On Tue, Feb 3, 2009 at 12:33 AM, rod <kawarod@laposte.net> wrote:
Hi Saeed,
Here is a first draft of what I did to install FS on my server. Configuration are not present, they'll be in a next release :p http://wiki.freeswitch.org/wiki/SBC_Setup
My aim is to setup FS as a SBC, I hope this page could be a great startup point for others. I will update regularly based on what I did.
Saeed, why are you replacing your Nextone, it's said to be one of the best commercial SBC on the market.
regards.
Hi all, I completed the wiki page with the comments I made in the posts: Re: [Freeswitch-users] FreeSwitch setup as a "Dumb" SBC I detailed how to setup mysql/kamailio/carrierroute to use the carrierroute module of kamailio for LCR. I wrote this page using my memory and history of the linux commands. Maybe some things are missing and I will update as soon as I get my new servers for reinstallation. I have to cleanup the way it is displayed, cause it lacks some wiki rules. If some would like to contribute, they are welcome. http://wiki.freeswitch.org/wiki/SBC_Setup regards, rod jay binks wrote:
Rod, that wiki article is Awesome !
real good to see guides with start to finish steps. cant wait to see the next installment of your guide :)
Jay
On Tue, Feb 3, 2009 at 12:33 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net>> wrote:
Hi Saeed,
Here is a first draft of what I did to install FS on my server. Configuration are not present, they'll be in a next release :p http://wiki.freeswitch.org/wiki/SBC_Setup
My aim is to setup FS as a SBC, I hope this page could be a great startup point for others. I will update regularly based on what I did.
Saeed, why are you replacing your Nextone, it's said to be one of the best commercial SBC on the market.
regards.
Hi rod, It's really amazing! Well described! Could you please explain a bit why we used Kamailio? Kind Regards Saeed Ahmed Tariq -----Original Message----- From: freeswitch-users-bounces@lists.freeswitch.org [mailto:freeswitch-users-bounces@lists.freeswitch.org] On Behalf Of rod Sent: Monday, February 02, 2009 3:33 PM To: freeswitch-users@lists.freeswitch.org Subject: Re: [Freeswitch-users] Strange Performance when using as SBC Hi Saeed, Here is a first draft of what I did to install FS on my server. Configuration are not present, they'll be in a next release :p http://wiki.freeswitch.org/wiki/SBC_Setup My aim is to setup FS as a SBC, I hope this page could be a great startup point for others. I will update regularly based on what I did. Saeed, why are you replacing your Nextone, it's said to be one of the best commercial SBC on the market. regards. Saeed Ahmed wrote:
Thanks rod for a quick answer,
FS is installed on Ubuntu Server.
I am planning to replace Nextone SBC with FS, Later I'll also use openZAP to communicate with TDM but this all depends how much calls it can take, or maybe we can also do something in clustering environment ( I am not sure about it). But thanks again and any further help will be highly appreciated.
Kind Regards Saeed Ahmed Tariq
-----Original Message----- From: freeswitch-users-bounces@lists.freeswitch.org [mailto:freeswitch-users-bounces@lists.freeswitch.org] On Behalf Of rod Sent: Monday, February 02, 2009 1:53 PM To: freeswitch-users@lists.freeswitch.org Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Saeed,
I just created an account to share my setup on the wiki. I will detail all the steps for a clean install of a debian64 lenny with FS used as a SBC (next step is to try the new LCR module :) )and what I'm doing do stress the server.
I wrote nothing at this time so please be patient, I'm waiting for my new hardware so that I will detail as much as possible what I'll do.
For beginning I suggest you reading the start page on the wiki, especially these pages: -http://wiki.freeswitch.org/wiki/Getting_Started_Guide -http://wiki.freeswitch.org/wiki/Dialplan_XML
maybe you could tell more about the linux distribution you're using so that I can give you some pointers for sipp...
regards. rod.
Saeed Ahmed wrote:
Hi Rod,
Could you please share how you configured Sipp & FS to create a test environment? Especially the dial plan, sofia settings etc..., actually I
am
a newbie. I want to test it on a single FS machine.
Kind Regards Saeed -----Original Message----- From: freeswitch-users-bounces@lists.freeswitch.org [mailto:freeswitch-users-bounces@lists.freeswitch.org] On Behalf Of rod Sent: Monday, February 02, 2009 11:00 AM To: freeswitch-users@lists.freeswitch.org Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Ken, Jay,
thanks for pointing to proxy media, I will test.
Ken, you are right, I was brain damaged (a stupid mistake) when setting INFO cause this kind of level could be very verbose. I'm switching to CRIT or ERR.
Thanks guys, rod.
thanks for
Ken Rice wrote:
If you don't have to transcode, using proxy media mode will still save
you
some CPU time. This is 1/2 way between bypass media and the default media interactive mode. The other draw back to this mode is if you are using FS
to
clean up RTP and DTMF you loose those functions but they are not needed
in
most use cases.
As far as the log level goes, I found that once I had things stable
setting
the loglevel to helped a good deal... Info is probably a bit too high of
a
loglevel I would probably go for CRIT or ERR (2 or 1 respectively) if you insist on leaving logging turned on... On a busy system these can and
will
generate a good deal of activity (and disk IO if using mod_logfile)
Ken
From: rod <kawarod@laposte.net> Reply-To: <freeswitch-users@lists.freeswitch.org> Date: Mon, 02 Feb 2009 11:36:35 +0400 To: <freeswitch-users@lists.freeswitch.org> Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Ken,
1) I'd like to use FS to hide topology, so bypass media is not possible 2) done 3) done 4) not used 5) i'm using this ins switch.xml -> <param name="loglevel" value="info"/>, if you think an other log level is more suitable.
Regarding logging, I can see in console and in the freeswitch.log that there is still a lot of NOTICE logging, see below: 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8721 (sofia/internal/sipp@10.10.10.1:5060) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/internal/sipp@10.10.10.1:5060 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8722 (sofia/external/9998@10.10.20.100) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/external/9998@10.10.20.100 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] sofia.c:3164 sofia_handle_sip_i_state() Channel [sofia/external/9998@10.10.20.100] has been answered 2009-02-02 08:33:56 [WARNING] mod_sofia.c:740 sofia_read_frame() Changing codec ptime to 30. I bet you have a linksys/sipura =D
Do you have any idea where I can switch off this kind of logging. I thought it should be in /dialplan/internal.xml, but I see that in internal.xml -> <param name="debug" value="0"/>
thanks a lot for your suggestion.
regards, rod
Ken Rice wrote:
Dont forget there are several things you can do to increase
performance...
1) where possible use bypass media or media proxy modes 2) mount freeswitch/db as a ram drive (if you are using voicemail with the internal FS DBs you'll need a way to make this persistant across reboots) 3) see the wiki for setting reasonable ulimits 4) (this is my oppinion others may vary) dont use mod_cdr_csv 5) turn off (or reduce logging) in switch.conf.xml
all of these thing can greatly improve performance.
On Mon, Feb 2, 2009 at 1:04 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net>> wrote:
Thanks Anthony,
the setup is like this:
sipp server ---- FS 1 ---- FS2
FS1 is the AMD CPU that has only one extension in dialplan that bridges 9999 to FS2. 9999 is the first extension in FS2 dialplan that plays moh, FS2 has no CPU pbm.
FS1 is maxing out at 60 bridged calls without your option -hp.
Using -hp, I'm now able to bridge 200 concurrent calls (a great improvement) and the system is still reactive. CPU load is high but not 100% and as the system responds well, I think that doesn't matter.
The
2GB of memory are completely consumed (top command shows 700MB for
FS
process).
I understand that FS1 server is not the best hardware platform, and I'm waiting for new 4 cores server for testing. I will update those numbers when testing with the new hardware.
regards, rod.
Anthony Minessale wrote:
Which of the 2 machines has the load issue? You said it was one box calling the other.
You have 2 major things against you, single CPU and AMD, but you should at least be able to get in the vicinity of 800-1000 calls
on a
box like that.
Are you calling the default 9999? It's not really an appropriate extension for load testing. On the terminating box you should set up a manual extension that is the first one in the dial plan to play a wav file from preferably a ram disk or /tmp
If you do plan on using this in production accept nothing less
than a
multi-core intel machine with at least 4 cores, the more cores the better because that parallel processing is where FS gets it's
atvantage.
On Fri, Jan 30, 2009 at 5:56 AM, rod <kawarod@laposte.net
<mailto:kawarod@laposte.net>
<mailto:kawarod@laposte.net <mailto:kawarod@laposte.net>>> wrote:
Dear list,
I've been playing with freeswitch for some time (2 months)
and the
fact is that I'm very pleased with the functionnalities of this
software.
I'd like to use FS as a SBC handling media and I'm doing some tests with sipp to load the machine but I'm unable to bridge more than
60 calls
without seeing the CPU being loaded at 100%. I'm sure
something is
going wrong with my setup but I'm unable to see what.
The test machine has the following specs: Athlon XP 3500+ with 2GB of memory (I know this is not a
high end
machine :p)
Freeswitch:/opt/freeswitch/log# cat /proc/cpuinfo processor : 0 vendor_id : AuthenticAMD cpu family : 15 model : 95 model name : AMD Athlon(tm) 64 Processor 3500+ stepping : 2 cpu MHz : 2199.973 cache size : 512 KB fpu : yes fpu_exception : yes cpuid level : 1 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic
sep mtrr pge
mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt rdtscp lm 3dnowext 3dnow up rep_good pni cx16 lahf_lm svm
extapic
cr8_legacy bogomips : 4402.97 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management: ts fid vid ttp tm stc
I installed FS on a fresh debian 64: Linux Freeswitch 2.6.26-1-amd64 #1 SMP Sat Jan 10 17:57:00
UTC 2009
x86_64 GNU/Linux
I set the ulimit parameters like those on the website: freeswitch@internal> ... Freeswitch:/opt/free-svn/bin# ulimit -a core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 999999 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) unlimited real-time priority (-r) 0 stack size (kbytes, -s) 244 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited
My network setup is the following:
SIPP machine (10.10.10.1/24)----------------vlan
<http://10.10.10.1/24%29----------------vlan>
<http://10.10.10.1/24%29----------------vlan> 55 ----------(10.10.10.254/24 <http://10.10.10.254/24>
(10.10.20.254/24)--------------
<http://10.10.20.254/24%29-------------->
<http://10.10.20.254/24%29--------------> vlan56 -------------------(10.10.20.100/24 <http://10.10.20.100/24>
OTHER STOCK FS
I launched sipp with: sipp -sn uac_pcap -s 9999 -r 10 -l 80 -d 60000 -mi
10.10.10.1 -i
10.10.10.1 -mp 25000 10.10.10.254:5060
<http://10.10.10.254:5060> <http://10.10.10.254:5060>
The dialplan on FS is very simple: <?xml version="1.0" encoding="utf-8"?> <!-- http://wiki.freeswitch.org/wiki/Dialplan_XML --> <include> <context name="default">
<extension name="hold_music_bridge"> <condition field="destination_number" expression="^9999$"> <action application="answer"/> <action application="bridge" data="sofia/external/9999@10.10.20.100
<mailto:9999@10.10.20.100> <mailto:9999@10.10.20.100 <mailto:9999@10.10.20.100>>"/>
</condition> </extension> </context>
</include>
FreeSWITCH Version 1.0.trunk (11560M) Started. Crash Protection [Disabled] Max Sessions[1000] Session Rate[100] SQL [Enabled]
The test is very simple: sipp dial 9999 that matches in my
FS dialplan
and this is bridged to an other FS machine playing music on
hold.
When I launch "top" I see after 30 to 40 s that FS consumes all the CPU ressources (with a mean of 50-60 % before), with 80 calls. When I set 70 calls, I have to wait 70-80 s before seeing
the same
issue.
Presence is set to false on the 2 profile.
I have the same issue with FS 1.0.2 that' s why I tried FS
11560.
When I use the FS machine as a router to test the packet per
second
performance, I'm reaching 100Mbps with 8000pps in each
direction (from
vlan 55 to vlan56) with less than 12% CPU. So that I don't think there's an issue with the network.
Here is an "mpstat -P ALL 1" to show you what's happening
suddenly
with 70 bridge calls: 12:31:26 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:27 all 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00 12:31:27 0 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00
12:31:27 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:28 all 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35 12:31:28 0 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35
12:31:28 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:29 all 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17 12:31:29 0 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17
The CPU is going from 89% idle to 0% in less than 2 seconds.
I know that I don't have to expect too much from this kind of hardware, but it seems strange that the CPU power vanished so suddenly.
Thanks a lot for the guys that have read this long mail :p
kind regards, rod
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>
<mailto:Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
-- Anthony Minessale II
FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/
AIM: anthm MSN:anthony_minessale@hotmail.com
<mailto:MSN%3Aanthony_minessale@hotmail.com>
<mailto:MSN%3Aanthony_minessale@hotmail.com
<mailto:MSN%253Aanthony_minessale@hotmail.com>>
GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com
<mailto:PAYPAL%3Aanthony.minessale@gmail.com>
<mailto:PAYPAL%3Aanthony.minessale@gmail.com
<mailto:PAYPAL%253Aanthony.minessale@gmail.com>>
IRC: irc.freenode.net <http://irc.freenode.net>
<http://irc.freenode.net> #freeswitch
FreeSWITCH Developer Conference sip:888@conference.freeswitch.org
<mailto:sip%3A888@conference.freeswitch.org>
<mailto:sip%3A888@conference.freeswitch.org
<mailto:sip%253A888@conference.freeswitch.org>>
iax:guest@conference.freeswitch.org/888
<http://iax:guest@conference.freeswitch.org/888>
<http://iax:guest@conference.freeswitch.org/888> googletalk:conf+888@conference.freeswitch.org
<mailto:googletalk%3Aconf%2B888@conference.freeswitch.org>
<mailto:googletalk%3Aconf%2B888@conference.freeswitch.org
<mailto:googletalk%253Aconf%252B888@conference.freeswitch.org>>
pstn:213-799-1400
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Hi Saaed, thanks for encouraging. I'm using Kamailio to get access to the carrierroute module. Carrierroute is a module that is able to handle very large routing table (excerpt from carrierroute page: "This modules scales up to more than a few million users, and is able to handle more than several hundred thousand routing table entries", Greatings to Henning Westerholt). When I did my first test with FS, LCR module was not available and as I'm not a programmer I had to deal with existing tools and being able to handle a route table with approx 160 000 entries. I'm not a programmer so I relies on SIP (which I understand better than C or C++ :p) and the possibility to define specific header to exchange message between FS and Kamailio at the cost of just an extra SIP invite parsing (maybe a bad thing for very very high call per second rate) So if you follow the setup on the wiki, FS will pass the number to examine, and Kamailio will send the best route to use depending on probability (for load sharing, eg: 10% on a gateway, 20% on an other and 70% on the last one) and matching longest prefix. Then FS uses those route. You could also update the kamailio database and then issue a "kamctl cr reload" to load the new routing table. Maybe this is not the best setup, but my aim is to share what I did so that we could converge to the best solution to use FS as a SBC, that's why I provided also some indications to optimize FS based on what I read on the list and the wiki. The next steps are scalability testing, maybe a php (or whatever else) frontend to populate carrierroute table depending on the cost of many carriers (any people willing to contribute, don't rely on me for this :o), FS redundancy (I'd like to use LVS and some tools like sipsack to check the SIP process, but I'm far from having done any interesting things on that) that is lacking against commercial SBC, some scripts to graph the number of calls... (please an SNMP module :p) An other way to achieve LCR could be to use the new LCR module, and I think that Ken Rice on this list can provide advices for a high performance LCR setup. I subscribed to this list a long time ago, and my feeling is that FS is a great piece of software with a great community, so that I decided that it could be great to contribute. regards, rod Saeed Ahmed wrote:
Hi rod,
It's really amazing! Well described!
Could you please explain a bit why we used Kamailio?
Kind Regards Saeed Ahmed Tariq
-----Original Message----- From: freeswitch-users-bounces@lists.freeswitch.org [mailto:freeswitch-users-bounces@lists.freeswitch.org] On Behalf Of rod Sent: Monday, February 02, 2009 3:33 PM To: freeswitch-users@lists.freeswitch.org Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Saeed,
Here is a first draft of what I did to install FS on my server. Configuration are not present, they'll be in a next release :p http://wiki.freeswitch.org/wiki/SBC_Setup
My aim is to setup FS as a SBC, I hope this page could be a great startup point for others. I will update regularly based on what I did.
Saeed, why are you replacing your Nextone, it's said to be one of the best commercial SBC on the market.
regards.
Saeed Ahmed wrote:
Thanks rod for a quick answer,
FS is installed on Ubuntu Server.
I am planning to replace Nextone SBC with FS, Later I'll also use openZAP
to
communicate with TDM but this all depends how much calls it can take, or maybe we can also do something in clustering environment ( I am not sure about it). But thanks again and any further help will be highly
appreciated.
Kind Regards Saeed Ahmed Tariq
-----Original Message----- From: freeswitch-users-bounces@lists.freeswitch.org [mailto:freeswitch-users-bounces@lists.freeswitch.org] On Behalf Of rod Sent: Monday, February 02, 2009 1:53 PM To: freeswitch-users@lists.freeswitch.org Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Saeed,
I just created an account to share my setup on the wiki. I will detail all the steps for a clean install of a debian64 lenny with FS used as a SBC (next step is to try the new LCR module :) )and what I'm doing do stress the server.
I wrote nothing at this time so please be patient, I'm waiting for my new hardware so that I will detail as much as possible what I'll do.
For beginning I suggest you reading the start page on the wiki, especially these pages: -http://wiki.freeswitch.org/wiki/Getting_Started_Guide -http://wiki.freeswitch.org/wiki/Dialplan_XML
maybe you could tell more about the linux distribution you're using so that I can give you some pointers for sipp...
regards. rod.
Saeed Ahmed wrote:
Hi Rod,
Could you please share how you configured Sipp & FS to create a test environment? Especially the dial plan, sofia settings etc..., actually I
am
a newbie. I want to test it on a single FS machine.
Kind Regards Saeed -----Original Message----- From: freeswitch-users-bounces@lists.freeswitch.org [mailto:freeswitch-users-bounces@lists.freeswitch.org] On Behalf Of rod Sent: Monday, February 02, 2009 11:00 AM To: freeswitch-users@lists.freeswitch.org Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Ken, Jay,
thanks for pointing to proxy media, I will test.
Ken, you are right, I was brain damaged (a stupid mistake) when setting INFO cause this kind of level could be very verbose. I'm switching to CRIT or ERR.
Thanks guys, rod.
thanks for
Ken Rice wrote:
If you don't have to transcode, using proxy media mode will still save
you
some CPU time. This is 1/2 way between bypass media and the default
media
interactive mode. The other draw back to this mode is if you are using
FS
to
clean up RTP and DTMF you loose those functions but they are not needed
in
most use cases.
As far as the log level goes, I found that once I had things stable
setting
the loglevel to helped a good deal... Info is probably a bit too high of
a
loglevel I would probably go for CRIT or ERR (2 or 1 respectively) if
you
insist on leaving logging turned on... On a busy system these can and
will
generate a good deal of activity (and disk IO if using mod_logfile)
Ken
From: rod <kawarod@laposte.net> Reply-To: <freeswitch-users@lists.freeswitch.org> Date: Mon, 02 Feb 2009 11:36:35 +0400 To: <freeswitch-users@lists.freeswitch.org> Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Ken,
1) I'd like to use FS to hide topology, so bypass media is not possible 2) done 3) done 4) not used 5) i'm using this ins switch.xml -> <param name="loglevel" value="info"/>, if you think an other log level is more suitable.
Regarding logging, I can see in console and in the freeswitch.log that there is still a lot of NOTICE logging, see below: 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8721 (sofia/internal/sipp@10.10.10.1:5060) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/internal/sipp@10.10.10.1:5060 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8722 (sofia/external/9998@10.10.20.100) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/external/9998@10.10.20.100 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] sofia.c:3164 sofia_handle_sip_i_state() Channel [sofia/external/9998@10.10.20.100] has been answered 2009-02-02 08:33:56 [WARNING] mod_sofia.c:740 sofia_read_frame() Changing codec ptime to 30. I bet you have a linksys/sipura =D
Do you have any idea where I can switch off this kind of logging. I thought it should be in /dialplan/internal.xml, but I see that in internal.xml -> <param name="debug" value="0"/>
thanks a lot for your suggestion.
regards, rod
Ken Rice wrote:
Dont forget there are several things you can do to increase
performance...
1) where possible use bypass media or media proxy modes 2) mount freeswitch/db as a ram drive (if you are using voicemail with the internal FS DBs you'll need a way to make this persistant across reboots) 3) see the wiki for setting reasonable ulimits 4) (this is my oppinion others may vary) dont use mod_cdr_csv 5) turn off (or reduce logging) in switch.conf.xml
all of these thing can greatly improve performance.
On Mon, Feb 2, 2009 at 1:04 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net>> wrote:
Thanks Anthony,
the setup is like this:
sipp server ---- FS 1 ---- FS2
FS1 is the AMD CPU that has only one extension in dialplan that bridges 9999 to FS2. 9999 is the first extension in FS2 dialplan that plays moh, FS2 has no CPU pbm.
FS1 is maxing out at 60 bridged calls without your option -hp.
Using -hp, I'm now able to bridge 200 concurrent calls (a great improvement) and the system is still reactive. CPU load is high but not 100% and as the system responds well, I think that doesn't matter.
The
2GB of memory are completely consumed (top command shows 700MB for
FS
process).
I understand that FS1 server is not the best hardware platform, and I'm waiting for new 4 cores server for testing. I will update those numbers when testing with the new hardware.
regards, rod.
Anthony Minessale wrote:
> Which of the 2 machines has the load issue? You said it was one box > calling the other. > > You have 2 major things against you, single CPU and AMD, but you > should at least be able to get in the vicinity of 800-1000 calls > > > > on a
> box like that. > > Are you calling the default 9999? It's not really an appropriate > extension for load testing. > On the terminating box you should set up a manual extension that is > the first one in the dial plan > to play a wav file from preferably a ram disk or /tmp > > If you do plan on using this in production accept nothing less > > > > than a
> multi-core intel machine with at least 4 cores, the more cores the > better because that parallel processing is where FS gets it's > > > > atvantage.
> On Fri, Jan 30, 2009 at 5:56 AM, rod <kawarod@laposte.net > > > > <mailto:kawarod@laposte.net>
> <mailto:kawarod@laposte.net <mailto:kawarod@laposte.net>>> wrote: > > Dear list, > > I've been playing with freeswitch for some time (2 months) > > > > and the
> fact > is that I'm very pleased with the functionnalities of this > > > > software.
> I'd like to use FS as a SBC handling media and I'm doing some > tests with > sipp to load the machine but I'm unable to bridge more than > > > > 60 calls
> without seeing the CPU being loaded at 100%. I'm sure > > > > something is
> going > wrong with my setup but I'm unable to see what. > > The test machine has the following specs: > Athlon XP 3500+ with 2GB of memory (I know this is not a > > > > high end
> machine :p) > > Freeswitch:/opt/freeswitch/log# cat /proc/cpuinfo > processor : 0 > vendor_id : AuthenticAMD > cpu family : 15 > model : 95 > model name : AMD Athlon(tm) 64 Processor 3500+ > stepping : 2 > cpu MHz : 2199.973 > cache size : 512 KB > fpu : yes > fpu_exception : yes > cpuid level : 1 > wp : yes > flags : fpu vme de pse tsc msr pae mce cx8 apic > > > > sep mtrr pge
> mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext > fxsr_opt > rdtscp lm 3dnowext 3dnow up rep_good pni cx16 lahf_lm svm > > > > extapic
> cr8_legacy > bogomips : 4402.97 > TLB size : 1024 4K pages > clflush size : 64 > cache_alignment : 64 > address sizes : 40 bits physical, 48 bits virtual > power management: ts fid vid ttp tm stc > > I installed FS on a fresh debian 64: > Linux Freeswitch 2.6.26-1-amd64 #1 SMP Sat Jan 10 17:57:00 > > > > UTC 2009
> x86_64 GNU/Linux > > I set the ulimit parameters like those on the website: > freeswitch@internal> ... > Freeswitch:/opt/free-svn/bin# ulimit -a > core file size (blocks, -c) unlimited > data seg size (kbytes, -d) unlimited > scheduling priority (-e) 0 > file size (blocks, -f) unlimited > pending signals (-i) unlimited > max locked memory (kbytes, -l) unlimited > max memory size (kbytes, -m) unlimited > open files (-n) 999999 > pipe size (512 bytes, -p) 8 > POSIX message queues (bytes, -q) unlimited > real-time priority (-r) 0 > stack size (kbytes, -s) 244 > cpu time (seconds, -t) unlimited > max user processes (-u) unlimited > virtual memory (kbytes, -v) unlimited > file locks (-x) unlimited > > > My network setup is the following: > > SIPP machine (10.10.10.1/24)----------------vlan > > > > <http://10.10.10.1/24%29----------------vlan>
> <http://10.10.10.1/24%29----------------vlan> 55 > ----------(10.10.10.254/24 <http://10.10.10.254/24> > > > > <http://10.10.10.254/24>) FS
> (10.10.20.254/24)-------------- > > > > <http://10.10.20.254/24%29-------------->
> <http://10.10.20.254/24%29--------------> vlan56 > -------------------(10.10.20.100/24 <http://10.10.20.100/24> > > > > <http://10.10.20.100/24>)
> OTHER STOCK FS > > > I launched sipp with: > sipp -sn uac_pcap -s 9999 -r 10 -l 80 -d 60000 -mi > > > > 10.10.10.1 -i
> 10.10.10.1 -mp 25000 10.10.10.254:5060 > > > > <http://10.10.10.254:5060> <http://10.10.10.254:5060>
> The dialplan on FS is very simple: > <?xml version="1.0" encoding="utf-8"?> > <!-- http://wiki.freeswitch.org/wiki/Dialplan_XML --> > <include> > <context name="default"> > > <extension name="hold_music_bridge"> > <condition field="destination_number" expression="^9999$"> > <action application="answer"/> > <action application="bridge" > data="sofia/external/9999@10.10.20.100 > > > > <mailto:9999@10.10.20.100> <mailto:9999@10.10.20.100 <mailto:9999@10.10.20.100>>"/>
> </condition> > </extension> > </context> > > </include> > > FreeSWITCH Version 1.0.trunk (11560M) Started. > Crash Protection [Disabled] > Max Sessions[1000] > Session Rate[100] > SQL [Enabled] > > > The test is very simple: sipp dial 9999 that matches in my > > > > FS dialplan
> and this is bridged to an other FS machine playing music on > > > > hold.
> When I launch "top" I see after 30 to 40 s that FS consumes all > the CPU > ressources (with a mean of 50-60 % before), with 80 calls. > When I set 70 calls, I have to wait 70-80 s before seeing > > > > the same
> issue. > > Presence is set to false on the 2 profile. > > I have the same issue with FS 1.0.2 that' s why I tried FS > > > > 11560.
> When I use the FS machine as a router to test the packet per > > > > second
> performance, I'm reaching 100Mbps with 8000pps in each > > > > direction (from
> vlan 55 to vlan56) with less than 12% CPU. So that I don't think > there's > an issue with the network. > > Here is an "mpstat -P ALL 1" to show you what's happening > > > > suddenly
> with > 70 bridge calls: > 12:31:26 CPU %user %nice %sys %iowait %irq %soft > %steal %idle intr/s > 12:31:27 all 3,00 0,00 3,00 0,00 1,00 4,00 > 0,00 89,00 6241,00 > 12:31:27 0 3,00 0,00 3,00 0,00 1,00 4,00 > 0,00 89,00 6241,00 > > 12:31:27 CPU %user %nice %sys %iowait %irq %soft > %steal %idle intr/s > 12:31:28 all 14,14 0,00 56,57 0,00 2,02 5,05 > 0,00 22,22 6035,35 > 12:31:28 0 14,14 0,00 56,57 0,00 2,02 5,05 > 0,00 22,22 6035,35 > > 12:31:28 CPU %user %nice %sys %iowait %irq %soft > %steal %idle intr/s > 12:31:29 all 24,75 0,00 67,33 0,00 0,99 6,93 > 0,00 0,00 5483,17 > 12:31:29 0 24,75 0,00 67,33 0,00 0,99 6,93 > 0,00 0,00 5483,17 > > > The CPU is going from 89% idle to 0% in less than 2 seconds. > > I know that I don't have to expect too much from this kind of > hardware, > but it seems strange that the CPU power vanished so suddenly. > > Thanks a lot for the guys that have read this long mail :p > > kind regards, > rod > > > _______________________________________________ > Freeswitch-users mailing list > Freeswitch-users@lists.freeswitch.org > > > > <mailto:Freeswitch-users@lists.freeswitch.org>
> <mailto:Freeswitch-users@lists.freeswitch.org > > > > <mailto:Freeswitch-users@lists.freeswitch.org>>
> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users > > > > >
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
> http://www.freeswitch.org > > > > > -- > Anthony Minessale II > > FreeSWITCH http://www.freeswitch.org/ > ClueCon http://www.cluecon.com/ > > AIM: anthm > MSN:anthony_minessale@hotmail.com > > > > <mailto:MSN%3Aanthony_minessale@hotmail.com>
> <mailto:MSN%3Aanthony_minessale@hotmail.com > > > > <mailto:MSN%253Aanthony_minessale@hotmail.com>>
> GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com > > > > <mailto:PAYPAL%3Aanthony.minessale@gmail.com>
> <mailto:PAYPAL%3Aanthony.minessale@gmail.com > > > > <mailto:PAYPAL%253Aanthony.minessale@gmail.com>>
> IRC: irc.freenode.net <http://irc.freenode.net> > > > > <http://irc.freenode.net> #freeswitch
> FreeSWITCH Developer Conference > sip:888@conference.freeswitch.org > > > > <mailto:sip%3A888@conference.freeswitch.org>
> <mailto:sip%3A888@conference.freeswitch.org > > > > <mailto:sip%253A888@conference.freeswitch.org>>
> iax:guest@conference.freeswitch.org/888 > > > > <http://iax:guest@conference.freeswitch.org/888>
> <http://iax:guest@conference.freeswitch.org/888> > googletalk:conf+888@conference.freeswitch.org > > > > <mailto:googletalk%3Aconf%2B888@conference.freeswitch.org>
> <mailto:googletalk%3Aconf%2B888@conference.freeswitch.org > > > > <mailto:googletalk%253Aconf%252B888@conference.freeswitch.org>>
> pstn:213-799-1400 > > > > >
> _______________________________________________ > Freeswitch-users mailing list > Freeswitch-users@lists.freeswitch.org > > > > <mailto:Freeswitch-users@lists.freeswitch.org>
> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users > > > > >
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
> http://www.freeswitch.org > > > > > _______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Some update: - I switched log level to "err" - I'm now using proxy-media - and I erased the directive answer in the dialplan (useless and seems that it consumes lots of CPU, don't know why) the dialplan now looks like this: <extension name="hold_music_bridge"> <condition field="destination_number" expression="^9999$"> <action application="set" data="proxy_media=true"/> <action application="bridge" data="sofia/external/9999@10.10.20.100"/> </condition> </extension> instead of <extension name="hold_music_bridge"> <condition field="destination_number" expression="^9999$"> <action application="answer"/> <action application="bridge" data="sofia/external/9999@10.10.20.100"/> </condition> </extension> The box is now able to bridge 300 calls with 20-30% of free CPU. I will run a long term test. I see this error in the log and don't understand exactly if somebody could help (I'm running latest trunk 11592M): 2009-02-02 13:29:54 [ERR] switch_core_io.c:117 switch_core_session_read_frame() sofia/external/9998@10.10.20.100 has no read codec. regards, rodrigue rod wrote:
Hi Ken, Jay,
thanks for pointing to proxy media, I will test.
Ken, you are right, I was brain damaged (a stupid mistake) when setting INFO cause this kind of level could be very verbose. I'm switching to CRIT or ERR.
Thanks guys, rod.
thanks for
Ken Rice wrote:
If you don't have to transcode, using proxy media mode will still save you some CPU time. This is 1/2 way between bypass media and the default media interactive mode. The other draw back to this mode is if you are using FS to clean up RTP and DTMF you loose those functions but they are not needed in most use cases.
As far as the log level goes, I found that once I had things stable setting the loglevel to helped a good deal... Info is probably a bit too high of a loglevel I would probably go for CRIT or ERR (2 or 1 respectively) if you insist on leaving logging turned on... On a busy system these can and will generate a good deal of activity (and disk IO if using mod_logfile)
Ken
From: rod <kawarod@laposte.net> Reply-To: <freeswitch-users@lists.freeswitch.org> Date: Mon, 02 Feb 2009 11:36:35 +0400 To: <freeswitch-users@lists.freeswitch.org> Subject: Re: [Freeswitch-users] Strange Performance when using as SBC
Hi Ken,
1) I'd like to use FS to hide topology, so bypass media is not possible 2) done 3) done 4) not used 5) i'm using this ins switch.xml -> <param name="loglevel" value="info"/>, if you think an other log level is more suitable.
Regarding logging, I can see in console and in the freeswitch.log that there is still a lot of NOTICE logging, see below: 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8721 (sofia/internal/sipp@10.10.10.1:5060) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/internal/sipp@10.10.10.1:5060 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960 switch_core_session_thread() Session 8722 (sofia/external/9998@10.10.20.100) Ended 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962 switch_core_session_thread() Close Channel sofia/external/9998@10.10.20.100 [CS_HANGUP] 2009-02-02 08:33:56 [NOTICE] sofia.c:3164 sofia_handle_sip_i_state() Channel [sofia/external/9998@10.10.20.100] has been answered 2009-02-02 08:33:56 [WARNING] mod_sofia.c:740 sofia_read_frame() Changing codec ptime to 30. I bet you have a linksys/sipura =D
Do you have any idea where I can switch off this kind of logging. I thought it should be in /dialplan/internal.xml, but I see that in internal.xml -> <param name="debug" value="0"/>
thanks a lot for your suggestion.
regards, rod
Ken Rice wrote:
Dont forget there are several things you can do to increase performance...
1) where possible use bypass media or media proxy modes 2) mount freeswitch/db as a ram drive (if you are using voicemail with the internal FS DBs you'll need a way to make this persistant across reboots) 3) see the wiki for setting reasonable ulimits 4) (this is my oppinion others may vary) dont use mod_cdr_csv 5) turn off (or reduce logging) in switch.conf.xml
all of these thing can greatly improve performance.
On Mon, Feb 2, 2009 at 1:04 AM, rod <kawarod@laposte.net <mailto:kawarod@laposte.net>> wrote:
Thanks Anthony,
the setup is like this:
sipp server ---- FS 1 ---- FS2
FS1 is the AMD CPU that has only one extension in dialplan that bridges 9999 to FS2. 9999 is the first extension in FS2 dialplan that plays moh, FS2 has no CPU pbm.
FS1 is maxing out at 60 bridged calls without your option -hp.
Using -hp, I'm now able to bridge 200 concurrent calls (a great improvement) and the system is still reactive. CPU load is high but not 100% and as the system responds well, I think that doesn't matter. The 2GB of memory are completely consumed (top command shows 700MB for FS process).
I understand that FS1 server is not the best hardware platform, and I'm waiting for new 4 cores server for testing. I will update those numbers when testing with the new hardware.
regards, rod.
Anthony Minessale wrote:
Which of the 2 machines has the load issue? You said it was one box calling the other.
You have 2 major things against you, single CPU and AMD, but you should at least be able to get in the vicinity of 800-1000 calls
on a
box like that.
Are you calling the default 9999? It's not really an appropriate extension for load testing. On the terminating box you should set up a manual extension that is the first one in the dial plan to play a wav file from preferably a ram disk or /tmp
If you do plan on using this in production accept nothing less
than a
multi-core intel machine with at least 4 cores, the more cores the better because that parallel processing is where FS gets it's
atvantage.
On Fri, Jan 30, 2009 at 5:56 AM, rod <kawarod@laposte.net
<mailto:kawarod@laposte.net>
<mailto:kawarod@laposte.net <mailto:kawarod@laposte.net>>> wrote:
Dear list,
I've been playing with freeswitch for some time (2 months)
and the
fact is that I'm very pleased with the functionnalities of this
software.
I'd like to use FS as a SBC handling media and I'm doing some tests with sipp to load the machine but I'm unable to bridge more than
60 calls
without seeing the CPU being loaded at 100%. I'm sure
something is
going wrong with my setup but I'm unable to see what.
The test machine has the following specs: Athlon XP 3500+ with 2GB of memory (I know this is not a
high end
machine :p)
Freeswitch:/opt/freeswitch/log# cat /proc/cpuinfo processor : 0 vendor_id : AuthenticAMD cpu family : 15 model : 95 model name : AMD Athlon(tm) 64 Processor 3500+ stepping : 2 cpu MHz : 2199.973 cache size : 512 KB fpu : yes fpu_exception : yes cpuid level : 1 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic
sep mtrr pge
mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt rdtscp lm 3dnowext 3dnow up rep_good pni cx16 lahf_lm svm
extapic
cr8_legacy bogomips : 4402.97 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management: ts fid vid ttp tm stc
I installed FS on a fresh debian 64: Linux Freeswitch 2.6.26-1-amd64 #1 SMP Sat Jan 10 17:57:00
UTC 2009
x86_64 GNU/Linux
I set the ulimit parameters like those on the website: freeswitch@internal> ... Freeswitch:/opt/free-svn/bin# ulimit -a core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 999999 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) unlimited real-time priority (-r) 0 stack size (kbytes, -s) 244 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited
My network setup is the following:
SIPP machine (10.10.10.1/24)----------------vlan
<http://10.10.10.1/24%29----------------vlan>
<http://10.10.10.1/24%29----------------vlan> 55 ----------(10.10.10.254/24 <http://10.10.10.254/24>
(10.10.20.254/24)--------------
<http://10.10.20.254/24%29-------------->
<http://10.10.20.254/24%29--------------> vlan56 -------------------(10.10.20.100/24 <http://10.10.20.100/24>
OTHER STOCK FS
I launched sipp with: sipp -sn uac_pcap -s 9999 -r 10 -l 80 -d 60000 -mi
10.10.10.1 -i
10.10.10.1 -mp 25000 10.10.10.254:5060
<http://10.10.10.254:5060> <http://10.10.10.254:5060>
The dialplan on FS is very simple: <?xml version="1.0" encoding="utf-8"?> <!-- http://wiki.freeswitch.org/wiki/Dialplan_XML --> <include> <context name="default">
<extension name="hold_music_bridge"> <condition field="destination_number" expression="^9999$"> <action application="answer"/> <action application="bridge" data="sofia/external/9999@10.10.20.100
<mailto:9999@10.10.20.100> <mailto:9999@10.10.20.100 <mailto:9999@10.10.20.100>>"/>
</condition> </extension> </context>
</include>
FreeSWITCH Version 1.0.trunk (11560M) Started. Crash Protection [Disabled] Max Sessions[1000] Session Rate[100] SQL [Enabled]
The test is very simple: sipp dial 9999 that matches in my
FS dialplan
and this is bridged to an other FS machine playing music on
hold.
When I launch "top" I see after 30 to 40 s that FS consumes all the CPU ressources (with a mean of 50-60 % before), with 80 calls. When I set 70 calls, I have to wait 70-80 s before seeing
the same
issue.
Presence is set to false on the 2 profile.
I have the same issue with FS 1.0.2 that' s why I tried FS
11560.
When I use the FS machine as a router to test the packet per
second
performance, I'm reaching 100Mbps with 8000pps in each
direction (from
vlan 55 to vlan56) with less than 12% CPU. So that I don't think there's an issue with the network.
Here is an "mpstat -P ALL 1" to show you what's happening
suddenly
with 70 bridge calls: 12:31:26 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:27 all 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00 12:31:27 0 3,00 0,00 3,00 0,00 1,00 4,00 0,00 89,00 6241,00
12:31:27 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:28 all 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35 12:31:28 0 14,14 0,00 56,57 0,00 2,02 5,05 0,00 22,22 6035,35
12:31:28 CPU %user %nice %sys %iowait %irq %soft %steal %idle intr/s 12:31:29 all 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17 12:31:29 0 24,75 0,00 67,33 0,00 0,99 6,93 0,00 0,00 5483,17
The CPU is going from 89% idle to 0% in less than 2 seconds.
I know that I don't have to expect too much from this kind of hardware, but it seems strange that the CPU power vanished so suddenly.
Thanks a lot for the guys that have read this long mail :p
kind regards, rod
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>
<mailto:Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
-- Anthony Minessale II
FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/
AIM: anthm MSN:anthony_minessale@hotmail.com
<mailto:MSN%3Aanthony_minessale@hotmail.com>
<mailto:MSN%3Aanthony_minessale@hotmail.com
<mailto:MSN%253Aanthony_minessale@hotmail.com>>
GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com
<mailto:PAYPAL%3Aanthony.minessale@gmail.com>
<mailto:PAYPAL%3Aanthony.minessale@gmail.com
<mailto:PAYPAL%253Aanthony.minessale@gmail.com>>
IRC: irc.freenode.net <http://irc.freenode.net>
<http://irc.freenode.net> #freeswitch
FreeSWITCH Developer Conference sip:888@conference.freeswitch.org
<mailto:sip%3A888@conference.freeswitch.org>
<mailto:sip%3A888@conference.freeswitch.org
<mailto:sip%253A888@conference.freeswitch.org>>
iax:guest@conference.freeswitch.org/888
<http://iax:guest@conference.freeswitch.org/888>
<http://iax:guest@conference.freeswitch.org/888> googletalk:conf+888@conference.freeswitch.org
<mailto:googletalk%3Aconf%2B888@conference.freeswitch.org>
<mailto:googletalk%3Aconf%2B888@conference.freeswitch.org
<mailto:googletalk%253Aconf%252B888@conference.freeswitch.org>>
pstn:213-799-1400
------------------------------------------------------------------------
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org
<mailto:Freeswitch-users@lists.freeswitch.org>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org <mailto:Freeswitch-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
------------------------------------------------------------------------
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
participants (9)
-
Anthony Minessale
-
Brian West
-
Hadley Rich
-
jay binks
-
Ken Rice
-
peder＠networkoblivion.com
-
Raul Fragoso
-
rod
-
Saeed Ahmed