while i was doing stress test over FS, things look pretty good as FS is able to hold 800 concurrent calls with a call loss rate at around 0.1%, when leveling up to 1000 concurrent calls, the call loss soars to 10-20%, i made some modification to switch.conf like <param name="max-sessions" value="2000"/> <param name="sessions-per-second" value="100"/> but things didn't get any better, the host CPU usage rate is around 80-90%, memory usage: 10%, network load 10%, so i think there should be someway we can make FS handle more concurrent calls, any ideas?
If your CPU is averaging around 80-90%, I would consider that maxed out! Can you try it on a more powerful machine?
while i was doing stress test over FS, things look pretty good as FS is able to hold 800 concurrent calls with a call loss rate at around 0.1%, when leveling up to 1000 concurrent calls, the call loss soars to 10-20%, i made some modification to switch.conf like
<param name="max-sessions" value="2000"/> <param name="sessions-per-second" value="100"/>
but things didn't get any better, the host CPU usage rate is around 80-90%, memory usage: 10%, network load 10%, so i think there should be someway we can make FS handle more concurrent calls, any ideas?
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
No virus found in this message. Checked by AVG - www.avg.com <http://www.avg.com> Version: 2012.0.2242 / Virus Database: 3199/5922 - Release Date: 06/18/13
I've doubled CPU capability, now the CPU usage at 1000 calls is around 50%, but call loss is still 10-20%, maybe Brian is right, don't try more than 500 calls. 2013/6/19 Alex Lake <alex@digitalmail.com>
If your CPU is averaging around 80-90%, I would consider that maxed out! Can you try it on a more powerful machine?
while i was doing stress test over FS, things look pretty good as FS is able to hold 800 concurrent calls with a call loss rate at around 0.1%, when leveling up to 1000 concurrent calls, the call loss soars to 10-20%, i made some modification to switch.conf like
<param name="max-sessions" value="2000"/> <param name="sessions-per-second" value="100"/>
but things didn't get any better, the host CPU usage rate is around 80-90%, memory usage: 10%, network load 10%, so i think there should be someway we can make FS handle more concurrent calls, any ideas?
_________________________________________________________________________ Professional FreeSWITCH Consulting Services:consulting@freeswitch.orghttp://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Serverhttp://www.cudatel.com
Official FreeSWITCH Siteshttp://www.freeswitch.orghttp://wiki.freeswitch.orghttp://www.cluecon.com
FreeSWITCH-users mailing listFreeSWITCH-users@lists.freeswitch.orghttp://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-usershttp://www.frees...
No virus found in this message. Checked by AVG - www.avg.com Version: 2012.0.2242 / Virus Database: 3199/5922 - Release Date: 06/18/13
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Vincent, What network card hardware are you using? UDP packets on cheap networking cards are very sensitive to a lack of idle cpu time. I've seen many models of RealTek cards that will start dropping over 10% of all UDP packets if your CPU idle drops below ~50%. In my experience server grade Intel network cards are much better, but even these will start dropping ~5-10% of UDP packets if your CPU idle gets below 15%. Also do these calls have the media going through this box? or through an external media gateway? William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com On 06/19/2013 07:55 PM, Vincent Xia wrote:
I've doubled CPU capability, now the CPU usage at 1000 calls is around 50%, but call loss is still 10-20%, maybe Brian is right, don't try more than 500 calls.
2013/6/19 Alex Lake <alex@digitalmail.com <mailto:alex@digitalmail.com>>
If your CPU is averaging around 80-90%, I would consider that maxed out! Can you try it on a more powerful machine?
while i was doing stress test over FS, things look pretty good as FS is able to hold 800 concurrent calls with a call loss rate at around 0.1%, when leveling up to 1000 concurrent calls, the call loss soars to 10-20%, i made some modification to switch.conf like
<param name="max-sessions" value="2000"/> <param name="sessions-per-second" value="100"/>
but things didn't get any better, the host CPU usage rate is around 80-90%, memory usage: 10%, network load 10%, so i think there should be someway we can make FS handle more concurrent calls, any ideas?
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
No virus found in this message. Checked by AVG - www.avg.com <http://www.avg.com> Version: 2012.0.2242 / Virus Database: 3199/5922 - Release Date: 06/18/13
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Vincent, I concur with quality lan card advice, namely intel. Also, what is your system's "clocksource0" -- both available and current. Cheers, ————— iThing: Big thumbs & little keys. Please excuse typo, spelling and grammar errors • Thought of the Day – "With all this manure, there must be a pony in here somewhere.” On 2013-06-19, at 23:35, William King <william.king@quentustech.com> wrote:
Vincent,
What network card hardware are you using? UDP packets on cheap networking cards are very sensitive to a lack of idle cpu time. I've seen many models of RealTek cards that will start dropping over 10% of all UDP packets if your CPU idle drops below ~50%. In my experience server grade Intel network cards are much better, but even these will start dropping ~5-10% of UDP packets if your CPU idle gets below 15%.
Also do these calls have the media going through this box? or through an external media gateway?
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
On 06/19/2013 07:55 PM, Vincent Xia wrote:
I've doubled CPU capability, now the CPU usage at 1000 calls is around 50%, but call loss is still 10-20%, maybe Brian is right, don't try more than 500 calls.
2013/6/19 Alex Lake <alex@digitalmail.com <mailto:alex@digitalmail.com>>
If your CPU is averaging around 80-90%, I would consider that maxed out! Can you try it on a more powerful machine?
while i was doing stress test over FS, things look pretty good as FS is able to hold 800 concurrent calls with a call loss rate at around 0.1%, when leveling up to 1000 concurrent calls, the call loss soars to 10-20%, i made some modification to switch.conf like
<param name="max-sessions" value="2000"/> <param name="sessions-per-second" value="100"/>
but things didn't get any better, the host CPU usage rate is around 80-90%, memory usage: 10%, network load 10%, so i think there should be someway we can make FS handle more concurrent calls, any ideas?
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
No virus found in this message. Checked by AVG - www.avg.com <http://www.avg.com> Version: 2012.0.2242 / Virus Database: 3199/5922 - Release Date: 06/18/13
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Doubled it so quick? Does that mean its a virtual or real box? The distro, the hardware, the speed of the network, the configuration, the filesystem all matter in performance. There is no mention to what the test is or what the frequency of calls is etc. Short duration calls hurt more than long etc. This is part of why we tend to shy away from load testing questions. On Wed, Jun 19, 2013 at 11:59 PM, S. Scott <8f27e956@gmail.com> wrote:
Vincent,
I concur with quality lan card advice, namely intel. Also, what is your system's "clocksource0" -- both available and current.
Cheers,
————— iThing: Big thumbs & little keys. Please excuse typo, spelling and grammar errors • Thought of the Day – "With all this manure, there must be a pony in here somewhere.”
On 2013-06-19, at 23:35, William King <william.king@quentustech.com> wrote:
Vincent,
What network card hardware are you using? UDP packets on cheap networking cards are very sensitive to a lack of idle cpu time. I've seen many models of RealTek cards that will start dropping over 10% of all UDP packets if your CPU idle drops below ~50%. In my experience server grade Intel network cards are much better, but even these will start dropping ~5-10% of UDP packets if your CPU idle gets below 15%.
Also do these calls have the media going through this box? or through an external media gateway?
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
On 06/19/2013 07:55 PM, Vincent Xia wrote:
I've doubled CPU capability, now the CPU usage at 1000 calls is around 50%, but call loss is still 10-20%, maybe Brian is right, don't try more than 500 calls.
2013/6/19 Alex Lake <alex@digitalmail.com <mailto:alex@digitalmail.com
If your CPU is averaging around 80-90%, I would consider that maxed out! Can you try it on a more powerful machine?
while i was doing stress test over FS, things look pretty good as FS is able to hold 800 concurrent calls with a call loss rate at around 0.1%, when leveling up to 1000 concurrent calls, the call loss soars to 10-20%, i made some modification to switch.conf like
<param name="max-sessions" value="2000"/> <param name="sessions-per-second" value="100"/>
but things didn't get any better, the host CPU usage rate is around 80-90%, memory usage: 10%, network load 10%, so i think there should be someway we can make FS handle more concurrent calls, any ideas?
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto: FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
No virus found in this message. Checked by AVG - www.avg.com <http://www.avg.com> Version: 2012.0.2242 / Virus Database: 3199/5922 - Release Date: 06/18/13
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Anthony Minessale II FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/ Twitter: http://twitter.com/FreeSWITCH_wire AIM: anthm MSN:anthony_minessale@hotmail.com GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com IRC: irc.freenode.net #freeswitch FreeSWITCH Developer Conference sip:888@conference.freeswitch.org googletalk:conf+888@conference.freeswitch.org pstn:+19193869900
exactly, im doing the test on a virtual box, double the CPU from quad-core to oct-core, the test scenario is simple, making calls at a speed of 28calls per sec, play sound file at PCMU codec for 150 sec after connected, then hangup and repeat. i've heard people stress tests FS with over 2000 concurrent calls, so i think there should be some way i can make my FS box more powerful, but things seem not gonna be easy to do. 2013/6/20 Anthony Minessale <anthony.minessale@gmail.com>
Doubled it so quick? Does that mean its a virtual or real box? The distro, the hardware, the speed of the network, the configuration, the filesystem all matter in performance. There is no mention to what the test is or what the frequency of calls is etc. Short duration calls hurt more than long etc.
This is part of why we tend to shy away from load testing questions.
On Wed, Jun 19, 2013 at 11:59 PM, S. Scott <8f27e956@gmail.com> wrote:
Vincent,
I concur with quality lan card advice, namely intel. Also, what is your system's "clocksource0" -- both available and current.
Cheers,
————— iThing: Big thumbs & little keys. Please excuse typo, spelling and grammar errors • Thought of the Day – "With all this manure, there must be a pony in here somewhere.”
On 2013-06-19, at 23:35, William King <william.king@quentustech.com> wrote:
Vincent,
What network card hardware are you using? UDP packets on cheap networking cards are very sensitive to a lack of idle cpu time. I've seen many models of RealTek cards that will start dropping over 10% of all UDP packets if your CPU idle drops below ~50%. In my experience server grade Intel network cards are much better, but even these will start dropping ~5-10% of UDP packets if your CPU idle gets below 15%.
Also do these calls have the media going through this box? or through an external media gateway?
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
On 06/19/2013 07:55 PM, Vincent Xia wrote:
I've doubled CPU capability, now the CPU usage at 1000 calls is around 50%, but call loss is still 10-20%, maybe Brian is right, don't try more than 500 calls.
2013/6/19 Alex Lake <alex@digitalmail.com <mailto:alex@digitalmail.com
If your CPU is averaging around 80-90%, I would consider that maxed out! Can you try it on a more powerful machine?
while i was doing stress test over FS, things look pretty good as FS is able to hold 800 concurrent calls with a call loss rate at around 0.1%, when leveling up to 1000 concurrent calls, the call loss soars to 10-20%, i made some modification to switch.conf like
<param name="max-sessions" value="2000"/> <param name="sessions-per-second" value="100"/>
but things didn't get any better, the host CPU usage rate is around 80-90%, memory usage: 10%, network load 10%, so i think there should be someway we can make FS handle more concurrent calls, any ideas?
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto: FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
No virus found in this message. Checked by AVG - www.avg.com <http://www.avg.com> Version: 2012.0.2242 / Virus Database: 3199/5922 - Release Date: 06/18/13
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_________________________________________________________________________
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Anthony Minessale II
FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/ Twitter: http://twitter.com/FreeSWITCH_wire
AIM: anthm MSN:anthony_minessale@hotmail.com GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com IRC: irc.freenode.net #freeswitch
FreeSWITCH Developer Conference sip:888@conference.freeswitch.org googletalk:conf+888@conference.freeswitch.org pstn:+19193869900
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
The first step towards great performance is to get real hardware. You will never come close to the performance when running inside a VM. /Peter 2013/6/20 Vincent Xia <gmangudai@gmail.com>
exactly, im doing the test on a virtual box, double the CPU from quad-core to oct-core, the test scenario is simple, making calls at a speed of 28calls per sec, play sound file at PCMU codec for 150 sec after connected, then hangup and repeat.
i've heard people stress tests FS with over 2000 concurrent calls, so i think there should be some way i can make my FS box more powerful, but things seem not gonna be easy to do.
2013/6/20 Anthony Minessale <anthony.minessale@gmail.com>
Doubled it so quick? Does that mean its a virtual or real box? The distro, the hardware, the speed of the network, the configuration, the filesystem all matter in performance. There is no mention to what the test is or what the frequency of calls is etc. Short duration calls hurt more than long etc.
This is part of why we tend to shy away from load testing questions.
On Wed, Jun 19, 2013 at 11:59 PM, S. Scott <8f27e956@gmail.com> wrote:
Vincent,
I concur with quality lan card advice, namely intel. Also, what is your system's "clocksource0" -- both available and current.
Cheers,
————— iThing: Big thumbs & little keys. Please excuse typo, spelling and grammar errors • Thought of the Day – "With all this manure, there must be a pony in here somewhere.”
On 2013-06-19, at 23:35, William King <william.king@quentustech.com> wrote:
Vincent,
What network card hardware are you using? UDP packets on cheap networking cards are very sensitive to a lack of idle cpu time. I've seen many models of RealTek cards that will start dropping over 10% of all UDP packets if your CPU idle drops below ~50%. In my experience server grade Intel network cards are much better, but even these will start dropping ~5-10% of UDP packets if your CPU idle gets below 15%.
Also do these calls have the media going through this box? or through an external media gateway?
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
On 06/19/2013 07:55 PM, Vincent Xia wrote:
I've doubled CPU capability, now the CPU usage at 1000 calls is around 50%, but call loss is still 10-20%, maybe Brian is right, don't try more than 500 calls.
2013/6/19 Alex Lake <alex@digitalmail.com <mailto: alex@digitalmail.com>>
If your CPU is averaging around 80-90%, I would consider that maxed out! Can you try it on a more powerful machine?
while i was doing stress test over FS, things look pretty good as FS is able to hold 800 concurrent calls with a call loss rate at around 0.1%, when leveling up to 1000 concurrent calls, the call loss soars to 10-20%, i made some modification to switch.conf like
<param name="max-sessions" value="2000"/> <param name="sessions-per-second" value="100"/>
but things didn't get any better, the host CPU usage rate is around 80-90%, memory usage: 10%, network load 10%, so i think there should be someway we can make FS handle more concurrent calls, any ideas?
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto: FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
No virus found in this message. Checked by AVG - www.avg.com <http://www.avg.com> Version: 2012.0.2242 / Virus Database: 3199/5922 - Release Date: 06/18/13
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_________________________________________________________________________
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Anthony Minessale II
FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/ Twitter: http://twitter.com/FreeSWITCH_wire
AIM: anthm MSN:anthony_minessale@hotmail.com GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com IRC: irc.freenode.net #freeswitch
FreeSWITCH Developer Conference sip:888@conference.freeswitch.org googletalk:conf+888@conference.freeswitch.org pstn:+19193869900
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
my network card: Intel(R) PRO/1000 MT Network Connection, and all calls have the media going through FS(everything is in the same LAN), cuz sometimes i need to do recording, but no with stress testing, as it will make significant burden to the system. 2013/6/20 William King <william.king@quentustech.com>
Vincent,
What network card hardware are you using? UDP packets on cheap networking cards are very sensitive to a lack of idle cpu time. I've seen many models of RealTek cards that will start dropping over 10% of all UDP packets if your CPU idle drops below ~50%. In my experience server grade Intel network cards are much better, but even these will start dropping ~5-10% of UDP packets if your CPU idle gets below 15%.
Also do these calls have the media going through this box? or through an external media gateway?
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
On 06/19/2013 07:55 PM, Vincent Xia wrote:
I've doubled CPU capability, now the CPU usage at 1000 calls is around 50%, but call loss is still 10-20%, maybe Brian is right, don't try more than 500 calls.
2013/6/19 Alex Lake <alex@digitalmail.com <mailto:alex@digitalmail.com>>
If your CPU is averaging around 80-90%, I would consider that maxed out! Can you try it on a more powerful machine?
while i was doing stress test over FS, things look pretty good as FS is able to hold 800 concurrent calls with a call loss rate at around 0.1%, when leveling up to 1000 concurrent calls, the call loss soars to 10-20%, i made some modification to switch.conf like
<param name="max-sessions" value="2000"/> <param name="sessions-per-second" value="100"/>
but things didn't get any better, the host CPU usage rate is around 80-90%, memory usage: 10%, network load 10%, so i think there should be someway we can make FS handle more concurrent calls, any ideas?
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:
FreeSWITCH-users@lists.freeswitch.org>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:
http://lists.freeswitch.org/mailman/options/freeswitch-users
No virus found in this message. Checked by AVG - www.avg.com <http://www.avg.com> Version: 2012.0.2242 / Virus Database: 3199/5922 - Release Date: 06/18/13
_________________________________________________________________________
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:
http://lists.freeswitch.org/mailman/options/freeswitch-users
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Hi Vincent I agree with Peter that the best way to get maximum performance is Bare Metal. Have a look at this link when it comes to virtualization if you have no other options. http://dtrace.org/blogs/brendan/2013/01/11/virtualization-performance-zones-... I prefer OpenVZ, but haven't done any stress testing yet. My bet would be that the performance will be better in Containers/Jails then any other form of virtualization. -- Rgds
Vincent Xia <mailto:gmangudai@gmail.com> June 20, 2013 7:47 AM my network card: Intel(R) PRO/1000 MT Network Connection, and all calls have the media going through FS(everything is in the same LAN), cuz sometimes i need to do recording, but no with stress testing, as it will make significant burden to the system.
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org William King <mailto:william.king@quentustech.com> June 20, 2013 4:31 AM Vincent,
What network card hardware are you using? UDP packets on cheap networking cards are very sensitive to a lack of idle cpu time. I've seen many models of RealTek cards that will start dropping over 10% of all UDP packets if your CPU idle drops below ~50%. In my experience server grade Intel network cards are much better, but even these will start dropping ~5-10% of UDP packets if your CPU idle gets below 15%.
Also do these calls have the media going through this box? or through an external media gateway?
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org Vincent Xia <mailto:gmangudai@gmail.com> June 20, 2013 3:55 AM I've doubled CPU capability, now the CPU usage at 1000 calls is around 50%, but call loss is still 10-20%, maybe Brian is right, don't try more than 500 calls.
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org Alex Lake <mailto:alex@digitalmail.com> June 19, 2013 8:49 AM If your CPU is averaging around 80-90%, I would consider that maxed out! Can you try it on a more powerful machine?
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org Vincent Xia <mailto:gmangudai@gmail.com> June 19, 2013 8:21 AM while i was doing stress test over FS, things look pretty good as FS is able to hold 800 concurrent calls with a call loss rate at around 0.1%, when leveling up to 1000 concurrent calls, the call loss soars to 10-20%, i made some modification to switch.conf like
<param name="max-sessions" value="2000"/> <param name="sessions-per-second" value="100"/>
but things didn't get any better, the host CPU usage rate is around 80-90%, memory usage: 10%, network load 10%, so i think there should be someway we can make FS handle more concurrent calls, any ideas? _________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
There's all sorts of ways to make the host more efficient (I wouldn't really consider it making freeswitch 'run faster'). They may or may not fit your use case. Q1: Are you transcoding? If yes, you could use a transcoding card from Sangoma or Digium. Make sure you aren't transcoding calls that don't need to be transcoded by using late codec negotiation. Q2: Are you using the default SQLite as your database? If so, you have several possibilities. You could load the SQLite database into RAM. The more preffered option would be to use a different machine for the database and use Postgres instead of SQLite. Q3: Are there other applications running on the host (web servers, other databases, even your call logic)? If so, put them elsewhere. Call logic could be handled by another server by using mod_xml_curl or something similar. Make sure that server is up to the task. Q4: Do you really need 800 calls running on one server? I don't know if I'd trust a server with 800 calls (it doesn't matter what your running to handle them). If for some reason the server fails (hardware or software), you could lose your calls. After I did all of the above, I would go ahead and get at least one other freeswitch server up and running. My rule is to never put more than 500 calls on one server at any given time. YMMV. Thank you, Brian Foster Project Manager/Owner's Rep. Davri Investments, Inc. O: 317-787-2686 x2102 M: 317-600-9753 E: bdfoster@davri.com Indianapolis, Indiana Sent from a mobile device. On Jun 19, 2013 3:28 AM, "Vincent Xia" <gmangudai@gmail.com> wrote:
while i was doing stress test over FS, things look pretty good as FS is able to hold 800 concurrent calls with a call loss rate at around 0.1%, when leveling up to 1000 concurrent calls, the call loss soars to 10-20%, i made some modification to switch.conf like
<param name="max-sessions" value="2000"/> <param name="sessions-per-second" value="100"/>
but things didn't get any better, the host CPU usage rate is around 80-90%, memory usage: 10%, network load 10%, so i think there should be someway we can make FS handle more concurrent calls, any ideas?
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
participants (8)
-
Alex Lake
-
Anthony Minessale
-
Brian Foster
-
Deon Vermeulen
-
Peter Olsson
-
S. Scott
-
Vincent Xia
-
William King