<div dir="ltr"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><span style="color:rgb(31,73,125);font-family:Calibri,sans-serif;font-size:15px">show nothing other than FreeSWITCH was receiving the new messages but no bridge or cancel actions were taking place</span></blockquote>
<div><br></div><div>Do you have your logs at debug level and are there any log messages that indicate a call reaching a point then pausing?</div><div><br></div><div>I saw something recently similar under load, and it turned out to be the limit subsystem was waiting on DB queries that were severely backing up because there were too many commits happening per second and InnoDB was configured to flush to disk on every transaction commit which can only happen ~200 times per second. (Switching to the memory engine fixed the error although isn't transactional).</div>
<div><br></div><div>-Steve</div><div><br></div><div>-Steve</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On 20 November 2013 20:38, Andre <span dir="ltr"><<a href="mailto:andretodd@verizon.net" target="_blank">andretodd@verizon.net</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div lang="EN-US" link="blue" vlink="purple"><div><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">I tested again and when I use 25 cps for 2 hours everything worked fine. When I sent 50 cps I noticed FreeSWITCH worked for about 5 minutes then I saw the memory jump from 122 mb to to 1.6 gb in seconds. I think FreeSWITCH crashed but the logs show nothing other than FreeSWITCH was receiving the new messages but no bridge or cancel actions were taking place.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">How do I tell what happened that made freeswitch just stop working? The GUI didn’t show anything like a throw exception and when I type version or sofia status in the FreeSWITCH gui it doesn’t respond.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Andre<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> <a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" target="_blank">freeswitch-users-bounces@lists.freeswitch.org</a> [mailto:<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" target="_blank">freeswitch-users-bounces@lists.freeswitch.org</a>] <b>On Behalf Of </b>Anthony Minessale<br>
<b>Sent:</b> Wednesday, November 20, 2013 12:33 AM<br><b>To:</b> Freeswitch-users</span></p><div class="im"><br><b>Subject:</b> Re: [Freeswitch-users] Freeswitch Performance<u></u><u></u></div><p></p><p class="MsoNormal">
<u></u> <u></u></p><p>Get HEAD of stable branch or HEAD of master for latest build files.<u></u><u></u></p><div><div class="h5"><p>There is no promise windows can do 500cps the industry standard is 50 and you'll have probably more luck on linux but there is only on way to fimd out.<u></u><u></u></p>
<div><p class="MsoNormal">On Nov 19, 2013 11:27 PM, "I put the Who? in Mishehu" <<a href="mailto:mishehu@freeswitch.org" target="_blank">mishehu@freeswitch.org</a>> wrote:<u></u><u></u></p><blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div><div><p class="MsoNormal">The amusing thing about the recurring load test threads that pop up every now and then is that the most important tips are already documented on the wiki in one single page. Beyond that, you probably spend more time load testing than you do just tossing up another server and using something like kamailio or opensips to load balance...<br>
<br><br><u></u><u></u></p><pre>-- <u></u><u></u></pre><pre>Yossi Neiman<u></u><u></u></pre><pre><u></u> <u></u></pre><pre><u></u> <u></u></pre><pre>On 11/19/2013 06:48 PM, Antonio Teixeira wrote:<u></u><u></u></pre></div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt"><div><p class="MsoNormal">Hello Andre.<br><br>Solving performance problems is always hard , but a few points to keep in mind :<br><br>To my knowledge FS is pretty much a linux software , it works on windows by that i doesn't means it performs on windows ( please correct me if i'm wrong)<br>
The native DB for FS is Postgresql ( this should make you oracle admin more happy :) ).<br><br>Try this :<br>Linux Server Realtime Kernel + Last FS Stable + Postgresql ( tune it well).<br>Take care with ulimit on linux , its needed for the extra punch of performance<br>
Check if your "performance test" is real if you are pointing to 1500CPS for a two minute call you will have 180k calls before the first call gets disconnected, if you are also testing RTP that means 180k * 2 ports needed , The Kernel will start to complaining and you will run out of ports you will also run out of FD probably before you run out of ports on a not tuned linux install.<br>
If the DB is on the same server it will also stall since the FD will not be present for new connections to the back end.<br><br>In terms of BW you will exceed 230000 kb/s add a few more kb/s for the DB ( Not a problem here i think)<br>
<br>Another thing , no sip server ( please include all the nice names here like B2BUA , etc ) should ever queue anything.<br>I have never read the code that handles this on FS but the way i would do it should be something like : can we sustain the load ? No in that case send 503 else proceed.<br>
This is done in freeswitch by this var<br><a href="https://wiki.freeswitch.org/wiki/XML_Switch_Configuration#max-sessions" target="_blank">https://wiki.freeswitch.org/wiki/XML_Switch_Configuration#max-sessions</a><br><br>
A more general approach:<br>In SIp Servers you will generally ( if not running cpu intensive tasks, trancoding , tone detection , etc ), consume all the ram , Network IO ,than the cpu.<br>For the guys that plan something big you should take a look at this :<br>
<a href="http://www.solarflare.com/High-Frequency-Trading" target="_blank">http://www.solarflare.com/High-Frequency-Trading</a><br>Not by The NIC itself but because of this :<br><a href="http://www.openonload.org" target="_blank">http://www.openonload.org</a><br>
<br>Without more data i don't think we can help , above all performance testing is a dark art you just need to keep on trying different things and above all have some type of monitor tool to understand what exactly is holding you up , maybe its no FS...<br>
<br>Also 1500CPS is something seen in carrier operations generally with a named SBC in front , keep in mind that FS is a great software but it doesn't hold against SBC's that use special processors like ASIC to perform transcoding , sip parsing , tone detection ,etc etc<br>
<br><br>Disclaimer : post written deep into the night...<br><br>On 20/11/13 00:09, Andre wrote:<u></u><u></u></p></div><blockquote style="margin-top:5.0pt;margin-bottom:5.0pt"><div><p class="MsoNormal">Hi, I am testing out my FreeSWITCH 1.2.14 64 bit windows 8.1 on my Alienware Laptop with a very fast SSD and I7 processor with 8 GB DDR3 Ram.<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p><p class="MsoNormal">I have been using a pjsip test tool to test FreeSWITCH to see how it performs. Tell me if I’m wrong here, I believe if I sent “too many” calls to FreeSWITCH that it queues up the calls and sooner or later uses all the memory on my PC then just stops working. I do have the CPS sent to 1500 for testing but I never hit that high, I hit about 200 CPS.<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p><p class="MsoNormal">The CDRs that save to my database show it takes about 8 seconds from start time to end time. It does start out only taking milliseconds then it progresses to the 8 second mark. <u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p><p class="MsoNormal">The calls are just going to FreeSWITCH then I’m sending back a 503.<u></u><u></u></p><p class="MsoNormal"> <u></u><u></u></p><p class="MsoNormal">I have every mod turned off, logging set to 0, Core db going to a SQL Server and I even set FreeSWITCH to real time.<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p><p class="MsoNormal">Can anyone give me advise on what I can do to get better performance? I’ve also tested it out on my real server but in about 3 minutes of 50 cps FreeSWITCH uses up 3gb of memory and stops responding.<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p><p class="MsoNormal">I’m at a loss here on what else to do.<u></u><u></u></p><p class="MsoNormal">Andre<u></u><u></u></p></div><p class="MsoNormal" style="margin-bottom:12.0pt"><u></u> <u></u></p>
<pre>_________________________________________________________________________<u></u><u></u></pre><pre>Professional FreeSWITCH Consulting Services:<u></u><u></u></pre><pre><a href="mailto:consulting@freeswitch.org" target="_blank">consulting@freeswitch.org</a><u></u><u></u></pre>
<pre><a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><u></u><u></u></pre><pre><u></u> <u></u></pre><pre>FreeSWITCH-powered IP PBX: The CudaTel Communication Server<u></u><u></u></pre>
<pre><a href="http://www.cudatel.com" target="_blank">http://www.cudatel.com</a><u></u><u></u></pre><pre><u></u> <u></u></pre><pre>Official FreeSWITCH Sites<u></u><u></u></pre><pre><a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><u></u><u></u></pre>
<pre><a href="http://wiki.freeswitch.org" target="_blank">http://wiki.freeswitch.org</a><u></u><u></u></pre><pre><a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><u></u><u></u></pre><pre><u></u> <u></u></pre>
<pre>FreeSWITCH-users mailing list<u></u><u></u></pre><pre><a href="mailto:FreeSWITCH-users@lists.freeswitch.org" target="_blank">FreeSWITCH-users@lists.freeswitch.org</a><u></u><u></u></pre><pre><a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><u></u><u></u></pre>
<pre>UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><u></u><u></u></pre><pre><a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><u></u><u></u></pre>
</blockquote><p class="MsoNormal" style="margin-bottom:12.0pt"><br><br><u></u><u></u></p><pre>_________________________________________________________________________<u></u><u></u></pre><pre>Professional FreeSWITCH Consulting Services:<u></u><u></u></pre>
<pre><a href="mailto:consulting@freeswitch.org" target="_blank">consulting@freeswitch.org</a><u></u><u></u></pre><pre><a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><u></u><u></u></pre>
<pre><u></u> <u></u></pre><pre>FreeSWITCH-powered IP PBX: The CudaTel Communication Server<u></u><u></u></pre><pre><a href="http://www.cudatel.com" target="_blank">http://www.cudatel.com</a><u></u><u></u></pre><pre><u></u> <u></u></pre>
<pre>Official FreeSWITCH Sites<u></u><u></u></pre><pre><a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><u></u><u></u></pre><pre><a href="http://wiki.freeswitch.org" target="_blank">http://wiki.freeswitch.org</a><u></u><u></u></pre>
<pre><a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><u></u><u></u></pre><pre><u></u> <u></u></pre><pre>FreeSWITCH-users mailing list<u></u><u></u></pre><pre><a href="mailto:FreeSWITCH-users@lists.freeswitch.org" target="_blank">FreeSWITCH-users@lists.freeswitch.org</a><u></u><u></u></pre>
<pre><a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><u></u><u></u></pre><pre>UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><u></u><u></u></pre>
<pre><a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><u></u><u></u></pre></blockquote><p class="MsoNormal"><u></u> <u></u></p></div><p class="MsoNormal" style="margin-bottom:12.0pt"><br>_________________________________________________________________________<br>
Professional FreeSWITCH Consulting Services:<br><a href="mailto:consulting@freeswitch.org" target="_blank">consulting@freeswitch.org</a><br><a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><br>
<br>FreeSWITCH-powered IP PBX: The CudaTel Communication Server<br><a href="http://www.cudatel.com" target="_blank">http://www.cudatel.com</a><br><br>Official FreeSWITCH Sites<br><a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
<a href="http://wiki.freeswitch.org" target="_blank">http://wiki.freeswitch.org</a><br><a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><br><br>FreeSWITCH-users mailing list<br><a href="mailto:FreeSWITCH-users@lists.freeswitch.org" target="_blank">FreeSWITCH-users@lists.freeswitch.org</a><br>
<a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
<a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><u></u><u></u></p></blockquote></div></div></div></div></div><br>_________________________________________________________________________<br>
Professional FreeSWITCH Consulting Services:<br>
<a href="mailto:consulting@freeswitch.org">consulting@freeswitch.org</a><br>
<a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><br>
<br>
FreeSWITCH-powered IP PBX: The CudaTel Communication Server<br>
<a href="http://www.cudatel.com" target="_blank">http://www.cudatel.com</a><br>
<br>
Official FreeSWITCH Sites<br>
<a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
<a href="http://wiki.freeswitch.org" target="_blank">http://wiki.freeswitch.org</a><br>
<a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><br>
<br>
FreeSWITCH-users mailing list<br>
<a href="mailto:FreeSWITCH-users@lists.freeswitch.org">FreeSWITCH-users@lists.freeswitch.org</a><br>
<a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
<a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
<br></blockquote></div><br></div>