<div dir="ltr">Take a look in your FS logs..<div>Im pretty sure you will see the whimsical & Awesome log message :</div><div>
<p class=""><i>LUKE: I'm hit, but not bad.<br>LUKE'S VOICE: Artoo, see what you can do with it. Hang on back there....</i></p></div><div>this is in thread_launch_failure in switch_core_session.c ( around line 1714 )<br>
</div><div>and around this code you can easily see the following </div><div>
<p class="">sess_count = switch_core_session_count();<br><span class="">if</span> (sess_count > <span class="">110</span>) {<br>switch_core_session_limit(sess_count - <span class="">10</span>);</p></div><div>as you can see, it bumps 10 off your SPS, every time thread_launch_failure is called.</div>
<div><br></div><div>thread_launch_failure is called whenever switch_thread_create fails to create a thread.</div><div>which basically means apr_thread_create </div><div><br></div><div>I have seen this myself with MUCH lower SPS on openVZ machines, but since your seeing it also im now hoping we can nut this out :)</div>
<div>im going to dig a little more and see what I can find.</div><div><br></div><div>what openVZ kernel are you using out of interest ?</div><div>ive seen this on a fairly old, but stable 2.6.32-19-pve</div><div><br></div>
<div>let me know what you find ! </div><div><br></div>
<div><br></div>
<div><br></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On 28 March 2014 04:30, Muhammad Naseer Bhatti <span dir="ltr"><<a href="mailto:nbhatti@gmail.com" target="_blank">nbhatti@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Yes, i was thinking on same lines. Its running over OpenVZ kernel.<br>
I am now going to try replicate this in a physical env.<br>
<br>
Sent from my iPad<br>
<div class="HOEnZb"><div class="h5"><br>
> On Mar 27, 2014, at 9:11 PM, William King <<a href="mailto:william.king@quentustech.com">william.king@quentustech.com</a>> wrote:<br>
><br>
> Is your FS instance running in a virtual environment?<br>
><br>
> William King<br>
> Senior Engineer<br>
> Quentus Technologies, INC<br>
> 1037 NE 65th St Suite 273<br>
> Seattle, WA 98115<br>
> Main: (877) 211-9337<br>
> Office: (206) 388-4772<br>
> Cell: (253) 686-5518<br>
> <a href="mailto:william.king@quentustech.com">william.king@quentustech.com</a><br>
><br>
>> On 03/27/2014 11:07 AM, Muhammad Naseer Bhatti wrote:<br>
>> No i am definitely not going to that SPS limit. The peak was set to 400<br>
>> so maybe this is just a skewed value. 1000 session does not look to be<br>
>> high load. The call is bridged and set to play silence and disconnects<br>
>> at random time under 1 minute. The resources on the server also clearly<br>
>> seem to be available. I am not gearing this towards a how do i ....<br>
>> Performance kind of a thread but could there be something unusual here?<br>
>><br>
>> Sent from my iPad<br>
>><br>
>> On Mar 27, 2014, at 9:07 PM, Ken Rice <<a href="mailto:krice@freeswitch.org">krice@freeswitch.org</a><br>
>> <mailto:<a href="mailto:krice@freeswitch.org">krice@freeswitch.org</a>>> wrote:<br>
>><br>
>>> Re: [Freeswitch-users] FreeSWITCH changing max_sessions automatically<br>
>>> You’re hitting a melt down protection... Once it reaches a limit and<br>
>>> cant allocate the additional resources for creating anew session it<br>
>>> will back down the max sessions limit to help save itself...<br>
>>><br>
>>> The PEAK SPS there was a value seen at some point the SPS buffer...<br>
>>> Depending on you beating the machine to death it is possible that<br>
>>> number got skewed due to a timer miss<br>
>>><br>
>>><br>
>>> On 3/27/14 10:57 AM, "Muhammad Bhatti" <<a href="mailto:nbhatti@gmail.com">nbhatti@gmail.com</a>> wrote:<br>
>>><br>
>>><br>
>>> Just have noticed something new today. Testing a local instance on<br>
>>> CentOS 6.0 with FreeSWITCH Version 1.2.23~64bit. FreeSWITCH seems<br>
>>> to be changing the max_sessions param automatically. This happens<br>
>>> when typically I bridge around 1000 sessions and whatever value I<br>
>>> set to sps and max_sessions, it comes down.<br>
>>><br>
>>> UP 0 years, 0 days, 0 hours, 37 minutes, 54 seconds, 362<br>
>>> milliseconds, 294 microseconds<br>
>>> FreeSWITCH (Version 1.2.23 64bit) is ready<br>
>>> 74716 session(s) since startup<br>
>>> *976 session(s) - peak 1022, last 5min 985<br>
>>> 112 session(s) per Sec out of max 400, peak 9053, last 5min 317 <-<br>
>>> BTW This peak was never tried, not sure why it says 9053<br>
>>> 5000 session(s) max<br>
>>> min idle cpu 0.00/55.00<br>
>>> Current Stack Size/Max 240K/8192K<br>
>>><br>
>>> =======<br>
>>> followed by<br>
>>> =======<br>
>>><br>
>>> switch_core_session.c:2288 Over Session Limit! 1013<br>
>>> mod_sofia.c:4884 Error Creating Session<br>
>>><br>
>>> =======<br>
>>> And then<br>
>>> =======<br>
>>><br>
>>> freeswitch@internal> status<br>
>>> UP 0 years, 0 days, 0 hours, 38 minutes, 35 seconds, 372<br>
>>> milliseconds, 831 microseconds<br>
>>> FreeSWITCH (Version 1.2.23 64bit) is ready<br>
>>> 76231 session(s) since startup<br>
>>> 560 session(s) - peak 1023, last 5min 1023<br>
>>> 0 session(s) per Sec out of max 400, peak 9053, last 5min 317<br>
>>> 1013 session(s) max<br>
>>> min idle cpu 0.00/99.00<br>
>>> Current Stack Size/Max 240K/8192K<br>
>>><br>
>>><br>
>>> Is this something changed recently? Or some sort of server<br>
>>> meltdown protection mechanism being forked :)<br>
>>><br>
>>><br>
>>> *<br>
>>><br>
>>> *<br>
>>> *--<br>
>>> Ken<br>
>>> _<a href="http://www.FreeSWITCH.org" target="_blank">http://www.FreeSWITCH.org</a><br>
>>> <a href="http://www.ClueCon.com" target="_blank">http://www.ClueCon.com</a><br>
>>> <a href="http://www.OSTAG.org" target="_blank">http://www.OSTAG.org</a><br>
>>> _<a href="http://irc.freenode.net" target="_blank">irc.freenode.net</a> <<a href="http://irc.freenode.net" target="_blank">http://irc.freenode.net</a>> #freeswitch<br>
>>> Twitter: @FreeSWITCH<br>
>>><br>
>>> _________________________________________________________________________<br>
>>> Professional FreeSWITCH Consulting Services:<br>
>>> <a href="mailto:consulting@freeswitch.org">consulting@freeswitch.org</a> <mailto:<a href="mailto:consulting@freeswitch.org">consulting@freeswitch.org</a>><br>
>>> <a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><br>
>>><br>
>>> FreeSWITCH-powered IP PBX: The CudaTel Communication Server<br>
>>> <a href="http://www.cudatel.com" target="_blank">http://www.cudatel.com</a><br>
>>><br>
>>> Official FreeSWITCH Sites<br>
>>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>>> <a href="http://wiki.freeswitch.org" target="_blank">http://wiki.freeswitch.org</a><br>
>>> <a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><br>
>>><br>
>>> FreeSWITCH-users mailing list<br>
>>> <a href="mailto:FreeSWITCH-users@lists.freeswitch.org">FreeSWITCH-users@lists.freeswitch.org</a><br>
>>> <mailto:<a href="mailto:FreeSWITCH-users@lists.freeswitch.org">FreeSWITCH-users@lists.freeswitch.org</a>><br>
>>> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
>>> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
>>> <<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a>><br>
>>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>><br>
>><br>
>> _________________________________________________________________________<br>
>> Professional FreeSWITCH Consulting Services:<br>
>> <a href="mailto:consulting@freeswitch.org">consulting@freeswitch.org</a><br>
>> <a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><br>
>><br>
>> FreeSWITCH-powered IP PBX: The CudaTel Communication Server<br>
>> <a href="http://www.cudatel.com" target="_blank">http://www.cudatel.com</a><br>
>><br>
>> Official FreeSWITCH Sites<br>
>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>> <a href="http://wiki.freeswitch.org" target="_blank">http://wiki.freeswitch.org</a><br>
>> <a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><br>
>><br>
>> FreeSWITCH-users mailing list<br>
>> <a href="mailto:FreeSWITCH-users@lists.freeswitch.org">FreeSWITCH-users@lists.freeswitch.org</a><br>
>> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
>> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>><br>
><br>
> _________________________________________________________________________<br>
> Professional FreeSWITCH Consulting Services:<br>
> <a href="mailto:consulting@freeswitch.org">consulting@freeswitch.org</a><br>
> <a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><br>
><br>
> FreeSWITCH-powered IP PBX: The CudaTel Communication Server<br>
> <a href="http://www.cudatel.com" target="_blank">http://www.cudatel.com</a><br>
><br>
> Official FreeSWITCH Sites<br>
> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
> <a href="http://wiki.freeswitch.org" target="_blank">http://wiki.freeswitch.org</a><br>
> <a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><br>
><br>
> FreeSWITCH-users mailing list<br>
> <a href="mailto:FreeSWITCH-users@lists.freeswitch.org">FreeSWITCH-users@lists.freeswitch.org</a><br>
> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
<br>
_________________________________________________________________________<br>
Professional FreeSWITCH Consulting Services:<br>
<a href="mailto:consulting@freeswitch.org">consulting@freeswitch.org</a><br>
<a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><br>
<br>
FreeSWITCH-powered IP PBX: The CudaTel Communication Server<br>
<a href="http://www.cudatel.com" target="_blank">http://www.cudatel.com</a><br>
<br>
Official FreeSWITCH Sites<br>
<a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
<a href="http://wiki.freeswitch.org" target="_blank">http://wiki.freeswitch.org</a><br>
<a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><br>
<br>
FreeSWITCH-users mailing list<br>
<a href="mailto:FreeSWITCH-users@lists.freeswitch.org">FreeSWITCH-users@lists.freeswitch.org</a><br>
<a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
<a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br>Sincerely<br><br>Jay
</div>