<div dir="ltr">There are for sure some important performance issues between 1.2.8 and latest stable.<div>There even more in master.</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Fri, Dec 13, 2013 at 3:26 PM, Tim St. Pierre <span dir="ltr"><<a href="mailto:fs-list@communicatefreely.net" target="_blank">fs-list@communicatefreely.net</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">I thought that too, but I ran a ping test against the machine (to that<br>
interface) when it happened. It didn't lose a single packet.<br>
<br>
-Tim<br>
<div class="im"><br>
On 13-12-13 04:19 PM, Lloyd Aloysius wrote:<br>
> Tim<br>
><br>
> I would first check the connectivity<br>
><br>
> Switch ports?<br>
><br>
> Lloyd<br>
><br>
> On Dec 13, 2013 4:14 PM, "Cal Leeming [Simplicity Media Ltd]"<br>
> <<a href="mailto:cal.leeming@simplicitymedialtd.co.uk">cal.leeming@simplicitymedialtd.co.uk</a><br>
</div><div class="im">> <mailto:<a href="mailto:cal.leeming@simplicitymedialtd.co.uk">cal.leeming@simplicitymedialtd.co.uk</a>>> wrote:<br>
><br>
> I'll be on the FS conference call for the next 30 mins if you want<br>
> to ask any questions about this btw.<br>
><br>
> Cal<br>
><br>
><br>
> On Fri, Dec 13, 2013 at 9:10 PM, Cal Leeming [Simplicity Media Ltd]<br>
> <<a href="mailto:cal.leeming@simplicitymedialtd.co.uk">cal.leeming@simplicitymedialtd.co.uk</a><br>
</div><div class="im">> <mailto:<a href="mailto:cal.leeming@simplicitymedialtd.co.uk">cal.leeming@simplicitymedialtd.co.uk</a>>> wrote:<br>
><br>
><br>
><br>
><br>
> On Fri, Dec 13, 2013 at 8:37 PM, Tim St. Pierre<br>
> <<a href="mailto:fs-list@communicatefreely.net">fs-list@communicatefreely.net</a><br>
</div><div><div class="h5">> <mailto:<a href="mailto:fs-list@communicatefreely.net">fs-list@communicatefreely.net</a>>> wrote:<br>
><br>
> Hello,<br>
><br>
> I'm having a problem where FS seems to exhaust it's open<br>
> file limit<br>
> after about 7 hours of operation. Once this happens, the<br>
> database and<br>
> curl connections no longer function, and I usually lose the<br>
> ability to<br>
> get a CLI connection. Existing calls usually stay up, until<br>
> I kill -9<br>
> and launch again.<br>
><br>
> I'm using FreeSWITCH Version<br>
> 1.2.8+git~20130403T221701Z~79be96aa8e<br>
> on Centos 2.6.18-348.el5<br>
><br>
> This machine had been running solid for at least 90 days<br>
> without a hitch<br>
> - I had almost hit 500K sessions, when this started<br>
> happening two days<br>
> ago. I have changed very little on the machine - the odd<br>
> dialplan<br>
> route, and nothing that seems to coincide with that time.<br>
><br>
><br>
> It looks like CURL is not closing sockets properly, as<br>
> netstat shows<br>
> between 2000 - 4000 http connections in TIME_WAIT state.<br>
> The number<br>
> slowly creeps up, then down a little, then up some more<br>
> until it all<br>
> comes crashing down.<br>
><br>
><br>
> Can you confirm if your web server is responding to the requests?<br>
><br>
> One possible explanation is this spike in traffic caused<br>
> excessive requests which your web server could not handle, and<br>
> thus you hit the ulimit.<br>
><br>
> You could increase the ulimit (or set it to unlimited) as per;<br>
> <a href="http://www.cyberciti.biz/faq/linux-increase-the-maximum-number-of-open-files/" target="_blank">http://www.cyberciti.biz/faq/linux-increase-the-maximum-number-of-open-files/</a><br>
><br>
> However, if your web server is struggling to keep up with the<br>
> work load then increasing the max open files will just make the<br>
> problem worse. Increasing is fine, as long as your web server<br>
> can keep up with the load, otherwise it will just continue to<br>
> snowball.<br>
><br>
> Try installing some profiling tools on your web server to<br>
> monitor the stats, you can use something like New Relic or<br>
> AppNeta for this, or even just change your access log to output<br>
> the loading/response times into your access log, then look for<br>
> high response times.<br>
><br>
> You can also tweak kernel TCP stack settings as per;<br>
> <a href="http://www.cyberciti.biz/faq/linux-command-forcibly-close-socket-ports-in-time_wait-state/" target="_blank">http://www.cyberciti.biz/faq/linux-command-forcibly-close-socket-ports-in-time_wait-state/</a><br>
><br>
> Hope this helps<br>
><br>
><br>
><br>
> ls /proc/15742/fd|wc -l currently returns about 400. It was<br>
> 300 an hour<br>
> ago. When it gets to 1024, I'm going to have to restart again.<br>
><br>
> Any suggestions as to where I should look?<br>
><br>
> -Tim<br>
><br>
> _________________________________________________________________________<br>
> Professional FreeSWITCH Consulting Services:<br>
</div></div>> <a href="mailto:consulting@freeswitch.org">consulting@freeswitch.org</a> <mailto:<a href="mailto:consulting@freeswitch.org">consulting@freeswitch.org</a>><br>
<div class="im">> <a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><br>
><br>
> FreeSWITCH-powered IP PBX: The CudaTel Communication Server<br>
> <a href="http://www.cudatel.com" target="_blank">http://www.cudatel.com</a><br>
><br>
> Official FreeSWITCH Sites<br>
> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
> <a href="http://wiki.freeswitch.org" target="_blank">http://wiki.freeswitch.org</a><br>
> <a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><br>
><br>
> FreeSWITCH-users mailing list<br>
> <a href="mailto:FreeSWITCH-users@lists.freeswitch.org">FreeSWITCH-users@lists.freeswitch.org</a><br>
</div>> <mailto:<a href="mailto:FreeSWITCH-users@lists.freeswitch.org">FreeSWITCH-users@lists.freeswitch.org</a>><br>
<div class="im">> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
><br>
><br>
><br>
><br>
> _________________________________________________________________________<br>
> Professional FreeSWITCH Consulting Services:<br>
</div>> <a href="mailto:consulting@freeswitch.org">consulting@freeswitch.org</a> <mailto:<a href="mailto:consulting@freeswitch.org">consulting@freeswitch.org</a>><br>
<div class="im">> <a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><br>
><br>
> FreeSWITCH-powered IP PBX: The CudaTel Communication Server<br>
> <a href="http://www.cudatel.com" target="_blank">http://www.cudatel.com</a><br>
><br>
> Official FreeSWITCH Sites<br>
> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
> <a href="http://wiki.freeswitch.org" target="_blank">http://wiki.freeswitch.org</a><br>
> <a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><br>
><br>
> FreeSWITCH-users mailing list<br>
> <a href="mailto:FreeSWITCH-users@lists.freeswitch.org">FreeSWITCH-users@lists.freeswitch.org</a><br>
</div>> <mailto:<a href="mailto:FreeSWITCH-users@lists.freeswitch.org">FreeSWITCH-users@lists.freeswitch.org</a>><br>
<div class="HOEnZb"><div class="h5">> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
><br>
><br>
><br>
> _________________________________________________________________________<br>
> Professional FreeSWITCH Consulting Services:<br>
> <a href="mailto:consulting@freeswitch.org">consulting@freeswitch.org</a><br>
> <a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><br>
><br>
> FreeSWITCH-powered IP PBX: The CudaTel Communication Server<br>
> <a href="http://www.cudatel.com" target="_blank">http://www.cudatel.com</a><br>
><br>
> Official FreeSWITCH Sites<br>
> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
> <a href="http://wiki.freeswitch.org" target="_blank">http://wiki.freeswitch.org</a><br>
> <a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><br>
><br>
> FreeSWITCH-users mailing list<br>
> <a href="mailto:FreeSWITCH-users@lists.freeswitch.org">FreeSWITCH-users@lists.freeswitch.org</a><br>
> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
><br>
<br>
_________________________________________________________________________<br>
Professional FreeSWITCH Consulting Services:<br>
<a href="mailto:consulting@freeswitch.org">consulting@freeswitch.org</a><br>
<a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><br>
<br>
FreeSWITCH-powered IP PBX: The CudaTel Communication Server<br>
<a href="http://www.cudatel.com" target="_blank">http://www.cudatel.com</a><br>
<br>
Official FreeSWITCH Sites<br>
<a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
<a href="http://wiki.freeswitch.org" target="_blank">http://wiki.freeswitch.org</a><br>
<a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><br>
<br>
FreeSWITCH-users mailing list<br>
<a href="mailto:FreeSWITCH-users@lists.freeswitch.org">FreeSWITCH-users@lists.freeswitch.org</a><br>
<a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
<a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br><div dir="ltr">Anthony Minessale II ♬ @anthmfs ♬ @FreeSWITCH ♬<div><br><div>☞ <a href="http://freeswitch.org/" target="_blank">http://freeswitch.org/</a> ☞ <a href="http://cluecon.com/" target="_blank">http://cluecon.com/</a> ☞ <a href="http://twitter.com/FreeSWITCH" target="_blank">http://twitter.com/FreeSWITCH</a></div>
<div><div>☞ <a href="http://irc.freenode.net" target="_blank">irc.freenode.net</a> #freeswitch ☞ <u><a href="http://freeswitch.org/g+" target="_blank">http://freeswitch.org/g+</a></u><br><br></div><div>ClueCon Weekly Development Call <br>
</div><div>☎ <a href="mailto:sip%3A888@conference.freeswitch.org" target="_blank">sip:888@conference.freeswitch.org</a> ☎ +19193869900 </div><div><br></div></div></div></div>
</div>