<div dir="ltr">You can compile FS under ASAN to check for memory leaks. Or you can try running it on valgrind and make just 1 or 2 calls.<div>Also did your test ever pause for 15 or 20 min to allow no callers to see if any of the memory was recycled?</div><div>P.S this should be a JIRA not a discussion on the mailing list.</div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Apr 25, 2016 at 12:18 PM, Nicholas Blasgen <span dir="ltr"><<a href="mailto:nicholas@hellohunter.com" target="_blank">nicholas@hellohunter.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">NewRelic, which you seem to be using, also provides per-application memory usage. Would be nice to see that after a day or partial day run.<div><br></div><div>Freeswitch uses a good amount of memory per channel. Are you sure the channels are being released? fs_cli -x status >> log_file ... and maybe run it on a crontab just to make sure the channels are being released.</div><div><br></div><div>Besides that, I personally don't have any ideas without recreating your test environment. I guess you could see if FIFO or Scheduled Hangup is the issue by calling HANGUP instead of FIFO for extension 7011. I've never personally used Schedule Hangup and as that's the method being used here to release the channels, it might be a concern.</div></div><div class="gmail_extra"><br clear="all"><div><div><br><div>Nicholas Blasgen</div><div>Developer</div><div>Predictive Dialer Limited</div><div><a href="tel:%2B1%20%28724%29%20252-7436" value="+17242527436" target="_blank">+1 (724) 252-7436</a> (cell)</div><div>Skype: nblasgen</div><div><br></div><div><font color="#666666">24/7 Support available:</font></div><div><font color="#666666"><a href="http://www.hellohunter.com" target="_blank">www.hellohunter.com</a> | <a href="tel:%28800%29%20513-5555" value="+18005135555" target="_blank">(800) 513-5555</a> | skype hello.hunter | <a href="mailto:support@hellohunter.com" target="_blank">support@hellohunter.com</a></font></div></div></div>
<br><div class="gmail_quote"><div><div class="h5">On Mon, Apr 25, 2016 at 6:11 AM, Mersed Kahrimanovic <span dir="ltr"><<a href="mailto:kahrimanovic.mersed@gmail.com" target="_blank">kahrimanovic.mersed@gmail.com</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div class="h5"><div dir="ltr"><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;font-size:large">Hello,<br></div><div class="gmail_quote"><div dir="ltr"><div style="font-family:arial,helvetica,sans-serif;font-size:large"><br></div><div style="font-family:arial,helvetica,sans-serif;font-size:large">We have implemented call center using a freeswitch as switch for handling calls. It is basically the logic where you have an agents within the queue waiting for an contacts to come in, or contact within the queue waiting if there is no any agents available.</div><div style="font-family:arial,helvetica,sans-serif;font-size:large"><br></div><div style="font-family:arial,helvetica,sans-serif;font-size:large">For this kind of implementation we used pure lua and hash tables (and not mod_fifo) in order to have a better flexibility and possibility to manage different contact/agent states.</div><div style="font-family:arial,helvetica,sans-serif;font-size:large"><br></div><div style="font-family:arial,helvetica,sans-serif;font-size:large">Everything was working fine on our old servers, now we are migrating to the cloud and we are using aws for that purpose, of course trying to cut some costs.</div><div style="font-family:arial,helvetica,sans-serif;font-size:large"><br></div><div style="font-family:arial,helvetica,sans-serif;font-size:large">---------------</div><div style="font-family:arial,helvetica,sans-serif;font-size:large"><br></div><div style="font-family:arial,helvetica,sans-serif;font-size:large">After initial setup of our solution we found out that there is a memory leak causing for freeswitch to consume 3 - 10 MB per minute during production hours. (we did not notice anything on old servers because we had like 24 cores and 94GB of ram on those).</div><div style="font-family:arial,helvetica,sans-serif;font-size:large">This is not too much of course but the bottom point is that increase is linear and its constantly raising consuming more and more of RAM.</div><div style="font-family:arial,helvetica,sans-serif;font-size:large"><br></div><div style="font-family:arial,helvetica,sans-serif;font-size:large">In order to isolate an issue and to conclude that we don't have an issue within our solution I installed 1.6.7 version of freeswitch and setup really simple call center with mod_fifo without anything else (totally independent from call center we are working on)</div><div style="font-family:arial,helvetica,sans-serif;font-size:large"><br></div><div style="font-family:arial,helvetica,sans-serif;font-size:large">For the reference:</div><div style="font-family:arial,helvetica,sans-serif;font-size:large"><br></div><div style="font-family:arial,helvetica,sans-serif;font-size:large"><b>Aws:</b> m4.large</div><div style="font-family:arial,helvetica,sans-serif;font-size:large"> vCPU: 2</div><div style="font-family:arial,helvetica,sans-serif;font-size:large"> RAM: 8GB</div><div style="font-family:arial,helvetica,sans-serif;font-size:large"> Throughput (Mbps): 450 </div><div style="font-family:arial,helvetica,sans-serif;font-size:large"><br><b>Freeswitch version:</b> 1.6.7<br><b>OS:</b> Debian GNU/Linux 8 (jessie)</div><div style="font-family:arial,helvetica,sans-serif;font-size:large"><b>Number of agents:</b> 30</div><div style="font-family:arial,helvetica,sans-serif;font-size:large"><b>Number of calls per agent:</b> 1</div><div style="font-family:arial,helvetica,sans-serif;font-size:large"><b>Total numbers of channels at time:</b> 60</div><div style="font-family:arial,helvetica,sans-serif;font-size:large"><b>Agents simulated with:</b> pjsip(<a href="http://www.pjsip.org/" target="_blank">http://www.pjsip.org/</a>)</div><div style="font-family:arial,helvetica,sans-serif;font-size:large"><b>Contact simulated with:</b> sipp(<a href="http://sipp.sourceforge.net/" target="_blank">http://sipp.sourceforge.net/</a>) </div><div style="font-family:arial,helvetica,sans-serif;font-size:large"><b>Configuration:</b> I used configuration which came with installation of freeswitch. The only things i changed is:</div><div style="font-family:arial,helvetica,sans-serif;font-size:large"> - default password</div><div style="font-family:arial,helvetica,sans-serif;font-size:large"> - internal rtp timeout</div><div style="font-family:arial,helvetica,sans-serif;font-size:large"> - rtpip and sip ip</div><div style="font-family:arial,helvetica,sans-serif;font-size:large"><br></div><div style="font-family:arial,helvetica,sans-serif;font-size:large">Test scenario:<br>1. Start the freeswitch.<br>2. Autoload lua script is going to ring all of the internal (agents) and push them to the extension where we had mod_fifo <br>3. After some time, same autoload script is going to start calling contacts each 800 miliseconds and push them to the extension where we have mod_fifo.</div><div style="font-family:arial,helvetica,sans-serif;font-size:large">4. mod_fifo will do the rest, bridge agent with the contact and handling the queue properly.</div><div style="font-family:arial,helvetica,sans-serif;font-size:large"><br></div><div style="font-family:arial,helvetica,sans-serif;font-size:large">As a result we will have 30 agents constantly "talking", and when ever call is dropped we will have agent connected with another. Parameters for the test match that scenario, and we dont have more then 60 - 65 channels open at the time (never).</div><div style="font-family:arial,helvetica,sans-serif;font-size:large"><br></div><div style="font-family:arial,helvetica,sans-serif;font-size:large">Dialplan for handling mod_fifo</div><div><font face="arial, helvetica, sans-serif" size="4"><a href="http://pastie.org/10812261" target="_blank">http://pastie.org/10812261</a></font><br></div><div><font face="arial, helvetica, sans-serif" size="4"><br></font></div><div><font face="arial, helvetica, sans-serif" size="4">Autoload lua script</font></div><div><font face="arial, helvetica, sans-serif" size="4"><a href="http://pastie.org/10812263" target="_blank">http://pastie.org/10812263</a><br></font></div><div><font face="arial, helvetica, sans-serif" size="4"><br></font></div><div><font face="arial, helvetica, sans-serif" size="4">Result</font></div><div><font face="arial, helvetica, sans-serif" size="4"><a href="http://prnt.sc/awm4ao" target="_blank">http://prnt.sc/awm4ao</a></font><br></div><div><font face="arial, helvetica, sans-serif" size="4"><br></font></div><div><font face="arial, helvetica, sans-serif" size="4">The results are for 24hrs period, and indeed 24hrs is a lot. We will never have production running more then 12hrs (and daily restart will occur). But this basically means that we are not able to host more then 40-45 agents on servers with 8GB of ram.</font></div><div><font face="arial, helvetica, sans-serif" size="4"><br></font></div><div><font face="arial, helvetica, sans-serif" size="4">My question is:</font></div><div><font face="arial, helvetica, sans-serif" size="4">Is this something which can be considered as memory leak, or this is simply how freeswitch works, behaves and requirements it have?</font></div><div><font face="arial, helvetica, sans-serif" size="4"><br></font></div><div><font face="arial, helvetica, sans-serif" size="4">Thank you,</font></div><div><font face="arial, helvetica, sans-serif" size="4"><br></font></div><div><font face="arial, helvetica, sans-serif" size="4">Mersed</font></div><div style="font-family:arial,helvetica,sans-serif;font-size:large"><br></div><div style="font-family:arial,helvetica,sans-serif;font-size:large"><br></div></div>
</div><br></div>
<br></div></div><span class="">_________________________________________________________________________<br>
Professional FreeSWITCH Consulting Services:<br>
<a href="mailto:consulting@freeswitch.org" target="_blank">consulting@freeswitch.org</a><br>
<a href="http://www.freeswitchsolutions.com" rel="noreferrer" target="_blank">http://www.freeswitchsolutions.com</a><br>
<br>
Official FreeSWITCH Sites<br>
<a href="http://www.freeswitch.org" rel="noreferrer" target="_blank">http://www.freeswitch.org</a><br>
<a href="http://wiki.freeswitch.org" rel="noreferrer" target="_blank">http://wiki.freeswitch.org</a><br>
<a href="http://www.cluecon.com" rel="noreferrer" target="_blank">http://www.cluecon.com</a><br>
<br>
FreeSWITCH-dev mailing list<br>
<a href="mailto:FreeSWITCH-dev@lists.freeswitch.org" target="_blank">FreeSWITCH-dev@lists.freeswitch.org</a><br>
<a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-dev" rel="noreferrer" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-dev</a><br>
UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-dev" rel="noreferrer" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-dev</a><br>
<a href="http://www.freeswitch.org" rel="noreferrer" target="_blank">http://www.freeswitch.org</a><br>
<br></span></blockquote></div><br></div>
<br>_________________________________________________________________________<br>
Professional FreeSWITCH Consulting Services:<br>
<a href="mailto:consulting@freeswitch.org">consulting@freeswitch.org</a><br>
<a href="http://www.freeswitchsolutions.com" rel="noreferrer" target="_blank">http://www.freeswitchsolutions.com</a><br>
<br>
Official FreeSWITCH Sites<br>
<a href="http://www.freeswitch.org" rel="noreferrer" target="_blank">http://www.freeswitch.org</a><br>
<a href="http://wiki.freeswitch.org" rel="noreferrer" target="_blank">http://wiki.freeswitch.org</a><br>
<a href="http://www.cluecon.com" rel="noreferrer" target="_blank">http://www.cluecon.com</a><br>
<br>
FreeSWITCH-dev mailing list<br>
<a href="mailto:FreeSWITCH-dev@lists.freeswitch.org">FreeSWITCH-dev@lists.freeswitch.org</a><br>
<a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-dev" rel="noreferrer" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-dev</a><br>
UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-dev" rel="noreferrer" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-dev</a><br>
<a href="http://www.freeswitch.org" rel="noreferrer" target="_blank">http://www.freeswitch.org</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr">Anthony Minessale II ♬ @anthmfs ♬ @FreeSWITCH ♬<div><br><div>☞ <a href="http://freeswitch.org/" target="_blank">http://freeswitch.org/</a> ☞ <a href="http://cluecon.com/" target="_blank">http://cluecon.com/</a> ☞ <a href="http://twitter.com/FreeSWITCH" target="_blank">http://twitter.com/FreeSWITCH</a></div><div><div>☞ <a href="http://irc.freenode.net" target="_blank">irc.freenode.net</a> #freeswitch ☞ <u><a href="http://freeswitch.org/g+" target="_blank">http://freeswitch.org/g+</a></u><br><br></div><div>ClueCon Weekly Development Call <br></div><div>☎ <a href="mailto:sip%3A888@conference.freeswitch.org" target="_blank">sip:888@conference.freeswitch.org</a> ☎ +19193869900 </div><div><br></div></div></div><div><a href="https://www.youtube.com/watch?v=9XXgW34t40s" style="color:rgb(17,85,204);font-size:12.8000001907349px" target="_blank">https://www.youtube.com/watch?v=9XXgW34t40s</a></div><div><a href="https://www.youtube.com/watch?v=NLaDpGQuZDA" target="_blank">https://www.youtube.com/watch?v=NLaDpGQuZDA</a><br></div></div></div></div></div></div></div>
</div>