<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Hi All,<div class=""><br class=""></div><div class="">I’m having a very similar issue however it’s not staying at 100% CPU on physical hardware. I’ve created a JIRA but wanted to see if anyone else had any feedback on possible causes? I’m using freeswitch 1.6.15 (previously 1.6.13). What happens is that FS will jump to 100% CPU and stay there for 1-2 seconds then drop back down but this is then causing massive jitter/call quality issues for about 10-15 seconds after the spike. The strange thing that I’ve noticed is that even with 0 active calls, FS is using 15-30% cpu constantly with only 40-60 registered endpoints.</div><div class=""><br class=""></div><div class="">I’m watching the logs in DEBUG mode and not seeing anything there that’s indicative of any issue, no loops that I can see, and it seems to be happening when there’s even just 1 or 2 active calls on the system. </div><div class=""><br class=""></div><div class="">I’m wondering if there’s any other suggestions on where to look because this is getting very frustrating for me and my users.</div><div class=""><br class=""></div><div class="">Thanks much for any pointers!<br class=""><div class="">
<span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; " class=""><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; " class=""><div class="">Cj B</div></div></span></div></span></span>
</div>
<br class=""><div><blockquote type="cite" class=""><div class="">On Mar 22, 2017, at 8:13 AM, Anthony Minessale <<a href="mailto:anthony.minessale@gmail.com" class="">anthony.minessale@gmail.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div class="">top -H -p `pidof freeswitch` </div><div class="">Note the pid using 100% cpu</div><div class=""><br class=""></div><div class="">gcore `pidof freeswitch`</div><div class=""><br class=""></div><div class="">Attach it to a jira. If you think its a bug in FS you should report it to Jira not to this list.</div><div class=""><br class=""></div><div class=""><a href="https://freeswitch.org/jira" class="">https://freeswitch.org/jira</a></div><div class=""><br class=""></div><div class=""> <br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""><div class="gmail_quote"><div class="">On Wed, Mar 22, 2017 at 10:14 AM Shaun Stokes <<a href="mailto:shaun.stokes@itec-support.co.uk" class="">shaun.stokes@itec-support.co.uk</a>> wrote:<br class=""></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="white" lang="EN-GB" link="blue" vlink="purple" class="gmail_msg">
<div class="gmail_msg m_8143532683370750560WordSection1"><p class="MsoNormal gmail_msg"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d" class="gmail_msg">It’s probably a long shot, but if you’re able to replicate the problem it might be worth trying to replicate this on physical hardware. That way you eliminate
your virtual environment from the problem, there are a number of factors which exist in virtual environments depending on your hyper-visor which can contribute to performance issues of which we’ve experienced in the past.</span></p><div class=""><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div><p class="MsoNormal gmail_msg"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d" class="gmail_msg">It would also be worth trying to isolate what the script is doing when the high CPU begins, if you’ve got a test environment you can use to replicate the issue
then you could try tweaking the script so you can eliminate certain actions from the list of causes, there’s maybe a FreeSWITCH module which is being called which triggers this.</span></p><div class=""><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div>
<div class="gmail_msg">
<div style="border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt 0cm 0cm 0cm" class="gmail_msg"><p class="MsoNormal gmail_msg"><b class="gmail_msg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext" class="gmail_msg">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext" class="gmail_msg"> <a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" class="gmail_msg" target="_blank">freeswitch-users-bounces@lists.freeswitch.org</a>
[mailto:<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" class="gmail_msg" target="_blank">freeswitch-users-bounces@lists.freeswitch.org</a>] <b class="gmail_msg">On Behalf Of </b>Grant Bagdasarian<br class="gmail_msg">
<b class="gmail_msg">Sent:</b> 22 March 2017 11:20</span></p></div></div></div></div><div bgcolor="white" lang="EN-GB" link="blue" vlink="purple" class="gmail_msg"><div class="gmail_msg m_8143532683370750560WordSection1"><div class="gmail_msg"><div style="border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt 0cm 0cm 0cm" class="gmail_msg"><p class="MsoNormal gmail_msg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext" class="gmail_msg"><br class="gmail_msg">
<b class="gmail_msg">To:</b> FreeSWITCH Users Help <<a href="mailto:freeswitch-users@lists.freeswitch.org" class="gmail_msg" target="_blank">freeswitch-users@lists.freeswitch.org</a>><br class="gmail_msg">
<b class="gmail_msg">Subject:</b> Re: [Freeswitch-users] 100% CPU usage</span></p></div></div></div></div><div bgcolor="white" lang="EN-GB" link="blue" vlink="purple" class="gmail_msg"><div class="gmail_msg m_8143532683370750560WordSection1"><div class=""> <br class="webkit-block-placeholder"></div><p class="MsoNormal gmail_msg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext" class="gmail_msg">@Shuan, yes we are using the session:ready() method before we execute.
</span></p><p class="MsoNormal gmail_msg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext" class="gmail_msg">We are running all of our servers virtually and never had any issues up until now.</span></p><p class="MsoNormal gmail_msg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext" class="gmail_msg">This same application ran on older versions of freeswitch without issues, even during and after high load.
</span></p><div class=""><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div><p class="MsoNormal gmail_msg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext" class="gmail_msg">@Antonio, thanks for the tips! I’ll have a look and try some stuff.</span></p><div class=""><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div>
<div class="gmail_msg">
<div style="border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt 0cm 0cm 0cm" class="gmail_msg"><p class="MsoNormal gmail_msg"><b class="gmail_msg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext" class="gmail_msg">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:windowtext" class="gmail_msg">
<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" class="gmail_msg" target="_blank">freeswitch-users-bounces@lists.freeswitch.org</a> [<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" class="gmail_msg" target="_blank">mailto:freeswitch-users-bounces@lists.freeswitch.org</a>]
<b class="gmail_msg">On Behalf Of </b>Antonio Silva<br class="gmail_msg">
<b class="gmail_msg">Sent:</b> woensdag 22 maart 2017 10:09<br class="gmail_msg">
<b class="gmail_msg">To:</b> <a href="mailto:freeswitch-users@lists.freeswitch.org" class="gmail_msg" target="_blank">freeswitch-users@lists.freeswitch.org</a><br class="gmail_msg">
<b class="gmail_msg">Subject:</b> Re: [Freeswitch-users] 100% CPU usage</span></p>
</div>
</div><div class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div><p class="MsoNormal gmail_msg" style="margin-bottom:12.0pt"><span lang="EN-US" class="gmail_msg">We had some issues using pcall functions like io.popen when trying to execute external commands, that block mod_lua, i end up replacing that with os.execute.<br class="gmail_msg">
<br class="gmail_msg">
Recently i also had some issue with cpu hitting 100%,for what i could compile from debugging was something related with malloc calls. after compiling fs with tcmalloc the issue disappear, you could try this approach as well.<br class="gmail_msg">
<br class="gmail_msg">
You can check jira: <a href="https://freeswitch.org/jira/browse/FS-9957" class="gmail_msg" target="_blank">https://freeswitch.org/jira/browse/FS-9957</a> and also in the malling: "CPU sys load issue" for more info.<br class="gmail_msg">
<br class="gmail_msg">
<br class="gmail_msg">
Regards,<br class="gmail_msg">
António</span></p>
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">On 03/22/2017 09:52 AM, Shaun Stokes wrote:</span></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt" class="gmail_msg">
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d" class="gmail_msg">Are you using ‘if (session:ready()) then’ in your scripts before you execute?</span><span lang="EN-US" class="gmail_msg"></span></p><div class=""><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d" class="gmail_msg"> </span><span lang="EN-US" class="gmail_msg"></span><br class="webkit-block-placeholder"></div><p class="MsoNormal gmail_msg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d" class="gmail_msg">Are you using virtual or physical hardware and what spec?</span><span lang="EN-US" class="gmail_msg"></span></p><div class=""><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1f497d" class="gmail_msg"> </span><span lang="EN-US" class="gmail_msg"></span><br class="webkit-block-placeholder"></div>
<div class="gmail_msg">
<div style="border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt 0cm 0cm 0cm" class="gmail_msg"><p class="MsoNormal gmail_msg"><b class="gmail_msg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">
<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" class="gmail_msg" target="_blank">freeswitch-users-bounces@lists.freeswitch.org</a> [<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" class="gmail_msg" target="_blank">mailto:freeswitch-users-bounces@lists.freeswitch.org</a>]
<b class="gmail_msg">On Behalf Of </b>Grant Bagdasarian<br class="gmail_msg">
<b class="gmail_msg">Sent:</b> 22 March 2017 07:31<br class="gmail_msg">
<b class="gmail_msg">To:</b> FreeSWITCH Users Help <a href="mailto:freeswitch-users@lists.freeswitch.org" class="gmail_msg" target="_blank">
<freeswitch-users@lists.freeswitch.org></a><br class="gmail_msg">
<b class="gmail_msg">Subject:</b> Re: [Freeswitch-users] 100% CPU usage</span><span lang="EN-US" class="gmail_msg"></span></p>
</div>
</div><div class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div><p class="MsoNormal gmail_msg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">Anthony, we triple checked the script and its dependencies. There are no loops at all in the script. The imported scripts are also written by us and they too
do not contain any loops. </span><span lang="EN-US" class="gmail_msg"></span></p><p class="MsoNormal gmail_msg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">It’s just basic call handling with some playback and play_and_get_digits calls, and some pcall calls to query a database.</span><span lang="EN-US" class="gmail_msg"></span></p><div class=""><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg"> </span><span lang="EN-US" class="gmail_msg"></span><br class="webkit-block-placeholder"></div><p class="MsoNormal gmail_msg"><b class="gmail_msg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">
<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" class="gmail_msg" target="_blank">freeswitch-users-bounces@lists.freeswitch.org</a> [<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" class="gmail_msg" target="_blank">mailto:freeswitch-users-bounces@lists.freeswitch.org</a>]
<b class="gmail_msg">On Behalf Of </b>Anthony Minessale<br class="gmail_msg">
<b class="gmail_msg">Sent:</b> dinsdag 21 maart 2017 16:02<br class="gmail_msg">
<b class="gmail_msg">To:</b> FreeSWITCH Users Help <<a href="mailto:freeswitch-users@lists.freeswitch.org" class="gmail_msg" target="_blank">freeswitch-users@lists.freeswitch.org</a>><br class="gmail_msg">
<b class="gmail_msg">Subject:</b> Re: [Freeswitch-users] 100% CPU usage</span><span lang="EN-US" class="gmail_msg"></span></p><div class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div>
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">I already told you why a week ago. Your script most likely has an endless loop in it that does not check the condition session:ready() </span></p>
</div>
<div class="gmail_msg"><div class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div>
</div>
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">However, Feel free to contact <a href="mailto:consulting@freeswitch.org" class="gmail_msg" target="_blank">
consulting@freeswitch.org</a> and we can formally diagnose it for a fee.</span></p>
</div>
<div class="gmail_msg"><div class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div>
</div>
<div class="gmail_msg"><div class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div>
</div>
<div class="gmail_msg"><div class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div>
</div>
<div class="gmail_msg"><div class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div>
<div class="gmail_msg">
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">On Tue, Mar 21, 2017 at 6:42 AM Grant Bagdasarian <<a href="mailto:gb@cm.nl" class="gmail_msg" target="_blank">gb@cm.nl</a>> wrote:</span></p>
</div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt" class="gmail_msg">
<div class="gmail_msg">
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">Attached are the logs for:</span></span><span lang="EN-US" class="gmail_msg"></span></p>
</div>
</div>
<div class="gmail_msg">
<div class="gmail_msg">
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">#check thread usage:</span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">top -p $(cat /var/run/freeswitch/freeswitch.pid) -H -b -n 1</span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"> </span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"> </span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">#memory mapping:</span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">cat /proc/$(cat /var/run/freeswitch/freeswitch.pid)/maps</span></pre><div class=""><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg"> </span></span><span lang="EN-US" class="gmail_msg"></span><br class="webkit-block-placeholder"></div>
</div>
</div>
<div class="gmail_msg">
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">We’re unable to run gcore since freeswitch hogs all available cpu’s at 100%.
</span></span><span lang="EN-US" class="gmail_msg"></span></p><p class="MsoNormal gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">I tried changing the nice settings real-time but that didn’t work either.</span></span><span lang="EN-US" class="gmail_msg"></span></p><div class=""><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg"> </span></span><span lang="EN-US" class="gmail_msg"></span><br class="webkit-block-placeholder"></div><p class="MsoNormal gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">At one point we had a huge spike in inbound traffic towards our freeswitch (valid traffic).</span></span><span lang="EN-US" class="gmail_msg"></span></p><p class="MsoNormal gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">The traffic is handled by a lua application.</span></span><span lang="EN-US" class="gmail_msg"></span></p><p class="MsoNormal gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">What we saw was calls hanging in freeswitch while they’ve already been physically disconnected.
</span></span><span lang="EN-US" class="gmail_msg"></span></p><p class="MsoNormal gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">After the huge spike freeswitch behaved normally for a couple of minutes and then suddenly started eating all the available cpu cores at
100%. </span></span><span lang="EN-US" class="gmail_msg"></span></p><div class=""><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg"> </span></span><span lang="EN-US" class="gmail_msg"></span><br class="webkit-block-placeholder"></div><p class="MsoNormal gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">We have some db queries which are fired in the lua application, so these may cause the application to hang, but we haven’t reproduced it
yet. </span></span><span lang="EN-US" class="gmail_msg"></span></p><div class=""><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg"> </span></span><span lang="EN-US" class="gmail_msg"></span><br class="webkit-block-placeholder"></div><p class="MsoNormal gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">I’ll setup a test lab with the same configuration and fire sipp at it to see if I can reproduce the issue.
</span></span><span lang="EN-US" class="gmail_msg"></span></p><p class="MsoNormal gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">However, I probably won’t be able to run gcore for debugging. Any other suggestions?</span></span><span lang="EN-US" class="gmail_msg"></span></p><div class=""><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg"> </span></span><span lang="EN-US" class="gmail_msg"></span><br class="webkit-block-placeholder"></div><p class="MsoNormal gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">Also we saw a lot of open udp ports and some had a huge read buffer size which did not decrease.
</span></span><span lang="EN-US" class="gmail_msg"></span></p><div class=""><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg"> </span></span><span lang="EN-US" class="gmail_msg"></span><br class="webkit-block-placeholder"></div><p class="MsoNormal gmail_msg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg"><img border="0" width="924" height="436" id="m_8143532683370750560m_3623806029287245330Picture_x0020_2" class="gmail_msg"></span><span lang="EN-US" class="gmail_msg"></span></p><div class=""><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg"> </span></span><span lang="EN-US" class="gmail_msg"></span><br class="webkit-block-placeholder"></div>
<div class="gmail_msg">
<div style="border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt 0cm 0cm 0cm" class="gmail_msg"><p class="MsoNormal gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><b class="gmail_msg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">From:</span></b></span><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">
<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" class="gmail_msg" target="_blank">freeswitch-users-bounces@lists.freeswitch.org</a> [mailto:<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" class="gmail_msg" target="_blank">freeswitch-users-bounces@lists.freeswitch.org</a>]
<b class="gmail_msg">On Behalf Of </b>Grant Bagdasarian</span></span><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg"><br class="gmail_msg">
<span class="gmail_msg m_8143532683370750560gmailmsg"><b class="gmail_msg">Sent:</b> maandag 13 maart 2017 09:04</span></span><span lang="EN-US" class="gmail_msg"></span></p>
</div>
</div>
</div>
</div>
<div class="gmail_msg">
<div class="gmail_msg">
<div class="gmail_msg">
<div style="border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt 0cm 0cm 0cm" class="gmail_msg"><p class="MsoNormal gmail_msg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg"><br class="gmail_msg">
<span class="gmail_msg m_8143532683370750560gmailmsg"><b class="gmail_msg">To:</b> FreeSWITCH Users Help <<a href="mailto:freeswitch-users@lists.freeswitch.org" class="gmail_msg" target="_blank">freeswitch-users@lists.freeswitch.org</a>></span><br class="gmail_msg">
<span class="gmail_msg m_8143532683370750560gmailmsg"><b class="gmail_msg">Subject:</b> Re: [Freeswitch-users] 100% CPU usage</span></span><span lang="EN-US" class="gmail_msg"></span></p>
</div>
</div>
</div>
</div>
<div class="gmail_msg">
<div class="gmail_msg"><div class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div><p class="MsoNormal gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="NL" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">Hi Antony and Antonio,</span></span><span lang="EN-US" class="gmail_msg"></span></p><div class=""><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="NL" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg"> </span></span><span lang="EN-US" class="gmail_msg"></span><br class="webkit-block-placeholder"></div><p class="MsoNormal gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">Thank you for the tips.</span></span><span lang="EN-US" class="gmail_msg"></span></p><p class="MsoNormal gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">We haven’t had freeswitch going berserk anymore (not sure as to why it did perform without issue over the weekend), but will continue to
monitor it and run the commands to trace the issue.</span></span><span lang="EN-US" class="gmail_msg"></span></p><div class=""><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg"> </span></span><span lang="EN-US" class="gmail_msg"></span><br class="webkit-block-placeholder"></div><p class="MsoNormal gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">Regards,</span></span><span lang="EN-US" class="gmail_msg"></span></p><div class=""><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg"> </span></span><span lang="EN-US" class="gmail_msg"></span><br class="webkit-block-placeholder"></div><p class="MsoNormal gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">Grant</span></span><span lang="EN-US" class="gmail_msg"></span></p><div class=""><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg"> </span></span><span lang="EN-US" class="gmail_msg"></span><br class="webkit-block-placeholder"></div><p class="MsoNormal gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><b class="gmail_msg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">From:</span></b></span><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg">
<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" class="gmail_msg" target="_blank">freeswitch-users-bounces@lists.freeswitch.org</a> [<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" class="gmail_msg" target="_blank">mailto:freeswitch-users-bounces@lists.freeswitch.org</a>]
<b class="gmail_msg">On Behalf Of </b>Anthony Minessale</span></span><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif" class="gmail_msg"><br class="gmail_msg">
<span class="gmail_msg m_8143532683370750560gmailmsg"><b class="gmail_msg">Sent:</b> zaterdag 11 maart 2017 00:07</span><br class="gmail_msg">
<span class="gmail_msg m_8143532683370750560gmailmsg"><b class="gmail_msg">To:</b> FreeSWITCH Users Help <<a href="mailto:freeswitch-users@lists.freeswitch.org" class="gmail_msg" target="_blank">freeswitch-users@lists.freeswitch.org</a>></span><br class="gmail_msg">
<span class="gmail_msg m_8143532683370750560gmailmsg"><b class="gmail_msg">Subject:</b> Re: [Freeswitch-users] 100% CPU usage</span></span><span lang="EN-US" class="gmail_msg"></span></p><div class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div>
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">Make sure you lua script has all while loops including session:ready() as a condition to continue. Its a common mistake that leads to loops spinning out of control on hungup channels.</span></p>
<div class="gmail_msg"><div class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div>
</div>
</div>
<div class="gmail_msg"><div class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div>
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">On Fri, Mar 10, 2017 at 6:11 AM, Antonio Silva <<a href="mailto:asilva@wirelessmundi.com" class="gmail_msg" target="_blank">asilva@wirelessmundi.com</a>> wrote:</span></p>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt" class="gmail_msg">
<div class="gmail_msg"><p class="MsoNormal gmail_msg" style="margin-bottom:12.0pt"><span lang="EN-US" class="gmail_msg">Hi,<br class="gmail_msg">
<br class="gmail_msg">
You can use the following commands:</span></p>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">#get a core:</span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">gcore -o /home/gcore-$(date +%s) $(cat /var/run/freeswitch/freeswitch.pid)</span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"> </span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"> </span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">#check thread usage:</span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">top -p $(cat /var/run/freeswitch/freeswitch.pid) -H -b -n 1</span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"> </span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"> </span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">#memory mapping:</span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">cat /proc/$(cat /var/run/freeswitch/freeswitch.pid)/maps</span></pre><p class="MsoNormal gmail_msg" style="margin-bottom:12.0pt"><span lang="EN-US" class="gmail_msg"><br class="gmail_msg">
<br class="gmail_msg">
you can get some info from fs:</span></p>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">fs_cli -x "sofia global siptrace on"</span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">fs_cli -x "fsctl debug_level 10"</span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">fs_cli -x "sofia loglevel all 9"</span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">fs_cli -x "fsctl debug_sql "</span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">fs_cli -x "sofia global debug presence"</span></pre><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg"><br class="gmail_msg">
<br class="gmail_msg">
Put everything into a jira so we can take a look.<br class="gmail_msg">
<br class="gmail_msg">
<br class="gmail_msg">
Regards,<br class="gmail_msg">
António</span></p>
<div class="gmail_msg">
<div class="gmail_msg"><div style="margin-bottom: 12pt;" class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div>
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">On 03/10/2017 11:08 AM, Grant Bagdasarian wrote:</span></p>
</div>
</div>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt" class="gmail_msg">
<div class="gmail_msg">
<div class="gmail_msg">
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="NL" class="gmail_msg">Hi,</span></span><span lang="EN-US" class="gmail_msg"></span></p><div class=""><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="NL" class="gmail_msg"> </span></span><span lang="EN-US" class="gmail_msg"></span><br class="webkit-block-placeholder"></div><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">We’re currently experiencing a weird issue with one of our freeswitch servers where the CPU just goes berserk and stays at 100%.
</span></p><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">There are no active calls at that moment, but FS is still using 100% CPU.
</span></p><div class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">I was unable to get a debug using gdb, since freeswitch does not crash.
</span></p><div class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">We had this issue on 1.6.13 and then I upgraded to 1.6.15 this morning, but the problem still persists.
</span></p><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">There is currently only one active application running on this box which is using LUA. Maybe that is causing the issue?</span></p><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">We checked the code but there are no weird loops etc. Perhaps we are missing something?</span></p><div class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">Any ideas how to trace this?</span></p><div class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">Regards,</span></p><div class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">Grant</span></p><div class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div>
</div><div style="margin-bottom: 12pt;" class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div>
</div>
</div>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">_________________________________________________________________________</span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">Professional FreeSWITCH Consulting Services: </span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"><a href="mailto:consulting@freeswitch.org" class="gmail_msg" target="_blank">consulting@freeswitch.org</a></span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"><a href="http://www.freeswitchsolutions.com/" class="gmail_msg" target="_blank">http://www.freeswitchsolutions.com</a></span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"> </span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">Official FreeSWITCH Sites</span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"><a href="http://www.freeswitch.org/" class="gmail_msg" target="_blank">http://www.freeswitch.org</a></span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"><a href="http://confluence.freeswitch.org/" class="gmail_msg" target="_blank">http://confluence.freeswitch.org</a></span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"><a href="http://www.cluecon.com/" class="gmail_msg" target="_blank">http://www.cluecon.com</a></span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"> </span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">FreeSWITCH-users mailing list</span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"><a href="mailto:FreeSWITCH-users@lists.freeswitch.org" class="gmail_msg" target="_blank">FreeSWITCH-users@lists.freeswitch.org</a></span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"><a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" class="gmail_msg" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a></span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" class="gmail_msg" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a></span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"><a href="http://www.freeswitch.org/" class="gmail_msg" target="_blank">http://www.freeswitch.org</a></span></pre>
</blockquote><div style="margin-bottom: 12pt;" class=""><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="color:#888888" class="gmail_msg"> </span></span><span lang="EN-US" class="gmail_msg"></span><br class="webkit-block-placeholder"></div>
<pre class="gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="color:#888888" class="gmail_msg">-- </span></span><span lang="EN-US" class="gmail_msg"></span></pre>
<pre class="gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="color:#888888" class="gmail_msg"> </span></span><span lang="EN-US" class="gmail_msg"></span></pre>
<pre class="gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="color:#888888" class="gmail_msg">Saludos / Regards / Cumprimentos,</span></span><span lang="EN-US" class="gmail_msg"></span></pre>
<pre class="gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="color:#888888" class="gmail_msg">António silva</span></span><span lang="EN-US" class="gmail_msg"></span></pre>
</div><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg"><br class="gmail_msg">
_________________________________________________________________________<br class="gmail_msg">
Professional FreeSWITCH Consulting Services:<br class="gmail_msg">
<a href="mailto:consulting@freeswitch.org" class="gmail_msg" target="_blank">consulting@freeswitch.org</a><br class="gmail_msg">
<a href="http://www.freeswitchsolutions.com/" class="gmail_msg" target="_blank">http://www.freeswitchsolutions.com</a><br class="gmail_msg">
<br class="gmail_msg">
Official FreeSWITCH Sites<br class="gmail_msg">
<a href="http://www.freeswitch.org/" class="gmail_msg" target="_blank">http://www.freeswitch.org</a><br class="gmail_msg">
<a href="http://confluence.freeswitch.org/" class="gmail_msg" target="_blank">http://confluence.freeswitch.org</a><br class="gmail_msg">
<a href="http://www.cluecon.com/" class="gmail_msg" target="_blank">http://www.cluecon.com</a><br class="gmail_msg">
<br class="gmail_msg">
FreeSWITCH-users mailing list<br class="gmail_msg">
<a href="mailto:FreeSWITCH-users@lists.freeswitch.org" class="gmail_msg" target="_blank">FreeSWITCH-users@lists.freeswitch.org</a><br class="gmail_msg">
<a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" class="gmail_msg" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br class="gmail_msg">
UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" class="gmail_msg" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br class="gmail_msg">
<a href="http://www.freeswitch.org/" class="gmail_msg" target="_blank">http://www.freeswitch.org</a></span></p>
</blockquote>
</div><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg"><br class="gmail_msg">
<br clear="all" class="gmail_msg">
</span></p>
<div class="gmail_msg"><div class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div>
</div><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">-- </span></p>
<div class="gmail_msg">
<div class="gmail_msg">
<div class="gmail_msg">
<div class="gmail_msg">
<div class="gmail_msg">
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">Anthony Minessale II </span><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif" class="gmail_msg">♬</span></span><span lang="EN-US" class="gmail_msg"> @anthmfs </span><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif" class="gmail_msg">♬</span></span><span lang="EN-US" class="gmail_msg">
@FreeSWITCH </span><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif" class="gmail_msg">♬</span></span><span lang="EN-US" class="gmail_msg"></span></p>
<div class="gmail_msg"><div class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div>
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif" class="gmail_msg">☞</span></span><span lang="EN-US" class="gmail_msg">
<a href="http://freeswitch.org/" class="gmail_msg" target="_blank">http://freeswitch.org/</a> </span><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif" class="gmail_msg">☞</span></span><span lang="EN-US" class="gmail_msg">
<a href="http://cluecon.com/" class="gmail_msg" target="_blank">http://cluecon.com/</a> </span><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif" class="gmail_msg">☞</span></span><span lang="EN-US" class="gmail_msg">
<a href="http://twitter.com/FreeSWITCH" class="gmail_msg" target="_blank">http://twitter.com/FreeSWITCH</a></span></p>
</div>
<div class="gmail_msg">
<div class="gmail_msg"><p class="MsoNormal gmail_msg" style="margin-bottom:12.0pt"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif" class="gmail_msg">☞</span></span><span lang="EN-US" class="gmail_msg">
<a href="http://irc.freenode.net/" class="gmail_msg" target="_blank">irc.freenode.net</a> #freeswitch </span><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif" class="gmail_msg">☞</span></span><span lang="EN-US" class="gmail_msg">
<u class="gmail_msg"><a href="http://freeswitch.org/g+" class="gmail_msg" target="_blank">http://freeswitch.org/g+</a></u></span></p>
</div>
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">ClueCon Weekly Development Call </span></p>
</div>
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif" class="gmail_msg">☎</span></span><span lang="EN-US" class="gmail_msg"> <a href="mailto:sip%3A888@conference.freeswitch.org" class="gmail_msg" target="_blank">sip:888@conference.freeswitch.org</a> </span><span class="gmail_msg m_8143532683370750560gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif" class="gmail_msg">☎</span></span><span lang="EN-US" class="gmail_msg">
+19193869900 </span></p>
</div>
<div class="gmail_msg"><div class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div>
</div>
</div>
</div>
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg"><a href="https://www.youtube.com/watch?v=9XXgW34t40s" class="gmail_msg" target="_blank"><span class="gmail_msg m_8143532683370750560gmailmsg"><span style="font-size:9.5pt;color:#1155cc" class="gmail_msg">https://www.youtube.com/watch?v=9XXgW34t40s</span></span></a></span></p>
</div>
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg"><a href="https://www.youtube.com/watch?v=NLaDpGQuZDA" class="gmail_msg" target="_blank">https://www.youtube.com/watch?v=NLaDpGQuZDA</a></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">_________________________________________________________________________<br class="gmail_msg">
Professional FreeSWITCH Consulting Services:<br class="gmail_msg">
<a href="mailto:consulting@freeswitch.org" class="gmail_msg" target="_blank">consulting@freeswitch.org</a><br class="gmail_msg">
<a href="http://www.freeswitchsolutions.com/" class="gmail_msg" target="_blank">http://www.freeswitchsolutions.com</a><br class="gmail_msg">
<br class="gmail_msg">
Official FreeSWITCH Sites<br class="gmail_msg">
<a href="http://www.freeswitch.org/" class="gmail_msg" target="_blank">http://www.freeswitch.org</a><br class="gmail_msg">
<a href="http://confluence.freeswitch.org/" class="gmail_msg" target="_blank">http://confluence.freeswitch.org</a><br class="gmail_msg">
<a href="http://www.cluecon.com/" class="gmail_msg" target="_blank">http://www.cluecon.com</a><br class="gmail_msg">
<br class="gmail_msg">
FreeSWITCH-users mailing list<br class="gmail_msg">
<a href="mailto:FreeSWITCH-users@lists.freeswitch.org" class="gmail_msg" target="_blank">FreeSWITCH-users@lists.freeswitch.org</a><br class="gmail_msg">
<a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" class="gmail_msg" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br class="gmail_msg">
UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" class="gmail_msg" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br class="gmail_msg">
<a href="http://www.freeswitch.org/" class="gmail_msg" target="_blank">http://www.freeswitch.org</a></span></p>
</blockquote>
</div>
</div>
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">-- </span></p>
</div>
<div class="gmail_msg">
<div class="gmail_msg">
<div class="gmail_msg">
<div class="gmail_msg">
<div class="gmail_msg">
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">Anthony Minessale II </span><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif" class="gmail_msg">♬</span><span lang="EN-US" class="gmail_msg"> @anthmfs </span><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif" class="gmail_msg">♬</span><span lang="EN-US" class="gmail_msg">
@FreeSWITCH </span><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif" class="gmail_msg">♬</span><span lang="EN-US" class="gmail_msg"></span></p>
<div class="gmail_msg"><div class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div>
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif" class="gmail_msg">☞</span><span lang="EN-US" class="gmail_msg">
<a href="http://freeswitch.org/" class="gmail_msg" target="_blank">http://freeswitch.org/</a> </span><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif" class="gmail_msg">☞</span><span lang="EN-US" class="gmail_msg">
<a href="http://cluecon.com/" class="gmail_msg" target="_blank">http://cluecon.com/</a> </span><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif" class="gmail_msg">☞</span><span lang="EN-US" class="gmail_msg">
<a href="http://twitter.com/FreeSWITCH" class="gmail_msg" target="_blank">http://twitter.com/FreeSWITCH</a></span></p>
</div>
<div class="gmail_msg">
<div class="gmail_msg"><p class="MsoNormal gmail_msg" style="margin-bottom:12.0pt"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif" class="gmail_msg">☞</span><span lang="EN-US" class="gmail_msg">
<a href="http://irc.freenode.net/" class="gmail_msg" target="_blank">irc.freenode.net</a> #freeswitch </span><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif" class="gmail_msg">☞</span><span lang="EN-US" class="gmail_msg">
<u class="gmail_msg"><a href="http://freeswitch.org/g+" class="gmail_msg" target="_blank">http://freeswitch.org/g+</a></u></span></p>
</div>
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">ClueCon Weekly Development Call </span></p>
</div>
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif" class="gmail_msg">☎</span><span lang="EN-US" class="gmail_msg"> <a href="mailto:sip%3A888@conference.freeswitch.org" class="gmail_msg" target="_blank">sip:888@conference.freeswitch.org</a> </span><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif" class="gmail_msg">☎</span><span lang="EN-US" class="gmail_msg">
+19193869900 </span></p>
</div>
<div class="gmail_msg"><div class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div>
</div>
</div>
</div>
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg"><a href="https://www.youtube.com/watch?v=9XXgW34t40s" class="gmail_msg" target="_blank"><span style="font-size:9.5pt;color:#1155cc" class="gmail_msg">https://www.youtube.com/watch?v=9XXgW34t40s</span></a></span></p>
</div>
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg"><a href="https://www.youtube.com/watch?v=NLaDpGQuZDA" class="gmail_msg" target="_blank">https://www.youtube.com/watch?v=NLaDpGQuZDA</a></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg"><br class="gmail_msg">
______________________________________________________________________<br class="gmail_msg">
This message has been checked for all known viruses by MessageLabs Virus Scanning Service.<br class="gmail_msg">
______________________________________________________________________</span></p>
</div>
<table class="gmail_msg m_8143532683370750560MsoNormalTable" border="0" cellpadding="0">
<tbody class="gmail_msg">
<tr class="gmail_msg">
<td style="padding:.75pt .75pt .75pt .75pt" class="gmail_msg"><p class="MsoNormal gmail_msg"><img border="0" id="m_8143532683370750560_x0000_i1026" src="http://www.itec-support.co.uk/wp-content/uploads/2016/07/email_logo.jpg" class="gmail_msg"></p>
</td>
<td valign="top" style="padding:.75pt .75pt .75pt .75pt" class="gmail_msg">
<div class="gmail_msg"><p class="MsoNormal gmail_msg">Shaun Stokes - Infrastructure Analyst</p>
</div>
<div class="gmail_msg">
<table class="gmail_msg m_8143532683370750560MsoNormalTable" border="0" cellpadding="0">
<tbody class="gmail_msg">
<tr class="gmail_msg">
<td style="padding:.75pt .75pt .75pt .75pt" class="gmail_msg"></td>
<td style="padding:.75pt .75pt .75pt .75pt" class="gmail_msg"></td>
</tr>
<tr class="gmail_msg">
<td style="padding:.75pt .75pt .75pt .75pt" class="gmail_msg"><p class="MsoNormal gmail_msg">T : </p>
</td>
<td style="padding:.75pt .75pt .75pt .75pt" class="gmail_msg"><p class="MsoNormal gmail_msg">01453 700713</p>
</td>
</tr>
<tr class="gmail_msg">
<td style="padding:.75pt .75pt .75pt .75pt" class="gmail_msg"><p class="MsoNormal gmail_msg">E : </p>
</td>
<td style="padding:.75pt .75pt .75pt .75pt" class="gmail_msg"><p class="MsoNormal gmail_msg"><a href="mailto:shaun.stokes@itec-support.co.uk" class="gmail_msg" target="_blank">shaun.stokes@itec-support.co.uk</a></p>
</td>
</tr>
<tr class="gmail_msg">
<td style="padding:.75pt .75pt .75pt .75pt" class="gmail_msg"><p class="MsoNormal gmail_msg">W : </p>
</td>
<td style="padding:.75pt .75pt .75pt .75pt" class="gmail_msg"><p class="MsoNormal gmail_msg"><a href="http://www.itec-support.co.uk/" class="gmail_msg" target="_blank">www.itec-support.co.uk</a></p>
</td>
</tr>
</tbody>
</table>
</div>
</td>
</tr>
</tbody>
</table>
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg">Registered Address :- ITEC Support, Suite 2 Prospect House, Bath Road, Stroud, Gloucestershire GL5 3QF
<br class="gmail_msg">
Company No. 06908001 </span></p>
</div>
<div class="gmail_msg"><p class="MsoNormal gmail_msg"><span lang="EN-US" class="gmail_msg"><br class="gmail_msg">
CONFIDENTIALITY NOTICE <br class="gmail_msg">
This communication and the information it contains are intended for the person or organisation to which it is addressed. Its contents are confidential and may be protected in law. Unauthorised use, copying or disclosure of any of it may be unlawful. If you
are not the intended recipient, please contact us immediately. <br class="gmail_msg">
The contents of any attachments in this e-mail may contain software viruses, which could damage your own computer system. While ITEC Support has taken every reasonable precaution to minimise this risk, we cannot accept liability for any damage which you sustain
as a result of software viruses. You should carry out your own virus checking procedure before opening any attachment.
</span></p>
</div><p class="MsoNormal gmail_msg" style="margin-bottom:12.0pt"><span lang="EN-US" class="gmail_msg"><br clear="all" class="gmail_msg">
______________________________________________________________________<br class="gmail_msg">
This message has been checked for all known viruses by MessageLabs Virus Scanning Service.<br class="gmail_msg">
______________________________________________________________________<br class="gmail_msg">
<br class="gmail_msg">
<br class="gmail_msg">
</span></p>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">_________________________________________________________________________</span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">Professional FreeSWITCH Consulting Services: </span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"><a href="mailto:consulting@freeswitch.org" class="gmail_msg" target="_blank">consulting@freeswitch.org</a></span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"><a href="http://www.freeswitchsolutions.com/" class="gmail_msg" target="_blank">http://www.freeswitchsolutions.com</a></span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"> </span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">Official FreeSWITCH Sites</span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"><a href="http://www.freeswitch.org/" class="gmail_msg" target="_blank">http://www.freeswitch.org</a></span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"><a href="http://confluence.freeswitch.org/" class="gmail_msg" target="_blank">http://confluence.freeswitch.org</a></span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"><a href="http://www.cluecon.com/" class="gmail_msg" target="_blank">http://www.cluecon.com</a></span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"> </span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">FreeSWITCH-users mailing list</span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"><a href="mailto:FreeSWITCH-users@lists.freeswitch.org" class="gmail_msg" target="_blank">FreeSWITCH-users@lists.freeswitch.org</a></span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"><a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" class="gmail_msg" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a></span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" class="gmail_msg" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a></span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"><a href="http://www.freeswitch.org/" class="gmail_msg" target="_blank">http://www.freeswitch.org</a></span></pre>
</blockquote><div style="margin-bottom: 12pt;" class=""><span lang="EN-US" class="gmail_msg"> </span><br class="webkit-block-placeholder"></div>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">-- </span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg"> </span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">Saludos / Regards / Cumprimentos,</span></pre>
<pre class="gmail_msg"><span lang="EN-US" class="gmail_msg">António silva</span></pre><p class="MsoNormal gmail_msg"><span lang="EN-US" style="color:windowtext" class="gmail_msg"><br class="gmail_msg">
______________________________________________________________________<br class="gmail_msg">
This message has been checked for all known viruses by MessageLabs Virus Scanning Service.<br class="gmail_msg">
______________________________________________________________________</span></p>
</div></div><div bgcolor="white" lang="EN-GB" link="blue" vlink="purple" class="gmail_msg">
<table class="gmail_msg">
<tbody class="gmail_msg">
<tr class="gmail_msg">
<td class="gmail_msg"><img src="http://www.itec-support.co.uk/wp-content/uploads/2016/07/email_logo.jpg" class="gmail_msg"></td>
<td valign="top" class="gmail_msg">
<div class="gmail_msg"><a style="font-family:calibri;color:#1b3e94;font-size:11pt" class="gmail_msg">Shaun Stokes - Infrastructure Analyst</a></div>
<div class="gmail_msg">
<table class="gmail_msg">
<tbody class="gmail_msg">
<tr class="gmail_msg">
<td class="gmail_msg"></td>
<td class="gmail_msg"></td>
</tr>
<tr class="gmail_msg">
<td class="gmail_msg"><a style="font-family:calibri;color:#1b3e94;font-size:11pt" class="gmail_msg">T : </a></td>
<td class="gmail_msg"><a style="font-family:calibri;color:#1b3e94;font-size:11pt" class="gmail_msg">01453 700713</a></td>
</tr>
<tr class="gmail_msg">
<td class="gmail_msg"><a style="font-family:calibri;color:#1b3e94;font-size:11pt" class="gmail_msg">E : </a></td>
<td class="gmail_msg"><a style="font-family:calibri;color:#1b3e94;font-size:11pt" class="gmail_msg">shaun.stokes@itec-support.co.uk</a></td>
</tr>
<tr class="gmail_msg">
<td class="gmail_msg"><a style="font-family:calibri;color:#1b3e94;font-size:11pt" class="gmail_msg">W : </a></td>
<td class="gmail_msg"><a style="font-family:calibri;color:#1b3e94;font-size:11pt" class="gmail_msg">www.itec-support.co.uk</a></td>
</tr>
</tbody>
</table>
</div>
</td>
</tr>
</tbody>
</table>
<div class="gmail_msg"><a style="font-family:calibri;color:#1b3e94;font-size:11pt" class="gmail_msg">Registered Address :- ITEC Support, Suite 2 Prospect House, Bath Road, Stroud, Gloucestershire GL5 3QF</a>
<br class="gmail_msg">
<a style="font-family:calibri;color:#1b3e94;font-size:11pt" class="gmail_msg">Company No. 06908001</a>
</div>
<div class="gmail_msg"><br class="gmail_msg">
<a style="font-family:calibri;color:Grey;font-size:11pt" class="gmail_msg">CONFIDENTIALITY NOTICE</a>
<br class="gmail_msg">
<a style="font-family:calibri;color:Grey;font-size:11pt" class="gmail_msg">This communication and the information it contains are intended for the person or organisation to which it is addressed. Its contents are confidential and may be protected in law. Unauthorised use,
copying or disclosure of any of it may be unlawful. If you are not the intended recipient, please contact us immediately.</a>
<br class="gmail_msg">
<a style="font-family:calibri;color:Grey;font-size:11pt" class="gmail_msg">The contents of any attachments in this e-mail may contain software viruses, which could damage your own computer system. While ITEC Support has taken every reasonable precaution to minimise this risk,
we cannot accept liability for any damage which you sustain as a result of software viruses. You should carry out your own virus checking procedure before opening any attachment.</a>
</div>
<br clear="both" class="gmail_msg">
______________________________________________________________________<br class="gmail_msg">
This message has been checked for all known viruses by MessageLabs Virus Scanning Service.<br class="gmail_msg">
______________________________________________________________________<br class="gmail_msg">
</div>
_________________________________________________________________________<br class="gmail_msg">
Professional FreeSWITCH Consulting Services:<br class="gmail_msg">
<a href="mailto:consulting@freeswitch.org" class="gmail_msg" target="_blank">consulting@freeswitch.org</a><br class="gmail_msg">
<a href="http://www.freeswitchsolutions.com/" rel="noreferrer" class="gmail_msg" target="_blank">http://www.freeswitchsolutions.com</a><br class="gmail_msg">
<br class="gmail_msg">
Official FreeSWITCH Sites<br class="gmail_msg">
<a href="http://www.freeswitch.org/" rel="noreferrer" class="gmail_msg" target="_blank">http://www.freeswitch.org</a><br class="gmail_msg">
<a href="http://confluence.freeswitch.org/" rel="noreferrer" class="gmail_msg" target="_blank">http://confluence.freeswitch.org</a><br class="gmail_msg">
<a href="http://www.cluecon.com/" rel="noreferrer" class="gmail_msg" target="_blank">http://www.cluecon.com</a><br class="gmail_msg">
<br class="gmail_msg">
FreeSWITCH-users mailing list<br class="gmail_msg">
<a href="mailto:FreeSWITCH-users@lists.freeswitch.org" class="gmail_msg" target="_blank">FreeSWITCH-users@lists.freeswitch.org</a><br class="gmail_msg">
<a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" rel="noreferrer" class="gmail_msg" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br class="gmail_msg">
UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" rel="noreferrer" class="gmail_msg" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br class="gmail_msg">
<a href="http://www.freeswitch.org/" rel="noreferrer" class="gmail_msg" target="_blank">http://www.freeswitch.org</a></blockquote></div></div><div dir="ltr" class="">-- <br class=""></div><div data-smartmail="gmail_signature" class=""><div dir="ltr" class=""><div class=""><div dir="ltr" class=""><div class=""><div dir="ltr" class="">Anthony Minessale II ♬ @anthmfs ♬ @FreeSWITCH ♬<div class=""><br class=""><div class="">☞ <a href="http://freeswitch.org/" target="_blank" class="">http://freeswitch.org/</a> ☞ <a href="http://cluecon.com/" target="_blank" class="">http://cluecon.com/</a> ☞ <a href="http://twitter.com/FreeSWITCH" target="_blank" class="">http://twitter.com/FreeSWITCH</a></div><div class=""><div class="">☞ <a href="http://irc.freenode.net/" target="_blank" class="">irc.freenode.net</a> #freeswitch ☞ <u class=""><a href="http://freeswitch.org/g+" target="_blank" class="">http://freeswitch.org/g+</a></u><br class=""><br class=""></div><div class="">ClueCon Weekly Development Call <br class=""></div><div class="">☎ <a href="mailto:sip%3A888@conference.freeswitch.org" target="_blank" class="">sip:888@conference.freeswitch.org</a> ☎ +19193869900 </div><div class=""><br class=""></div></div></div><div class=""><a href="https://www.youtube.com/watch?v=9XXgW34t40s" style="color:rgb(17,85,204);font-size:12.8000001907349px" target="_blank" class="">https://www.youtube.com/watch?v=9XXgW34t40s</a></div><div class=""><a href="https://www.youtube.com/watch?v=NLaDpGQuZDA" target="_blank" class="">https://www.youtube.com/watch?v=NLaDpGQuZDA</a><br class=""></div></div></div></div></div></div></div>
_________________________________________________________________________<br class="">Professional FreeSWITCH Consulting Services: <br class=""><a href="mailto:consulting@freeswitch.org" class="">consulting@freeswitch.org</a><br class="">http://www.freeswitchsolutions.com<br class=""><br class="">Official FreeSWITCH Sites<br class="">http://www.freeswitch.org<br class="">http://confluence.freeswitch.org<br class="">http://www.cluecon.com<br class=""><br class="">FreeSWITCH-users mailing list<br class="">FreeSWITCH-users@lists.freeswitch.org<br class="">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users<br class="">UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users<br class="">http://www.freeswitch.org</div></blockquote></div><br class=""></div></body></html>