<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style>
<!--
@font-face
{font-family:Helvetica}
@font-face
{font-family:Wingdings}
@font-face
{font-family:"Cambria Math"}
@font-face
{font-family:Calibri}
@font-face
{font-family:Consolas}
@font-face
{font-family:"Segoe UI Symbol"}
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif}
a:link, span.MsoHyperlink
{color:blue;
text-decoration:underline}
a:visited, span.MsoHyperlinkFollowed
{color:purple;
text-decoration:underline}
pre
{margin:0cm;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New"}
span.HTMLPreformattedChar
{font-family:Consolas}
p.msonormal0, li.msonormal0, div.msonormal0
{margin-right:0cm;
margin-left:0cm;
font-size:12.0pt;
font-family:"Times New Roman",serif}
span.apple-style-span
{}
span.apple-converted-space
{}
span.gmailmsg
{}
span.EmailStyle23
{font-family:"Calibri",sans-serif;
color:windowtext}
span.EmailStyle24
{font-family:"Calibri",sans-serif;
color:#1F497D}
.MsoChpDefault
{font-size:10.0pt}
@page WordSection1
{margin:70.85pt 70.85pt 70.85pt 70.85pt}
div.WordSection1
{}
ol
{margin-bottom:0cm}
ul
{margin-bottom:0cm}
-->
</style>
</head>
<body lang="EN-GB" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D">It sounds like you may have narrowed it down to a DB query, if you aren’t already then I’d suggest logging the output of your query and the results. You can
use something similar to the this to see at which point it fails (or loops):</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D">freeswitch.consoleLog("DEBUG", "text here "..variable_here.." \n");</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> </span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D">I’d also suggest checking your SQL logs if you haven’t already to check there isn’t anything out of the ordinary when the problem occurs.</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> </span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D">If you replace the DB query(s) with static variables for testing purposes does this resolve your issue?</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> </span></p>
<div>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">From:</span></b><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> freeswitch-users-bounces@lists.freeswitch.org [mailto:freeswitch-users-bounces@lists.freeswitch.org]
<b>On Behalf Of </b>Grant Bagdasarian<br>
<b>Sent:</b> 03 April 2017 14:38<br>
<b>To:</b> FreeSWITCH Users Help <freeswitch-users@lists.freeswitch.org><br>
<b>Subject:</b> Re: [Freeswitch-users] 100% CPU usage</span></p>
</div>
</div>
<p class="MsoNormal"> </p>
<p class="MsoNormal"><span lang="NL" style="font-size:11.0pt; font-family:"Calibri",sans-serif">Just a small update.</span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">We did some testing today, and it looks like calls to the database are causing the call inside freeswitch to hang.
</span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">We traced it back to the call to dbh:query where the call just hangs. It doesn’t even have to be high load. Generating only a total of 10 calls with 10 CPS causes
1 or 2 channels to hang. </span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">What is interesting is when I do a uuid_kill freeswitch cli reports it has been killed, but the show channels command still shows the channel there. Another uuid_kill
returns “Error no such channel”. The channel id still shows up in the uuid_kill list.
</span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">When we kill the sql session in mysql itself, that’s when freeswitch starts to go berserk and the CPU spikes to 100%. You can either kill it manually or wait
for the mysql server timeout. Either way, 100% cpu usage. </span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">We put the session:ready() check everywhere possible, without success. We also rewrote some parts of the db access, connecting and releasing in the connection
pool, but with no luck. </span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>
<div>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">From:</span></b><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">
<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org">freeswitch-users-bounces@lists.freeswitch.org</a> [<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org">mailto:freeswitch-users-bounces@lists.freeswitch.org</a>]
<b>On Behalf Of </b>Cj B<br>
<b>Sent:</b> vrijdag 31 maart 2017 17:04<br>
<b>To:</b> FreeSWITCH Users Help <<a href="mailto:freeswitch-users@lists.freeswitch.org">freeswitch-users@lists.freeswitch.org</a>><br>
<b>Subject:</b> Re: [Freeswitch-users] 100% CPU usage</span></p>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
<p class="MsoNormal"><span lang="EN-US">Hi All,</span></p>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Thanks for you detailed replies and suggestions… I spent yesterday setting up a test box and doing some testing. </span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Just for information, my production boxes are Intel(R) Xeon(R) CPU E5430 @ 2.66GHz and Intel(R) Xeon(R) CPU L5520 @ 2.27GHz with 16gb RAM on raw hardware, 15ksas drives, local storage and core.db is in memory. My expiry
is set to 360seconds and I do have manage-presence. I do not appear to have sip-force-expires set that I see anywhere. </span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Here’s some interesting things I found.</span></p>
</div>
<div>
<ul type="disc">
<li class="MsoNormal" style=""><span lang="EN-US">Test box was a digitalocean $5 droplet, 1 CPU, 512RAM. Configured it exactly as my production boxes, FS 1.6.15, all the same scripts, same number of Destinations, same number of domains, etc. I registered 10
phones to it and had 6 active calls, including 1 video call with no problems at all with expected CPU usage for such a low power box (around 50% CPU)</span></li><li class="MsoNormal" style=""><span lang="EN-US">With this information I then started looking at other things on my production boxes. I did a service freeswitch restart and when freeswitch came back up it was complaining that 5060 and 8021 were still in use.
I did a netstat -npl | grep 8021 and noticed there was an “sh” process still active on both those ports. I killed the process and FS came back up. However I noticed that my RAM usage hadn’t decreased at all. I would expect that upon restating FS, it would
free up RAM, am I mistaken here? Perhaps whatever that Sh process was is a cleanup?</span></li><li class="MsoNormal" style=""><span lang="EN-US">I then rebooted one of my servers and memory dropped and noticed that CPU usage had also dropped to about 1-2% when idle. So I rebooted the other servers as well and CPU usage dropped.</span></li></ul>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">It’s now been about 13 hours and I see CPU starting to climb again and my RAM is 100% used again.</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">I will continue to monitor today and send any updates. Thanks again for everyone’s suggestions!</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">Cj B</span></p>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
<div>
<blockquote style="margin-top:5.0pt; margin-bottom:5.0pt">
<div>
<p class="MsoNormal"><span lang="EN-US">On Mar 31, 2017, at 12:34 AM, Shaun Stokes <<a href="mailto:shaun.stokes@itec-support.co.uk">shaun.stokes@itec-support.co.uk</a>> wrote:</span></p>
</div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
<div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D">Also, a few questions that might help us solve this.</span><span lang="EN-US"></span></p>
</div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> </span><span lang="EN-US"></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D">What is the registration expiry on the devices (i.e. how frequently are they trying to re-register)? If you have 60 devices which are re-registering
every 30 seconds (120 registrations per minute) this would be comparable to over 2000 devices re-registering every 20 minutes.</span><span lang="EN-US"></span></p>
</div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> </span><span lang="EN-US"></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D">What are you SIP profile forced registry expiry settings (sip-force-expires, sip-expires-max-deviation)?</span><span lang="EN-US"></span></p>
</div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> </span><span lang="EN-US"></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D">Are you using presence (manage-presence)?</span><span lang="EN-US"></span></p>
</div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> </span><span lang="EN-US"></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> </span><span lang="EN-US"></span></p>
<div>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0cm 0cm 0cm">
<div>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">From:</span></b><span class="apple-converted-space"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"><a href="mailto:freeswitch-users-bounces@lists.freeswitch.org"><span style="color:purple">freeswitch-users-bounces@lists.freeswitch.org</span></a><span class="apple-converted-space"> </span>[<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org"><span style="color:purple">mailto:freeswitch-users-bounces@lists.freeswitch.org</span></a>]<span class="apple-converted-space"> </span><b>On
Behalf Of<span class="apple-converted-space"> </span></b>Shaun Stokes<br>
<b>Sent:</b><span class="apple-converted-space"> </span>31 March 2017 08:17<br>
<b>To:</b><span class="apple-converted-space"> </span>'FreeSWITCH Users Help' <<a href="mailto:freeswitch-users@lists.freeswitch.org"><span style="color:purple">freeswitch-users@lists.freeswitch.org</span></a>><br>
<b>Subject:</b><span class="apple-converted-space"> </span>Re: [Freeswitch-users] 100% CPU usage</span><span lang="EN-US"></span></p>
</div>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D">Cj B,</span><span lang="EN-US"></span></p>
</div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> </span><span lang="EN-US"></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D">What hyper-visor are you using? Also, what spec (AMD or Intel host, number of cores, RAM, 15k SAS or SSD storage, local or network storage etc)?</span><span lang="EN-US"></span></p>
</div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> </span><span lang="EN-US"></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D">This sounds very similar to problems we had on virtual hardware but we were closer to 400 registrations before we ran into problems, on physical
hardware of the same spec we managed to get up to 800 registered extensions before we ran into limitations on the SIP profile (different symptoms). We’re now running roughly 1200 registered extensions across 2 SIP profiles on the same physical hardware average
CPU under load roughly 25%.</span><span lang="EN-US"></span></p>
</div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> </span><span lang="EN-US"></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D">Shaun</span><span lang="EN-US"></span></p>
</div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> </span><span lang="EN-US"></span></p>
<div>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0cm 0cm 0cm">
<div>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">From:</span></b><span class="apple-converted-space"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"><a href="mailto:freeswitch-users-bounces@lists.freeswitch.org"><span style="color:purple">freeswitch-users-bounces@lists.freeswitch.org</span></a><span class="apple-converted-space"> </span>[<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org"><span style="color:purple">mailto:freeswitch-users-bounces@lists.freeswitch.org</span></a>]<span class="apple-converted-space"> </span><b>On
Behalf Of<span class="apple-converted-space"> </span></b>Cj B<br>
<b>Sent:</b><span class="apple-converted-space"> </span>29 March 2017 18:21<br>
<b>To:</b><span class="apple-converted-space"> </span>FreeSWITCH Users Help <<a href="mailto:freeswitch-users@lists.freeswitch.org"><span style="color:purple">freeswitch-users@lists.freeswitch.org</span></a>><br>
<b>Subject:</b><span class="apple-converted-space"> </span>Re: [Freeswitch-users] 100% CPU usage</span><span lang="EN-US"></span></p>
</div>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
<div>
<p class="MsoNormal"><span lang="EN-US">Hi All,</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">I’m having a very similar issue however it’s not staying at 100% CPU on physical hardware. I’ve created a JIRA but wanted to see if anyone else had any feedback on possible causes? I’m using freeswitch 1.6.15 (previously
1.6.13). What happens is that FS will jump to 100% CPU and stay there for 1-2 seconds then drop back down but this is then causing massive jitter/call quality issues for about 10-15 seconds after the spike. The strange thing that I’ve noticed is that even
with 0 active calls, FS is using 15-30% cpu constantly with only 40-60 registered endpoints.</span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">I’m watching the logs in DEBUG mode and not seeing anything there that’s indicative of any issue, no loops that I can see, and it seems to be happening when there’s even just 1 or 2 active calls on the system. </span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">I’m wondering if there’s any other suggestions on where to look because this is getting very frustrating for me and my users.</span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">Thanks much for any pointers!</span></p>
</div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Helvetica",sans-serif">Cj B</span><span lang="EN-US"></span></p>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
<div>
<blockquote style="margin-top:5.0pt; margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">On Mar 22, 2017, at 8:13 AM, Anthony Minessale <<a href="mailto:anthony.minessale@gmail.com"><span style="color:purple">anthony.minessale@gmail.com</span></a>> wrote:</span></p>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
<div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">top -H -p `pidof freeswitch` </span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">Note the pid using 100% cpu</span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">gcore `pidof freeswitch`</span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">Attach it to a jira. If you think its a bug in FS you should report it to Jira not to this list.</span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US"><a href="https://freeswitch.org/jira"><span style="color:purple">https://freeswitch.org/jira</span></a></span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
<div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">On Wed, Mar 22, 2017 at 10:14 AM Shaun Stokes <<a href="mailto:shaun.stokes@itec-support.co.uk"><span style="color:purple">shaun.stokes@itec-support.co.uk</span></a>> wrote:</span></p>
</div>
</div>
<blockquote style="border:none; border-left:solid #CCCCCC 1.0pt; padding:0cm 0cm 0cm 6.0pt; margin-left:4.8pt; margin-top:5.0pt; margin-right:0cm; margin-bottom:5.0pt">
<div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D">It’s probably a long shot, but if you’re able to replicate the problem it might be worth trying to replicate this on physical
hardware. That way you eliminate your virtual environment from the problem, there are a number of factors which exist in virtual environments depending on your hyper-visor which can contribute to performance issues of which we’ve experienced in the past.</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D">It would also be worth trying to isolate what the script is doing when the high CPU begins, if you’ve got a test environment
you can use to replicate the issue then you could try tweaking the script so you can eliminate certain actions from the list of causes, there’s maybe a FreeSWITCH module which is being called which triggers this.</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0cm 0cm 0cm">
<div>
<p class="MsoNormal"><span class="gmailmsg"><b><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">From:</span></b></span><span class="apple-converted-space"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"><a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" target="_blank"><span style="color:purple">freeswitch-users-bounces@lists.freeswitch.org</span></a></span></span><span class="apple-converted-space"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">[mailto:<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" target="_blank"><span style="color:purple">freeswitch-users-bounces@lists.freeswitch.org</span></a>]</span></span><span class="apple-converted-space"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span class="gmailmsg"><b><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">On
Behalf Of</span></b></span><span class="apple-converted-space"><b><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></b></span><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">Grant
Bagdasarian</span></span><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"><br>
<span class="gmailmsg"><b>Sent:</b></span><span class="apple-converted-space"> </span><span class="gmailmsg">22 March 2017 11:20</span></span><span lang="EN-US"></span></p>
</div>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0cm 0cm 0cm">
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"><br>
<span class="gmailmsg"><b>To:</b></span><span class="apple-converted-space"> </span><span class="gmailmsg">FreeSWITCH Users Help <<a href="mailto:freeswitch-users@lists.freeswitch.org" target="_blank"><span style="color:purple">freeswitch-users@lists.freeswitch.org</span></a>></span><br>
<span class="gmailmsg"><b>Subject:</b></span><span class="apple-converted-space"> </span><span class="gmailmsg">Re: [Freeswitch-users] 100% CPU usage</span></span><span lang="EN-US"></span></p>
</div>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">@Shuan, yes we are using the session:ready() method before we execute.</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">We are running all of our servers virtually and never had any issues up until now.</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">This same application ran on older versions of freeswitch without issues, even during and after high load.</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">@Antonio, thanks for the tips! I’ll have a look and try some stuff.</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0cm 0cm 0cm">
<div>
<p class="MsoNormal"><span class="gmailmsg"><b><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">From:</span></b></span><span class="apple-converted-space"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"><a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" target="_blank"><span style="color:purple">freeswitch-users-bounces@lists.freeswitch.org</span></a></span></span><span class="apple-converted-space"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">[<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" target="_blank"><span style="color:purple">mailto:freeswitch-users-bounces@lists.freeswitch.org</span></a>]</span></span><span class="apple-converted-space"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span class="gmailmsg"><b><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">On
Behalf Of</span></b></span><span class="apple-converted-space"><b><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></b></span><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">Antonio
Silva</span></span><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"><br>
<span class="gmailmsg"><b>Sent:</b></span><span class="apple-converted-space"> </span><span class="gmailmsg">woensdag 22 maart 2017 10:09</span><br>
<span class="gmailmsg"><b>To:</b></span><span class="apple-converted-space"> </span><span class="gmailmsg"><a href="mailto:freeswitch-users@lists.freeswitch.org" target="_blank"><span style="color:purple">freeswitch-users@lists.freeswitch.org</span></a></span><br>
<span class="gmailmsg"><b>Subject:</b></span><span class="apple-converted-space"> </span><span class="gmailmsg">Re: [Freeswitch-users] 100% CPU usage</span></span><span lang="EN-US"></span></p>
</div>
</div>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span class="gmailmsg"><span lang="EN-US">We had some issues using pcall functions like io.popen when trying to execute external commands, that block mod_lua, i end up replacing that with os.execute.</span></span><span lang="EN-US"><br>
<br>
<span class="gmailmsg">Recently i also had some issue with cpu hitting 100%,for what i could compile from debugging was something related with malloc calls. after compiling fs with tcmalloc the issue disappear, you could try this approach as well.</span><br>
<br>
<span class="gmailmsg">You can check jira:</span><span class="apple-converted-space"> </span><span class="gmailmsg"><a href="https://freeswitch.org/jira/browse/FS-9957" target="_blank"><span style="color:purple">https://freeswitch.org/jira/browse/FS-9957</span></a></span><span class="apple-converted-space"> </span><span class="gmailmsg">and
also in the malling: "CPU sys load issue" for more info.</span><br>
<br>
<br>
<span class="gmailmsg">Regards,</span><br>
<span class="gmailmsg">António</span></span></p>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">On 03/22/2017 09:52 AM, Shaun Stokes wrote:</span></span><span lang="EN-US"></span></p>
</div>
</div>
<blockquote style="margin-top:5.0pt; margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D">Are you using ‘if (session:ready()) then’ in your scripts before you execute?</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D">Are you using virtual or physical hardware and what spec?</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0cm 0cm 0cm">
<div>
<p class="MsoNormal"><span class="gmailmsg"><b><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">From:</span></b></span><span class="apple-converted-space"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"><a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" target="_blank"><span style="color:purple">freeswitch-users-bounces@lists.freeswitch.org</span></a></span></span><span class="apple-converted-space"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">[<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" target="_blank"><span style="color:purple">mailto:freeswitch-users-bounces@lists.freeswitch.org</span></a>]<b>On
Behalf Of</b></span></span><span class="apple-converted-space"><b><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></b></span><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">Grant
Bagdasarian</span></span><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"><br>
<span class="gmailmsg"><b>Sent:</b></span><span class="apple-converted-space"> </span><span class="gmailmsg">22 March 2017 07:31</span><br>
<span class="gmailmsg"><b>To:</b></span><span class="apple-converted-space"> </span><span class="gmailmsg">FreeSWITCH Users Help</span><span class="apple-converted-space"> </span><span class="gmailmsg"><a href="mailto:freeswitch-users@lists.freeswitch.org" target="_blank"><span style="color:purple"><freeswitch-users@lists.freeswitch.org></span></a></span><br>
<span class="gmailmsg"><b>Subject:</b></span><span class="apple-converted-space"> </span><span class="gmailmsg">Re: [Freeswitch-users] 100% CPU usage</span></span><span lang="EN-US"></span></p>
</div>
</div>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">Anthony, we triple checked the script and its dependencies. There are no loops at all in the script. The imported scripts are also written
by us and they too do not contain any loops.</span></span><span class="apple-converted-space"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">It’s just basic call handling with some playback and play_and_get_digits calls, and some pcall calls to query a database.</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><b><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">From:</span></b></span><span class="apple-converted-space"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"><a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" target="_blank"><span style="color:purple">freeswitch-users-bounces@lists.freeswitch.org</span></a></span></span><span class="apple-converted-space"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">[<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" target="_blank"><span style="color:purple">mailto:freeswitch-users-bounces@lists.freeswitch.org</span></a>]<b>On
Behalf Of</b></span></span><span class="apple-converted-space"><b><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></b></span><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">Anthony
Minessale</span></span><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"><br>
<span class="gmailmsg"><b>Sent:</b></span><span class="apple-converted-space"> </span><span class="gmailmsg">dinsdag 21 maart 2017 16:02</span><br>
<span class="gmailmsg"><b>To:</b></span><span class="apple-converted-space"> </span><span class="gmailmsg">FreeSWITCH Users Help <<a href="mailto:freeswitch-users@lists.freeswitch.org" target="_blank"><span style="color:purple">freeswitch-users@lists.freeswitch.org</span></a>></span><br>
<span class="gmailmsg"><b>Subject:</b></span><span class="apple-converted-space"> </span><span class="gmailmsg">Re: [Freeswitch-users] 100% CPU usage</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">I already told you why a week ago. Your script most likely has an endless loop in it that does not check the condition session:ready() </span></span><span lang="EN-US"></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">However, Feel free to contact</span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US"><a href="mailto:consulting@freeswitch.org" target="_blank"><span style="color:purple">consulting@freeswitch.org</span></a></span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US">and
we can formally diagnose it for a fee.</span></span><span lang="EN-US"></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">On Tue, Mar 21, 2017 at 6:42 AM Grant Bagdasarian <<a href="mailto:gb@cm.nl" target="_blank"><span style="color:purple">gb@cm.nl</span></a>> wrote:</span></span><span lang="EN-US"></span></p>
</div>
</div>
<blockquote style="border:none; border-left:solid #CCCCCC 1.0pt; padding:0cm 0cm 0cm 6.0pt; margin-left:4.8pt; margin-top:5.0pt; margin-right:0cm; margin-bottom:5.0pt">
<div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">Attached are the logs for:</span></span><span lang="EN-US"></span></p>
</div>
</div>
</div>
<div>
<div>
<pre><span class="gmailmsg"><span lang="EN-US">#check thread usage:</span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US">top -p $(cat /var/run/freeswitch/freeswitch.pid) -H -b -n 1</span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US">#memory mapping:</span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US">cat /proc/$(cat /var/run/freeswitch/freeswitch.pid)/maps</span></span><span lang="EN-US"></span></pre>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span lang="EN-US"></span></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">We’re unable to run gcore since freeswitch hogs all available cpu’s at 100%.</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">I tried changing the nice settings real-time but that didn’t work either.</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">At one point we had a huge spike in inbound traffic towards our freeswitch (valid traffic).</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">The traffic is handled by a lua application.</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">What we saw was calls hanging in freeswitch while they’ve already been physically disconnected.</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">After the huge spike freeswitch behaved normally for a couple of minutes and then suddenly started eating all the available cpu cores at
100%.</span></span><span class="apple-converted-space"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">We have some db queries which are fired in the lua application, so these may cause the application to hang, but we haven’t reproduced it
yet.</span></span><span class="apple-converted-space"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">I’ll setup a test lab with the same configuration and fire sipp at it to see if I can reproduce the issue.</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">However, I probably won’t be able to run gcore for debugging. Any other suggestions?</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">Also we saw a lot of open udp ports and some had a huge read buffer size which did not decrease.</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0cm 0cm 0cm">
<div>
<p class="MsoNormal"><span class="gmailmsg"><b><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">From:</span></b></span><span class="apple-converted-space"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"><a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" target="_blank"><span style="color:purple">freeswitch-users-bounces@lists.freeswitch.org</span></a></span></span><span class="apple-converted-space"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">[mailto:<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" target="_blank"><span style="color:purple">freeswitch-users-bounces@lists.freeswitch.org</span></a>]<b>On
Behalf Of</b></span></span><span class="apple-converted-space"><b><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></b></span><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">Grant
Bagdasarian</span></span><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"><br>
<span class="gmailmsg"><b>Sent:</b></span><span class="apple-converted-space"> </span><span class="gmailmsg">maandag 13 maart 2017 09:04</span></span><span lang="EN-US"></span></p>
</div>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0cm 0cm 0cm">
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"><br>
<span class="gmailmsg"><b>To:</b></span><span class="apple-converted-space"> </span><span class="gmailmsg">FreeSWITCH Users Help <<a href="mailto:freeswitch-users@lists.freeswitch.org" target="_blank"><span style="color:purple">freeswitch-users@lists.freeswitch.org</span></a>></span><br>
<span class="gmailmsg"><b>Subject:</b></span><span class="apple-converted-space"> </span><span class="gmailmsg">Re: [Freeswitch-users] 100% CPU usage</span></span><span lang="EN-US"></span></p>
</div>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="NL" style="font-size:11.0pt; font-family:"Calibri",sans-serif">Hi Antony and Antonio,</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="NL" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">Thank you for the tips.</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">We haven’t had freeswitch going berserk anymore (not sure as to why it did perform without issue over the weekend), but will continue to
monitor it and run the commands to trace the issue.</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">Regards,</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">Grant</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><b><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">From:</span></b></span><span class="apple-converted-space"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"><a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" target="_blank"><span style="color:purple">freeswitch-users-bounces@lists.freeswitch.org</span></a></span></span><span class="apple-converted-space"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></span><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">[<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org" target="_blank"><span style="color:purple">mailto:freeswitch-users-bounces@lists.freeswitch.org</span></a>]<b>On
Behalf Of</b></span></span><span class="apple-converted-space"><b><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></b></span><span class="gmailmsg"><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif">Anthony
Minessale</span></span><span lang="EN-US" style="font-size:11.0pt; font-family:"Calibri",sans-serif"><br>
<span class="gmailmsg"><b>Sent:</b></span><span class="apple-converted-space"> </span><span class="gmailmsg">zaterdag 11 maart 2017 00:07</span><br>
<span class="gmailmsg"><b>To:</b></span><span class="apple-converted-space"> </span><span class="gmailmsg">FreeSWITCH Users Help <<a href="mailto:freeswitch-users@lists.freeswitch.org" target="_blank"><span style="color:purple">freeswitch-users@lists.freeswitch.org</span></a>></span><br>
<span class="gmailmsg"><b>Subject:</b></span><span class="apple-converted-space"> </span><span class="gmailmsg">Re: [Freeswitch-users] 100% CPU usage</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">Make sure you lua script has all while loops including session:ready() as a condition to continue. Its a common mistake that leads to loops spinning out of control on hungup channels.</span></span><span lang="EN-US"></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">On Fri, Mar 10, 2017 at 6:11 AM, Antonio Silva <<a href="mailto:asilva@wirelessmundi.com" target="_blank"><span style="color:purple">asilva@wirelessmundi.com</span></a>> wrote:</span></span><span lang="EN-US"></span></p>
</div>
<blockquote style="border:none; border-left:solid #CCCCCC 1.0pt; padding:0cm 0cm 0cm 6.0pt; margin-left:4.8pt; margin-top:5.0pt; margin-right:0cm; margin-bottom:5.0pt">
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span class="gmailmsg"><span lang="EN-US">Hi,</span></span><span lang="EN-US"><br>
<br>
<span class="gmailmsg">You can use the following commands:</span></span></p>
<pre><span class="gmailmsg"><span lang="EN-US">#get a core:</span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US">gcore -o /home/gcore-$(date +%s) $(cat /var/run/freeswitch/freeswitch.pid)</span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US">#check thread usage:</span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US">top -p $(cat /var/run/freeswitch/freeswitch.pid) -H -b -n 1</span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US">#memory mapping:</span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US">cat /proc/$(cat /var/run/freeswitch/freeswitch.pid)/maps</span></span><span lang="EN-US"></span></pre>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span lang="EN-US"><br>
<br>
<span class="gmailmsg">you can get some info from fs:</span></span></p>
<pre><span class="gmailmsg"><span lang="EN-US">fs_cli -x "sofia global siptrace on"</span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US">fs_cli -x "fsctl debug_level 10"</span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US">fs_cli -x "sofia loglevel all 9"</span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US">fs_cli -x "fsctl debug_sql "</span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US">fs_cli -x "sofia global debug presence"</span></span><span lang="EN-US"></span></pre>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
<br>
<span class="gmailmsg">Put everything into a jira so we can take a look.</span><br>
<br>
<br>
<span class="gmailmsg">Regards,</span><br>
<span class="gmailmsg">António</span></span></p>
</div>
<div>
<div>
<div style="margin-bottom:12.0pt">
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">On 03/10/2017 11:08 AM, Grant Bagdasarian wrote:</span></span><span lang="EN-US"></span></p>
</div>
</div>
</div>
</div>
<blockquote style="margin-top:5.0pt; margin-bottom:5.0pt">
<div>
<div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="NL">Hi,</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="NL"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">We’re currently experiencing a weird issue with one of our freeswitch servers where the CPU just goes berserk and stays at 100%.</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">There are no active calls at that moment, but FS is still using 100% CPU.</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">I was unable to get a debug using gdb, since freeswitch does not crash.</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">We had this issue on 1.6.13 and then I upgraded to 1.6.15 this morning, but the problem still persists.</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">There is currently only one active application running on this box which is using LUA. Maybe that is causing the issue?</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">We checked the code but there are no weird loops etc. Perhaps we are missing something?</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">Any ideas how to trace this?</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">Regards,</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">Grant</span></span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
</div>
<div style="margin-bottom:12.0pt">
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
</div>
</div>
<pre><span class="gmailmsg"><span lang="EN-US">_________________________________________________________________________</span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US">Professional FreeSWITCH Consulting Services: </span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"><a href="mailto:consulting@freeswitch.org" target="_blank"><span style="color:purple">consulting@freeswitch.org</span></a></span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"><a href="http://www.freeswitchsolutions.com/" target="_blank"><span style="color:purple">http://www.freeswitchsolutions.com</span></a></span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US">Official FreeSWITCH Sites</span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"><a href="http://www.freeswitch.org/" target="_blank"><span style="color:purple">http://www.freeswitch.org</span></a></span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"><a href="http://confluence.freeswitch.org/" target="_blank"><span style="color:purple">http://confluence.freeswitch.org</span></a></span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"><a href="http://www.cluecon.com/" target="_blank"><span style="color:purple">http://www.cluecon.com</span></a></span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US">FreeSWITCH-users mailing list</span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"><a href="mailto:FreeSWITCH-users@lists.freeswitch.org" target="_blank"><span style="color:purple">FreeSWITCH-users@lists.freeswitch.org</span></a></span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"><a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank"><span style="color:purple">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</span></a></span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US">UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank"><span style="color:purple">http://lists.freeswitch.org/mailman/options/freeswitch-users</span></a></span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"><a href="http://www.freeswitch.org/" target="_blank"><span style="color:purple">http://www.freeswitch.org</span></a></span></span><span lang="EN-US"></span></pre>
</blockquote>
<div style="margin-bottom:12.0pt">
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="color:#888888"> </span></span><span lang="EN-US"></span></p>
</div>
<pre><span class="gmailmsg"><span lang="EN-US" style="color:#888888">-- </span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US" style="color:#888888"> </span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US" style="color:#888888">Saludos / Regards / Cumprimentos,</span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US" style="color:#888888">António silva</span></span><span lang="EN-US"></span></pre>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
<span class="gmailmsg">_________________________________________________________________________</span><br>
<span class="gmailmsg">Professional FreeSWITCH Consulting Services:</span><br>
<span class="gmailmsg"><a href="mailto:consulting@freeswitch.org" target="_blank"><span style="color:purple">consulting@freeswitch.org</span></a></span><br>
<span class="gmailmsg"><a href="http://www.freeswitchsolutions.com/" target="_blank"><span style="color:purple">http://www.freeswitchsolutions.com</span></a></span><br>
<br>
<span class="gmailmsg">Official FreeSWITCH Sites</span><br>
<span class="gmailmsg"><a href="http://www.freeswitch.org/" target="_blank"><span style="color:purple">http://www.freeswitch.org</span></a></span><br>
<span class="gmailmsg"><a href="http://confluence.freeswitch.org/" target="_blank"><span style="color:purple">http://confluence.freeswitch.org</span></a></span><br>
<span class="gmailmsg"><a href="http://www.cluecon.com/" target="_blank"><span style="color:purple">http://www.cluecon.com</span></a></span><br>
<br>
<span class="gmailmsg">FreeSWITCH-users mailing list</span><br>
<span class="gmailmsg"><a href="mailto:FreeSWITCH-users@lists.freeswitch.org" target="_blank"><span style="color:purple">FreeSWITCH-users@lists.freeswitch.org</span></a></span><br>
<span class="gmailmsg"><a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank"><span style="color:purple">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</span></a></span><br>
<span class="gmailmsg">UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank"><span style="color:purple">http://lists.freeswitch.org/mailman/options/freeswitch-users</span></a></span><br>
<span class="gmailmsg"><a href="http://www.freeswitch.org/" target="_blank"><span style="color:purple">http://www.freeswitch.org</span></a></span></span></p>
</div>
</blockquote>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
<br clear="all">
</span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">--</span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">Anthony Minessale II </span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">♬</span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US">@anthmfs </span></span><span class="gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">♬</span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US">@FreeSWITCH </span></span><span class="gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">♬</span></span><span lang="EN-US"></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">☞</span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US"><a href="http://freeswitch.org/" target="_blank"><span style="color:purple">http://freeswitch.org/</span></a></span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">☞</span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US"><a href="http://cluecon.com/" target="_blank"><span style="color:purple">http://cluecon.com/</span></a></span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">☞</span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US"><a href="http://twitter.com/FreeSWITCH" target="_blank"><span style="color:purple">http://twitter.com/FreeSWITCH</span></a></span></span><span lang="EN-US"></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span class="gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">☞</span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US"><a href="http://irc.freenode.net/" target="_blank"><span style="color:purple">irc.freenode.net</span></a></span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US">#freeswitch </span></span><span class="gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">☞</span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><u><span lang="EN-US"><a href="http://freeswitch.org/g+" target="_blank"><span style="color:purple">http://freeswitch.org/g+</span></a></span></u></span><span lang="EN-US"></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">ClueCon Weekly Development Call </span></span><span lang="EN-US"></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">☎</span></span><span class="gmailmsg"><span lang="EN-US"> <a href="mailto:sip%3A888@conference.freeswitch.org" target="_blank"><span style="color:purple">sip:888@conference.freeswitch.org</span></a></span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">☎</span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US">+19193869900 </span></span><span lang="EN-US"></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
</div>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"><a href="https://www.youtube.com/watch?v=9XXgW34t40s" target="_blank"><span style="font-size:9.5pt; color:#1155CC">https://www.youtube.com/watch?v=9XXgW34t40s</span></a></span></span><span lang="EN-US"></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"><a href="https://www.youtube.com/watch?v=NLaDpGQuZDA" target="_blank"><span style="color:purple">https://www.youtube.com/watch?v=NLaDpGQuZDA</span></a></span></span><span lang="EN-US"></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">_________________________________________________________________________</span></span><span lang="EN-US"><br>
<span class="gmailmsg">Professional FreeSWITCH Consulting Services:</span><br>
<span class="gmailmsg"><a href="mailto:consulting@freeswitch.org" target="_blank"><span style="color:purple">consulting@freeswitch.org</span></a></span><br>
<span class="gmailmsg"><a href="http://www.freeswitchsolutions.com/" target="_blank"><span style="color:purple">http://www.freeswitchsolutions.com</span></a></span><br>
<br>
<span class="gmailmsg">Official FreeSWITCH Sites</span><br>
<span class="gmailmsg"><a href="http://www.freeswitch.org/" target="_blank"><span style="color:purple">http://www.freeswitch.org</span></a></span><br>
<span class="gmailmsg"><a href="http://confluence.freeswitch.org/" target="_blank"><span style="color:purple">http://confluence.freeswitch.org</span></a></span><br>
<span class="gmailmsg"><a href="http://www.cluecon.com/" target="_blank"><span style="color:purple">http://www.cluecon.com</span></a></span><br>
<br>
<span class="gmailmsg">FreeSWITCH-users mailing list</span><br>
<span class="gmailmsg"><a href="mailto:FreeSWITCH-users@lists.freeswitch.org" target="_blank"><span style="color:purple">FreeSWITCH-users@lists.freeswitch.org</span></a></span><br>
<span class="gmailmsg"><a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank"><span style="color:purple">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</span></a></span><br>
<span class="gmailmsg">UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank"><span style="color:purple">http://lists.freeswitch.org/mailman/options/freeswitch-users</span></a></span><br>
<span class="gmailmsg"><a href="http://www.freeswitch.org/" target="_blank"><span style="color:purple">http://www.freeswitch.org</span></a></span></span></p>
</div>
</blockquote>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">--</span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
</div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">Anthony Minessale II </span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">♬</span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US">@anthmfs </span></span><span class="gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">♬</span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US">@FreeSWITCH </span></span><span class="gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">♬</span></span><span lang="EN-US"></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">☞</span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US"><a href="http://freeswitch.org/" target="_blank"><span style="color:purple">http://freeswitch.org/</span></a></span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">☞</span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US"><a href="http://cluecon.com/" target="_blank"><span style="color:purple">http://cluecon.com/</span></a></span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">☞</span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US"><a href="http://twitter.com/FreeSWITCH" target="_blank"><span style="color:purple">http://twitter.com/FreeSWITCH</span></a></span></span><span lang="EN-US"></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span class="gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">☞</span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US"><a href="http://irc.freenode.net/" target="_blank"><span style="color:purple">irc.freenode.net</span></a></span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US">#freeswitch </span></span><span class="gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">☞</span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><u><span lang="EN-US"><a href="http://freeswitch.org/g+" target="_blank"><span style="color:purple">http://freeswitch.org/g+</span></a></span></u></span><span lang="EN-US"></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">ClueCon Weekly Development Call </span></span><span lang="EN-US"></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">☎</span></span><span class="gmailmsg"><span lang="EN-US"> <a href="mailto:sip%3A888@conference.freeswitch.org" target="_blank"><span style="color:purple">sip:888@conference.freeswitch.org</span></a></span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">☎</span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span class="gmailmsg"><span lang="EN-US">+19193869900 </span></span><span lang="EN-US"></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
</div>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"><a href="https://www.youtube.com/watch?v=9XXgW34t40s" target="_blank"><span style="font-size:9.5pt; color:#1155CC">https://www.youtube.com/watch?v=9XXgW34t40s</span></a></span></span><span lang="EN-US"></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"><a href="https://www.youtube.com/watch?v=NLaDpGQuZDA" target="_blank"><span style="color:purple">https://www.youtube.com/watch?v=NLaDpGQuZDA</span></a></span></span><span lang="EN-US"></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
<span class="gmailmsg">______________________________________________________________________</span><br>
<span class="gmailmsg">This message has been checked for all known viruses by MessageLabs Virus Scanning Service.</span><br>
<span class="gmailmsg">______________________________________________________________________</span></span></p>
</div>
</div>
<table class="MsoNormalTable" border="0" cellpadding="0">
<tbody>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal"><img border="0" id="m_8143532683370750560_x005f_x0000_i1026" src="http://www.itec-support.co.uk/wp-content/uploads/2016/07/email_logo.jpg"></p>
</div>
</td>
<td valign="top" style="padding:.75pt .75pt .75pt .75pt">
<div>
<div>
<p class="MsoNormal">Shaun Stokes - Infrastructure Analyst</p>
</div>
</div>
<div>
<table class="MsoNormalTable" border="0" cellpadding="0">
<tbody>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt"></td>
<td style="padding:.75pt .75pt .75pt .75pt"></td>
</tr>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal">T :<span class="apple-converted-space"> </span></p>
</div>
</td>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal">01453 700713</p>
</div>
</td>
</tr>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal">E :<span class="apple-converted-space"> </span></p>
</div>
</td>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal"><a href="mailto:shaun.stokes@itec-support.co.uk" target="_blank"><span style="color:purple">shaun.stokes@itec-support.co.uk</span></a></p>
</div>
</td>
</tr>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal">W :<span class="apple-converted-space"> </span></p>
</div>
</td>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal"><a href="http://www.itec-support.co.uk/" target="_blank"><span style="color:purple">www.itec-support.co.uk</span></a></p>
</div>
</td>
</tr>
</tbody>
</table>
</div>
</td>
</tr>
</tbody>
</table>
<div>
<div>
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US">Registered Address :- ITEC Support, Suite 2 Prospect House, Bath Road, Stroud, Gloucestershire GL5 3QF</span></span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span lang="EN-US"><br>
<span class="gmailmsg">Company No. 06908001</span><span class="apple-converted-space"> </span></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
<span class="gmailmsg">CONFIDENTIALITY NOTICE</span><span class="apple-converted-space"> </span><br>
<span class="gmailmsg">This communication and the information it contains are intended for the person or organisation to which it is addressed. Its contents are confidential and may be protected in law. Unauthorised use, copying or disclosure of any of it may
be unlawful. If you are not the intended recipient, please contact us immediately.</span><span class="apple-converted-space"> </span><br>
<span class="gmailmsg">The contents of any attachments in this e-mail may contain software viruses, which could damage your own computer system. While ITEC Support has taken every reasonable precaution to minimise this risk, we cannot accept liability for any
damage which you sustain as a result of software viruses. You should carry out your own virus checking procedure before opening any attachment.</span></span></p>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span lang="EN-US"><br clear="all">
<span class="gmailmsg">______________________________________________________________________</span><br>
<span class="gmailmsg">This message has been checked for all known viruses by MessageLabs Virus Scanning Service.</span><br>
<span class="gmailmsg">______________________________________________________________________</span></span></p>
<pre><span class="gmailmsg"><span lang="EN-US">_________________________________________________________________________</span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US">Professional FreeSWITCH Consulting Services: </span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"><a href="mailto:consulting@freeswitch.org" target="_blank"><span style="color:purple">consulting@freeswitch.org</span></a></span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"><a href="http://www.freeswitchsolutions.com/" target="_blank"><span style="color:purple">http://www.freeswitchsolutions.com</span></a></span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US">Official FreeSWITCH Sites</span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"><a href="http://www.freeswitch.org/" target="_blank"><span style="color:purple">http://www.freeswitch.org</span></a></span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"><a href="http://confluence.freeswitch.org/" target="_blank"><span style="color:purple">http://confluence.freeswitch.org</span></a></span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"><a href="http://www.cluecon.com/" target="_blank"><span style="color:purple">http://www.cluecon.com</span></a></span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US">FreeSWITCH-users mailing list</span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"><a href="mailto:FreeSWITCH-users@lists.freeswitch.org" target="_blank"><span style="color:purple">FreeSWITCH-users@lists.freeswitch.org</span></a></span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"><a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank"><span style="color:purple">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</span></a></span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US">UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank"><span style="color:purple">http://lists.freeswitch.org/mailman/options/freeswitch-users</span></a></span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"><a href="http://www.freeswitch.org/" target="_blank"><span style="color:purple">http://www.freeswitch.org</span></a></span></span><span lang="EN-US"></span></pre>
</blockquote>
<div style="margin-bottom:12.0pt">
<p class="MsoNormal"><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></p>
</div>
<pre><span class="gmailmsg"><span lang="EN-US">-- </span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US"> </span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US">Saludos / Regards / Cumprimentos,</span></span><span lang="EN-US"></span></pre>
<pre><span class="gmailmsg"><span lang="EN-US">António silva</span></span><span lang="EN-US"></span></pre>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
<span class="gmailmsg">______________________________________________________________________</span><br>
<span class="gmailmsg">This message has been checked for all known viruses by MessageLabs Virus Scanning Service.</span><br>
<span class="gmailmsg">______________________________________________________________________</span></span></p>
</div>
</div>
</div>
<div>
<table class="MsoNormalTable" border="0" cellpadding="0">
<tbody>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal"><img border="0" id="_x0000_i1026" src="http://www.itec-support.co.uk/wp-content/uploads/2016/07/email_logo.jpg"></p>
</div>
</td>
<td valign="top" style="padding:.75pt .75pt .75pt .75pt">
<div>
<div>
<p class="MsoNormal">Shaun Stokes - Infrastructure Analyst</p>
</div>
</div>
<div>
<table class="MsoNormalTable" border="0" cellpadding="0">
<tbody>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt"></td>
<td style="padding:.75pt .75pt .75pt .75pt"></td>
</tr>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal">T :<span class="apple-converted-space"> </span></p>
</div>
</td>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal">01453 700713</p>
</div>
</td>
</tr>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal">E :<span class="apple-converted-space"> </span></p>
</div>
</td>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal"><a href="mailto:shaun.stokes@itec-support.co.uk"><span style="color:purple">shaun.stokes@itec-support.co.uk</span></a></p>
</div>
</td>
</tr>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal">W :<span class="apple-converted-space"> </span></p>
</div>
</td>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal"><a href="http://www.itec-support.co.uk/"><span style="color:purple">www.itec-support.co.uk</span></a></p>
</div>
</td>
</tr>
</tbody>
</table>
</div>
</td>
</tr>
</tbody>
</table>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">Registered Address :- ITEC Support, Suite 2 Prospect House, Bath Road, Stroud, Gloucestershire GL5 3QF<span class="apple-converted-space"> </span><br>
Company No. 06908001<span class="apple-converted-space"> </span></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
CONFIDENTIALITY NOTICE<span class="apple-converted-space"> </span><br>
This communication and the information it contains are intended for the person or organisation to which it is addressed. Its contents are confidential and may be protected in law. Unauthorised use, copying or disclosure of any of it may be unlawful. If you
are not the intended recipient, please contact us immediately.<span class="apple-converted-space"> </span><br>
The contents of any attachments in this e-mail may contain software viruses, which could damage your own computer system. While ITEC Support has taken every reasonable precaution to minimise this risk, we cannot accept liability for any damage which you sustain
as a result of software viruses. You should carry out your own virus checking procedure before opening any attachment.</span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
______________________________________________________________________<br>
This message has been checked for all known viruses by MessageLabs Virus Scanning Service.<br>
______________________________________________________________________</span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">_________________________________________________________________________<br>
Professional FreeSWITCH Consulting Services:<br>
<a href="mailto:consulting@freeswitch.org" target="_blank"><span style="color:purple">consulting@freeswitch.org</span></a><br>
<a href="http://www.freeswitchsolutions.com/" target="_blank"><span style="color:purple">http://www.freeswitchsolutions.com</span></a><br>
<br>
Official FreeSWITCH Sites<br>
<a href="http://www.freeswitch.org/" target="_blank"><span style="color:purple">http://www.freeswitch.org</span></a><br>
<a href="http://confluence.freeswitch.org/" target="_blank"><span style="color:purple">http://confluence.freeswitch.org</span></a><br>
<a href="http://www.cluecon.com/" target="_blank"><span style="color:purple">http://www.cluecon.com</span></a><br>
<br>
FreeSWITCH-users mailing list<br>
<a href="mailto:FreeSWITCH-users@lists.freeswitch.org" target="_blank"><span style="color:purple">FreeSWITCH-users@lists.freeswitch.org</span></a><br>
<a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank"><span style="color:purple">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</span></a><br>
UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank"><span style="color:purple">http://lists.freeswitch.org/mailman/options/freeswitch-users</span></a><br>
<a href="http://www.freeswitch.org/" target="_blank"><span style="color:purple">http://www.freeswitch.org</span></a></span></p>
</div>
</blockquote>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">--<span class="apple-converted-space"> </span></span></p>
</div>
</div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">Anthony Minessale II <span class="apple-converted-space"> </span></span><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">♬</span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span lang="EN-US">@anthmfs </span><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">♬</span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span lang="EN-US">@FreeSWITCH </span><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">♬</span><span lang="EN-US"></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">☞</span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span lang="EN-US"><a href="http://freeswitch.org/" target="_blank"><span style="color:purple">http://freeswitch.org/</span></a><span class="apple-converted-space"> </span> </span><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">☞</span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span lang="EN-US"><a href="http://cluecon.com/" target="_blank"><span style="color:purple">http://cluecon.com/</span></a><span class="apple-converted-space"> </span> </span><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">☞</span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span lang="EN-US"><a href="http://twitter.com/FreeSWITCH" target="_blank"><span style="color:purple">http://twitter.com/FreeSWITCH</span></a></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">☞</span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span lang="EN-US"><a href="http://irc.freenode.net/" target="_blank"><span style="color:purple">irc.freenode.net</span></a><span class="apple-converted-space"> </span>#freeswitch </span><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">☞</span><span class="apple-converted-space"><span lang="EN-US"> </span></span><u><span lang="EN-US"><a href="http://freeswitch.org/g+" target="_blank"><span style="color:purple">http://freeswitch.org/g+</span></a></span></u><span lang="EN-US"></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">ClueCon Weekly Development Call </span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">☎</span><span lang="EN-US"> <a href="mailto:sip%3A888@conference.freeswitch.org" target="_blank"><span style="color:purple">sip:888@conference.freeswitch.org</span></a><span class="apple-converted-space"> </span> </span><span lang="EN-US" style="font-family:"Segoe UI Symbol",sans-serif">☎</span><span class="apple-converted-space"><span lang="EN-US"> </span></span><span lang="EN-US">+19193869900 </span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
</div>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US"><a href="https://www.youtube.com/watch?v=9XXgW34t40s" target="_blank"><span style="font-size:9.5pt; color:#1155CC">https://www.youtube.com/watch?v=9XXgW34t40s</span></a></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US"><a href="https://www.youtube.com/watch?v=NLaDpGQuZDA" target="_blank"><span style="color:purple">https://www.youtube.com/watch?v=NLaDpGQuZDA</span></a></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">_________________________________________________________________________<br>
Professional FreeSWITCH Consulting Services:<span class="apple-converted-space"> </span><br>
<a href="mailto:consulting@freeswitch.org"><span style="color:purple">consulting@freeswitch.org</span></a><br>
<a href="http://www.freeswitchsolutions.com/"><span style="color:purple">http://www.freeswitchsolutions.com</span></a><br>
<br>
Official FreeSWITCH Sites<br>
<a href="http://www.freeswitch.org/"><span style="color:purple">http://www.freeswitch.org</span></a><br>
<a href="http://confluence.freeswitch.org/"><span style="color:purple">http://confluence.freeswitch.org</span></a><br>
<a href="http://www.cluecon.com/"><span style="color:purple">http://www.cluecon.com</span></a><br>
<br>
FreeSWITCH-users mailing list<br>
<a href="mailto:FreeSWITCH-users@lists.freeswitch.org"><span style="color:purple">FreeSWITCH-users@lists.freeswitch.org</span></a><br>
<a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users"><span style="color:purple">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</span></a><br>
UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users"><span style="color:purple">http://lists.freeswitch.org/mailman/options/freeswitch-users</span></a><br>
<a href="http://www.freeswitch.org/"><span style="color:purple">http://www.freeswitch.org</span></a></span></p>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
______________________________________________________________________<br>
This message has been checked for all known viruses by MessageLabs Virus Scanning Service.<br>
______________________________________________________________________</span></p>
</div>
</div>
<table class="MsoNormalTable" border="0" cellpadding="0">
<tbody>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal"><img border="0" id="_x0000_i1027" src="http://www.itec-support.co.uk/wp-content/uploads/2016/07/email_logo.jpg"></p>
</div>
</td>
<td valign="top" style="padding:.75pt .75pt .75pt .75pt">
<div>
<div>
<p class="MsoNormal">Shaun Stokes - Infrastructure Analyst</p>
</div>
</div>
<div>
<table class="MsoNormalTable" border="0" cellpadding="0">
<tbody>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt"></td>
<td style="padding:.75pt .75pt .75pt .75pt"></td>
</tr>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal">T :<span class="apple-converted-space"> </span></p>
</div>
</td>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal">01453 700713</p>
</div>
</td>
</tr>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal">E :<span class="apple-converted-space"> </span></p>
</div>
</td>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal"><a href="mailto:shaun.stokes@itec-support.co.uk"><span style="color:purple">shaun.stokes@itec-support.co.uk</span></a></p>
</div>
</td>
</tr>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal">W :<span class="apple-converted-space"> </span></p>
</div>
</td>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal"><a href="http://www.itec-support.co.uk/"><span style="color:purple">www.itec-support.co.uk</span></a></p>
</div>
</td>
</tr>
</tbody>
</table>
</div>
</td>
</tr>
</tbody>
</table>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">Registered Address :- ITEC Support, Suite 2 Prospect House, Bath Road, Stroud, Gloucestershire GL5 3QF<span class="apple-converted-space"> </span><br>
Company No. 06908001<span class="apple-converted-space"> </span></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
CONFIDENTIALITY NOTICE<span class="apple-converted-space"> </span><br>
This communication and the information it contains are intended for the person or organisation to which it is addressed. Its contents are confidential and may be protected in law. Unauthorised use, copying or disclosure of any of it may be unlawful. If you
are not the intended recipient, please contact us immediately.<span class="apple-converted-space"> </span><br>
The contents of any attachments in this e-mail may contain software viruses, which could damage your own computer system. While ITEC Support has taken every reasonable precaution to minimise this risk, we cannot accept liability for any damage which you sustain
as a result of software viruses. You should carry out your own virus checking procedure before opening any attachment.</span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
______________________________________________________________________<br>
This message has been checked for all known viruses by MessageLabs Virus Scanning Service.<br>
______________________________________________________________________<br>
<br>
______________________________________________________________________<br>
This message has been checked for all known viruses by MessageLabs Virus Scanning Service.<br>
______________________________________________________________________</span></p>
</div>
<table class="MsoNormalTable" border="0" cellpadding="0">
<tbody>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal"><img border="0" id="_x0000_i1028" src="http://www.itec-support.co.uk/wp-content/uploads/2016/07/email_logo.jpg"></p>
</div>
</td>
<td valign="top" style="padding:.75pt .75pt .75pt .75pt">
<div>
<div>
<p class="MsoNormal">-</p>
</div>
</div>
<div>
<table class="MsoNormalTable" border="0" cellpadding="0">
<tbody>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt"></td>
<td style="padding:.75pt .75pt .75pt .75pt"></td>
</tr>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal">T :</p>
</div>
</td>
<td style="padding:.75pt .75pt .75pt .75pt"></td>
</tr>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal">E :</p>
</div>
</td>
<td style="padding:.75pt .75pt .75pt .75pt"></td>
</tr>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal">W :</p>
</div>
</td>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal"><a href="http://www.itec-support.co.uk/"><span style="color:purple">www.itec-support.co.uk</span></a></p>
</div>
</td>
</tr>
</tbody>
</table>
</div>
</td>
</tr>
</tbody>
</table>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">Registered Address :- ITEC Support, Suite 2 Prospect House, Bath Road, Stroud, Gloucestershire GL5 3QF<span class="apple-converted-space"> </span><br>
Company No. 06908001<span class="apple-converted-space"> </span></span></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US"><br>
CONFIDENTIALITY NOTICE<span class="apple-converted-space"> </span><br>
This communication and the information it contains are intended for the person or organisation to which it is addressed. Its contents are confidential and may be protected in law. Unauthorised use, copying or disclosure of any of it may be unlawful. If you
are not the intended recipient, please contact us immediately.<span class="apple-converted-space"> </span><br>
The contents of any attachments in this e-mail may contain software viruses, which could damage your own computer system. While ITEC Support has taken every reasonable precaution to minimise this risk, we cannot accept liability for any damage which you sustain
as a result of software viruses. You should carry out your own virus checking procedure before opening any attachment.</span></p>
</div>
</div>
</div>
<table class="MsoNormalTable" border="0" cellpadding="0" style="orphans:auto; widows:auto; word-spacing:0px">
<tbody>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<p class="MsoNormal"><span style="font-family:"Helvetica",sans-serif"><img border="0" id="_x0000_i1029" src="http://www.itec-support.co.uk/wp-content/uploads/2016/07/email_logo.jpg"></span></p>
</td>
<td valign="top" style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal"><span style="font-family:"Helvetica",sans-serif">Shaun Stokes - Infrastructure Analyst</span></p>
</div>
<div>
<table class="MsoNormalTable" border="0" cellpadding="0">
<tbody>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt"></td>
<td style="padding:.75pt .75pt .75pt .75pt"></td>
</tr>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<p class="MsoNormal">T :<span class="apple-converted-space"> </span></p>
</td>
<td style="padding:.75pt .75pt .75pt .75pt">
<p class="MsoNormal">01453 700713</p>
</td>
</tr>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<p class="MsoNormal">E :<span class="apple-converted-space"> </span></p>
</td>
<td style="padding:.75pt .75pt .75pt .75pt">
<p class="MsoNormal"><a href="mailto:shaun.stokes@itec-support.co.uk"><span style="color:purple">shaun.stokes@itec-support.co.uk</span></a></p>
</td>
</tr>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<p class="MsoNormal">W :<span class="apple-converted-space"> </span></p>
</td>
<td style="padding:.75pt .75pt .75pt .75pt">
<p class="MsoNormal"><a href="http://www.itec-support.co.uk/"><span style="color:purple">www.itec-support.co.uk</span></a></p>
</td>
</tr>
</tbody>
</table>
</div>
</td>
</tr>
</tbody>
</table>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt; font-family:"Helvetica",sans-serif">Registered Address :- ITEC Support, Suite 2 Prospect House, Bath Road, Stroud, Gloucestershire GL5 3QF<span class="apple-converted-space"> </span><br>
Company No. 06908001</span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt; font-family:"Helvetica",sans-serif"><br>
CONFIDENTIALITY NOTICE<span class="apple-converted-space"> </span><br>
This communication and the information it contains are intended for the person or organisation to which it is addressed. Its contents are confidential and may be protected in law. Unauthorised use, copying or disclosure of any of it may be unlawful. If you
are not the intended recipient, please contact us immediately.<span class="apple-converted-space"> </span><br>
The contents of any attachments in this e-mail may contain software viruses, which could damage your own computer system. While ITEC Support has taken every reasonable precaution to minimise this risk, we cannot accept liability for any damage which you sustain
as a result of software viruses. You should carry out your own virus checking procedure before opening any attachment.</span></p>
</div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9.0pt; font-family:"Helvetica",sans-serif"><br>
______________________________________________________________________<br>
This message has been checked for all known viruses by MessageLabs Virus Scanning Service.<br>
______________________________________________________________________<br>
_________________________________________________________________________<br>
Professional FreeSWITCH Consulting Services:<span class="apple-converted-space"> </span><br>
</span><span lang="EN-US"><a href="mailto:consulting@freeswitch.org"><span style="font-size:9.0pt; font-family:"Helvetica",sans-serif; color:purple">consulting@freeswitch.org</span></a></span><span lang="EN-US" style="font-size:9.0pt; font-family:"Helvetica",sans-serif"><br>
</span><span lang="EN-US"><a href="http://www.freeswitchsolutions.com/"><span style="font-size:9.0pt; font-family:"Helvetica",sans-serif; color:purple">http://www.freeswitchsolutions.com</span></a></span><span lang="EN-US" style="font-size:9.0pt; font-family:"Helvetica",sans-serif"><br>
<br>
Official FreeSWITCH Sites<br>
</span><span lang="EN-US"><a href="http://www.freeswitch.org/"><span style="font-size:9.0pt; font-family:"Helvetica",sans-serif; color:purple">http://www.freeswitch.org</span></a></span><span lang="EN-US" style="font-size:9.0pt; font-family:"Helvetica",sans-serif"><br>
</span><span lang="EN-US"><a href="http://confluence.freeswitch.org/"><span style="font-size:9.0pt; font-family:"Helvetica",sans-serif; color:purple">http://confluence.freeswitch.org</span></a></span><span lang="EN-US" style="font-size:9.0pt; font-family:"Helvetica",sans-serif"><br>
</span><span lang="EN-US"><a href="http://www.cluecon.com/"><span style="font-size:9.0pt; font-family:"Helvetica",sans-serif; color:purple">http://www.cluecon.com</span></a></span><span lang="EN-US" style="font-size:9.0pt; font-family:"Helvetica",sans-serif"><br>
<br>
FreeSWITCH-users mailing list<br>
</span><span lang="EN-US"><a href="mailto:FreeSWITCH-users@lists.freeswitch.org"><span style="font-size:9.0pt; font-family:"Helvetica",sans-serif; color:purple">FreeSWITCH-users@lists.freeswitch.org</span></a></span><span lang="EN-US" style="font-size:9.0pt; font-family:"Helvetica",sans-serif"><br>
</span><span lang="EN-US"><a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users"><span style="font-size:9.0pt; font-family:"Helvetica",sans-serif; color:purple">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</span></a></span><span lang="EN-US" style="font-size:9.0pt; font-family:"Helvetica",sans-serif"><br>
UNSUBSCRIBE:</span><span lang="EN-US"><a href="http://lists.freeswitch.org/mailman/options/freeswitch-users"><span style="font-size:9.0pt; font-family:"Helvetica",sans-serif; color:purple">http://lists.freeswitch.org/mailman/options/freeswitch-users</span></a></span><span lang="EN-US" style="font-size:9.0pt; font-family:"Helvetica",sans-serif"><br>
</span><span lang="EN-US"><a href="http://www.freeswitch.org/"><span style="font-size:9.0pt; font-family:"Helvetica",sans-serif; color:purple">http://www.freeswitch.org</span></a></span></p>
</div>
</blockquote>
</div>
<p class="MsoNormal"><span lang="EN-US"> </span></p>
<p class="MsoNormal"><span lang="EN-US"><br>
______________________________________________________________________<br>
This message has been checked for all known viruses by MessageLabs Virus Scanning Service.<br>
______________________________________________________________________</span></p>
</div>
<table>
<tbody>
<tr>
<td><img src="http://www.itec-support.co.uk/wp-content/uploads/2016/07/email_logo.jpg"></td>
<td valign="top">
<div><a style="font-family:calibri; color:#1B3E94; font-size:11pt">Shaun Stokes - Infrastructure Analyst</a></div>
<div>
<table>
<tbody>
<tr>
<td></td>
<td></td>
</tr>
<tr>
<td><a style="font-family:calibri; color:#1B3E94; font-size:11pt">T : </a></td>
<td><a style="font-family:calibri; color:#1B3E94; font-size:11pt">01453 700713</a></td>
</tr>
<tr>
<td><a style="font-family:calibri; color:#1B3E94; font-size:11pt">E : </a></td>
<td><a style="font-family:calibri; color:#1B3E94; font-size:11pt">shaun.stokes@itec-support.co.uk</a></td>
</tr>
<tr>
<td><a style="font-family:calibri; color:#1B3E94; font-size:11pt">W : </a></td>
<td><a style="font-family:calibri; color:#1B3E94; font-size:11pt">www.itec-support.co.uk</a></td>
</tr>
</tbody>
</table>
</div>
</td>
</tr>
</tbody>
</table>
<div><a style="font-family:calibri; color:#1B3E94; font-size:11pt">Registered Address :- ITEC Support, Suite 2 Prospect House, Bath Road, Stroud, Gloucestershire GL5 3QF</a>
<br>
<a style="font-family:calibri; color:#1B3E94; font-size:11pt">Company No. 06908001</a>
</div>
<div><br>
<a style="font-family:calibri; color:Grey; font-size:11pt">CONFIDENTIALITY NOTICE</a>
<br>
<a style="font-family:calibri; color:Grey; font-size:11pt">This communication and the information it contains are intended for the person or organisation to which it is addressed. Its contents are confidential and may be protected in law. Unauthorised use,
copying or disclosure of any of it may be unlawful. If you are not the intended recipient, please contact us immediately.</a>
<br>
<a style="font-family:calibri; color:Grey; font-size:11pt">The contents of any attachments in this e-mail may contain software viruses, which could damage your own computer system. While ITEC Support has taken every reasonable precaution to minimise this risk,
we cannot accept liability for any damage which you sustain as a result of software viruses. You should carry out your own virus checking procedure before opening any attachment.</a>
</div>
<br clear="both">
______________________________________________________________________<BR>
This message has been checked for all known viruses by MessageLabs Virus Scanning Service.<BR>
______________________________________________________________________<BR>
</body>
</html>