[Freeswitch-users] Freeswitch 1.4.15 and a sudden jump in CPU usage
Michael Jerris
mike at jerris.com
Wed Feb 11 22:31:29 MSK 2015
Please move any debugging on this issue to the bug mentioned earlier. If anyone can provide the required debug it will allow us to move forward on this issue. Without the debug requested in the jira, we can't move forward.
> On Feb 11, 2015, at 1:58 PM, Ali Pey <alipey at gmail.com> wrote:
>
> Hi Tristan,
>
> Do you see a sudden jump or just more CPU usage?
>
> In my case, everything is good for a few days with less than %10 CPU usage, then there is a sudden jump to ~%98 CPU usage and it doesn't come down until a restart. After restart, it's good again with the same load.
>
> Thanks,
> Ali Pey
>
>
> On Wed, Feb 11, 2015 at 1:40 PM, Tristan Mahé <t.mahe at b-and-c.net <mailto:t.mahe at b-and-c.net>> wrote:
> Maybe related to https://freeswitch.org/jira/browse/FS-7066 <https://freeswitch.org/jira/browse/FS-7066> ?
>
> Le 11/02/2015 08:00, Giovanni Maruzzelli a écrit :
> > somebody has tested if it's a regression, eg: is 1.4.14 having
> > same symptoms?
> >
> > -giovanni
> >
> > On Wed, Feb 11, 2015 at 4:57 PM, Moishe Grunstein <max at nysolutions.com <mailto:max at nysolutions.com>> wrote:
> >> Why not a Jira?
> >>
> >> Thanks,
> >>
> >> Moishe Grunstein
> >> Tornado Computer Systems, Inc.
> >> 212.400.7650 <tel:212.400.7650> 888.IPPBX.US <http://888.ippbx.us/>
> >> Service Request Email: support at nysolutions.com <mailto:support at nysolutions.com>
> >>
> >> Computer Networking * Managed Services * IP Video Surveillance * Network Assessments * Web Solutions * Voice over IP * Disaster Recovery * Network Security * Site Surveys * CMS
> >>
> >> -----Original Message-----
> >> From: freeswitch-users-bounces at lists.freeswitch.org <mailto:freeswitch-users-bounces at lists.freeswitch.org> [mailto:freeswitch-users-bounces at lists.freeswitch.org <mailto:freeswitch-users-bounces at lists.freeswitch.org>] On Behalf Of ??
> >> Sent: Wednesday, February 11, 2015 10:49 AM
> >> To: FreeSWITCH Users Help
> >> Subject: Re: [Freeswitch-users] Freeswitch 1.4.15 and a sudden jump in CPU usage
> >>
> >> i think it's bug of freeswitch:
> >>
> >> -- the Freeswitch using more than 1000% CPU, and there is no other process eating CPU
> >> -- we move all SIP traffic from the server away, the cpu is low. and after sevral hours, if we move the SIP traffic back again, the FS eating all CPU again. the only way to recovery is to restart the FS.
> >> -- there is no DB such as mysql on the server, and we have add "nosql"
> >> option, no help
> >>
> >> On Wed, Feb 11, 2015 at 10:03 PM, John Nash <john.nash778 at gmail.com <mailto:john.nash778 at gmail.com>> wrote:
> >>> Dear Muhammad,
> >>>
> >>> I think your issue is different than Ali Pey because CPU rises at a
> >>> specific time (approx) while running fine most of the time. In my
> >>> experience you should check following ..
> >>> - Check using top commands if its indeed freeswitch taking up CPU. It
> >>> may be logrotate or something.
> >>> - If you are using DB on same server, also check DB connections, May
> >>> be some long running query causing it (Like someone fires some billing
> >>> report at approx same time)
> >>>
> >>> On the other hand when you say "it runs fine all day". You may want to
> >>> check that using top command at different time of day, may be CPU
> >>> usage keep on increasing and in your peak time it increases so much that you see symptoms.
> >>> (If this is true may be you and Ali pey have same issue perhaps some
> >>> CPU leak).
> >>>
> >>> P.S. All points I mentioned are from my VOIP experiences in general. I
> >>> am NOT freeswitch expert. I have recently started experiments with
> >>> freeswitch so people who are using freeswitch or experts will give
> >>> more meaningful insight.
> >>>
> >>>
> >>>
> >>> On Wed, Feb 11, 2015 at 7:16 PM, 彭勇 <ppyy at pubyun.com <mailto:ppyy at pubyun.com>> wrote:
> >>>> we have add this option to grub and reboot one months ago. no help.
> >>>>
> >>>> we have media-pass-through option, and have more than 10 thousands
> >>>> sessions. it works fine all day and the CPU will rise suddenly about
> >>>> 9:00 am every day. i should restart the FS to recovery.
> >>>>
> >>>> On Wed, Feb 11, 2015 at 9:25 PM, Muhammad Naseer Bhatti
> >>>> <nbhatti at gmail.com <mailto:nbhatti at gmail.com>> wrote:
> >>>>> Try nohz=off reboot and see if that helps.
> >>>>>
> >>>>> Sent from my iPad
> >>>>>
> >>>>> On Feb 11, 2015, at 16:18, Aqs Younas <aqsyounas at gmail.com <mailto:aqsyounas at gmail.com>> wrote:
> >>>>>
> >>>>> I am facing same issue. Freeswitch taking more than 100% cpu usage
> >>>>> in htop even on 200 concurrent calls. For 1000 concurrent calls i
> >>>>> have to install 3 freeswitch instances due to this much cpu usage
> >>>>> taking by a single freeswitch node. My Dist is Debian 7.
> >>>>>
> >>>>> On 11 February 2015 at 17:35, Muhammad Naseer Bhatti
> >>>>> <nbhatti at gmail.com <mailto:nbhatti at gmail.com>>
> >>>>> wrote:
> >>>>>>
> >>>>>> It looks like this is the same tickless kernel issue. I am using
> >>>>>> Debian
> >>>>>> 7
> >>>>>> and the CPU usage shows very high. Adding nohz=off to grub options
> >>>>>> does makes it lower. I am gathering more information in order to
> >>>>>> file a Jira.
> >>>>>> Debian 6 on the other hand works very quietly on the same
> >>>>>> workload. We are talking about 200+% CPU utilization on Debian 7
> >>>>>> and around 50% on Debian 6 showing in htop. I know so many other
> >>>>>> factors also involved but I am still digging out more.
> >>>>>>
> >>>>>> —
> >>>>>> Thanks,
> >>>>>> Muhammad Naseer Bhatti
> >>>>>>
> >>>>>> From: 彭勇 <ppyy at pubyun.com <mailto:ppyy at pubyun.com>>
> >>>>>> Reply: FreeSWITCH Users Help
> >>>>>> <freeswitch-users at lists.freeswitch.org <mailto:freeswitch-users at lists.freeswitch.org>>>
> >>>>>> Date: February 11, 2015 at 3:20:46 PM
> >>>>>> To: FreeSWITCH Users Help <freeswitch-users at lists.freeswitch.org <mailto:freeswitch-users at lists.freeswitch.org>>>
> >>>>>> Subject: Re: [Freeswitch-users] Freeswitch 1.4.15 and a sudden
> >>>>>> jump in CPU usage
> >>>>>>
> >>>>>> same issue.
> >>>>>>
> >>>>>> I have several FS 1.4.15 running on CentOS 6.5 x86_64, the CPU
> >>>>>> will be very high about 9:00 am every morning. there is no crontab
> >>>>>> at this time.
> >>>>>>
> >>>>>> i will downgrade to 1.4.14 to see if there is such issue.
> >>>>>>
> >>>>>> On Wed, Feb 11, 2015 at 1:14 AM, Ali Pey <alipey at gmail.com <mailto:alipey at gmail.com>> wrote:
> >>>>>>> Hi Anthony,
> >>>>>>>
> >>>>>>> I do not know if I am hitting a bug and if this is a bug, I
> >>>>>>> don't have much info. I'm using this mailing list to see if
> >>>>>>> anyone else is experiencing this problem and if there is a
> >>>>>>> configuration change on Linux or Freeswitch that can fix this
> >>>>>>> problem. Jira would be to report bugs when you know there is a
> >>>>>>> bug. My problem could be (very likely) an environment related issue.
> >>>>>>>
> >>>>>>> Thanks.
> >>>>>>>
> >>>>>>>
> >>>>>>> On Tue, Feb 10, 2015 at 11:55 AM, Anthony Minessale
> >>>>>>> <anthony.minessale at gmail.com <mailto:anthony.minessale at gmail.com>> wrote:
> >>>>>>>> Also you will have better luck using JIRA. The mailing list is
> >>>>>>>> expressly NOT for reporting issues.
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> On Tue, Feb 10, 2015 at 10:51 AM, Michael Jerris
> >>>>>>>> <mike at jerris.com <mailto:mike at jerris.com>>
> >>>>>>>> wrote:
> >>>>>>>>> you might want to use gcore to look at the threads and see
> >>>>>>>>> what is different when it in this state and not.
> >>>>>>>>>
> >>>>>>>>>> On Feb 10, 2015, at 11:28 AM, Ali Pey <alipey at gmail.com <mailto:alipey at gmail.com>> wrote:
> >>>>>>>>>>
> >>>>>>>>>> Hello,
> >>>>>>>>>>
> >>>>>>>>>> Normally our CPU usage during peak hours are less than %10;
> >>>>>>>>>> however, time to time, freeswitch uses more than %95 of the
> >>>>>>>>>> CPU and it stays there forever. The only way to get it back
> >>>>>>>>>> to normal is to restart freeswitch service. During the high
> >>>>>>>>>> CPU usage, freeswitch continues to operate but very very
> >>>>>>>>>> slow.
> >>>>>>>>>>
> >>>>>>>>>> If I lower the traffic quite a bit, the CPU comes down, but
> >>>>>>>>>> adding back the traffic, the CPU usage goes right back up.
> >>>>>>>>>> After freeswitch restart, it becomes normal again with the
> >>>>>>>>>> same traffic.
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> Any ideas or suggestions?
> >>>>>>>>>>
> >>>>>>>>>> Much appreciated.
> >>>>>>>>>>
> >>>>>>>>>> Thanks,
> >>>>>>>>>> Ali Pey
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> ______________________________________________________________
> >>>>>>>>> ___________ Professional FreeSWITCH Consulting Services:
> >>>>>>>>> consulting at freeswitch.org <mailto:consulting at freeswitch.org>
> >>>>>>>>> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>
> >>>>>>>>>
> >>>>>>>>> Official FreeSWITCH Sites
> >>>>>>>>> http://www.freeswitch.org <http://www.freeswitch.org/>
> >>>>>>>>> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>
> >>>>>>>>>
> >>>>>>>>> FreeSWITCH-users mailing list
> >>>>>>>>> FreeSWITCH-users at lists.freeswitch.org <mailto:FreeSWITCH-users at lists.freeswitch.org>
> >>>>>>>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freesw <http://lists.freeswitch.org/mailman/options/freesw>
> >>>>>>>>> itch-users
> >>>>>>>>> http://www.freeswitch.org <http://www.freeswitch.org/>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> --
> >>>>>>>> Anthony Minessale II ♬ @anthmfs ♬ @FreeSWITCH ♬
> >>>>>>>>
> >>>>>>>> ☞ http://freeswitch.org/ <http://freeswitch.org/> ☞ http://cluecon.com/ <http://cluecon.com/> ☞
> >>>>>>>> http://twitter.com/FreeSWITCH <http://twitter.com/FreeSWITCH> ☞ irc.freenode.net <http://irc.freenode.net/> #freeswitch ☞
> >>>>>>>> http://freeswitch.org/g+ <http://freeswitch.org/g+>
> >>>>>>>>
> >>>>>>>> ClueCon Weekly Development Call ☎
> >>>>>>>> sip:888 at conference.freeswitch.org <mailto:sip%3A888 at conference.freeswitch.org> ☎ +19193869900 <tel:%2B19193869900>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> _______________________________________________________________
> >>>>>>>> __________ Professional FreeSWITCH Consulting Services:
> >>>>>>>> consulting at freeswitch.org <mailto:consulting at freeswitch.org>
> >>>>>>>> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>
> >>>>>>>>
> >>>>>>>> Official FreeSWITCH Sites
> >>>>>>>> http://www.freeswitch.org <http://www.freeswitch.org/>
> >>>>>>>> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>
> >>>>>>>>
> >>>>>>>> FreeSWITCH-users mailing list
> >>>>>>>> FreeSWITCH-users at lists.freeswitch.org <mailto:FreeSWITCH-users at lists.freeswitch.org>
> >>>>>>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswi <http://lists.freeswitch.org/mailman/options/freeswi>
> >>>>>>>> tch-users
> >>>>>>>> http://www.freeswitch.org <http://www.freeswitch.org/>
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>> ________________________________________________________________
> >>>>>>> _________ Professional FreeSWITCH Consulting Services:
> >>>>>>> consulting at freeswitch.org <mailto:consulting at freeswitch.org>
> >>>>>>> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>
> >>>>>>>
> >>>>>>> Official FreeSWITCH Sites
> >>>>>>> http://www.freeswitch.org <http://www.freeswitch.org/>
> >>>>>>> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>
> >>>>>>>
> >>>>>>> FreeSWITCH-users mailing list
> >>>>>>> FreeSWITCH-users at lists.freeswitch.org <mailto:FreeSWITCH-users at lists.freeswitch.org>
> >>>>>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users>
> >>>>>>>
> >>>>>>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswit <http://lists.freeswitch.org/mailman/options/freeswit>
> >>>>>>> ch-users
> >>>>>>> http://www.freeswitch.org <http://www.freeswitch.org/>
> >>>>>>
> >>>>>>
> >>>>>> --
> >>>>>> Peng Yong
> >>>>>>
> >>>>>>
> >>>>>> __________________________________________________________________
> >>>>>> _______ Professional FreeSWITCH Consulting Services:
> >>>>>> consulting at freeswitch.org <mailto:consulting at freeswitch.org>
> >>>>>> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>
> >>>>>>
> >>>>>> Official FreeSWITCH Sites
> >>>>>> http://www.freeswitch.org <http://www.freeswitch.org/>
> >>>>>> http://confluence.freeswitch.org <http://confluence.freeswitch.org/>
> >>>>>> http://www.cluecon.com <http://www.cluecon.com/>
> >>>>>>
> >>>>>> FreeSWITCH-users mailing list
> >>>>>> FreeSWITCH-users at lists.freeswitch.org <mailto:FreeSWITCH-users at lists.freeswitch.org>
> >>>>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users>
> >>>>>>
> >>>>>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch <http://lists.freeswitch.org/mailman/options/freeswitch>
> >>>>>> -users
> >>>>>> http://www.freeswitch.org <http://www.freeswitch.org/>
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> __________________________________________________________________
> >>>>>> _______ Professional FreeSWITCH Consulting Services:
> >>>>>> consulting at freeswitch.org <mailto:consulting at freeswitch.org>
> >>>>>> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>
> >>>>>>
> >>>>>> Official FreeSWITCH Sites
> >>>>>> http://www.freeswitch.org <http://www.freeswitch.org/>
> >>>>>> http://confluence.freeswitch.org <http://confluence.freeswitch.org/>
> >>>>>> http://www.cluecon.com <http://www.cluecon.com/>
> >>>>>>
> >>>>>> FreeSWITCH-users mailing list
> >>>>>> FreeSWITCH-users at lists.freeswitch.org <mailto:FreeSWITCH-users at lists.freeswitch.org>
> >>>>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users>
> >>>>>>
> >>>>>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch <http://lists.freeswitch.org/mailman/options/freeswitch>
> >>>>>> -users
> >>>>>> http://www.freeswitch.org <http://www.freeswitch.org/>
> >>>>>
> >>>>>
> >>>>> ___________________________________________________________________
> >>>>> ______ Professional FreeSWITCH Consulting Services:
> >>>>> consulting at freeswitch.org <mailto:consulting at freeswitch.org>
> >>>>> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>
> >>>>>
> >>>>> Official FreeSWITCH Sites
> >>>>> http://www.freeswitch.org <http://www.freeswitch.org/>
> >>>>> http://confluence.freeswitch.org <http://confluence.freeswitch.org/>
> >>>>> http://www.cluecon.com <http://www.cluecon.com/>
> >>>>>
> >>>>> FreeSWITCH-users mailing list
> >>>>> FreeSWITCH-users at lists.freeswitch.org <mailto:FreeSWITCH-users at lists.freeswitch.org>
> >>>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users>
> >>>>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch- <http://lists.freeswitch.org/mailman/options/freeswitch->
> >>>>> users
> >>>>> http://www.freeswitch.org <http://www.freeswitch.org/>
> >>>>>
> >>>>>
> >>>>>
> >>>>> ___________________________________________________________________
> >>>>> ______ Professional FreeSWITCH Consulting Services:
> >>>>> consulting at freeswitch.org <mailto:consulting at freeswitch.org>
> >>>>> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>
> >>>>>
> >>>>> Official FreeSWITCH Sites
> >>>>> http://www.freeswitch.org <http://www.freeswitch.org/>
> >>>>> http://confluence.freeswitch.org <http://confluence.freeswitch.org/>
> >>>>> http://www.cluecon.com <http://www.cluecon.com/>
> >>>>>
> >>>>> FreeSWITCH-users mailing list
> >>>>> FreeSWITCH-users at lists.freeswitch.org <mailto:FreeSWITCH-users at lists.freeswitch.org>
> >>>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users>
> >>>>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch- <http://lists.freeswitch.org/mailman/options/freeswitch->
> >>>>> users
> >>>>> http://www.freeswitch.org <http://www.freeswitch.org/>
> >>>>
> >>>>
> >>>> --
> >>>> Peng Yong
> >>>>
> >>>> _____________________________________________________________________
> >>>> ____ Professional FreeSWITCH Consulting Services:
> >>>> consulting at freeswitch.org <mailto:consulting at freeswitch.org>
> >>>> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>
> >>>>
> >>>> Official FreeSWITCH Sites
> >>>> http://www.freeswitch.org <http://www.freeswitch.org/>
> >>>> http://confluence.freeswitch.org <http://confluence.freeswitch.org/>
> >>>> http://www.cluecon.com <http://www.cluecon.com/>
> >>>>
> >>>> FreeSWITCH-users mailing list
> >>>> FreeSWITCH-users at lists.freeswitch.org <mailto:FreeSWITCH-users at lists.freeswitch.org>
> >>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users>
> >>>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-us <http://lists.freeswitch.org/mailman/options/freeswitch-us>
> >>>> ers
> >>>> http://www.freeswitch.org <http://www.freeswitch.org/>
> >>>
> >>>
> >>> ______________________________________________________________________
> >>> ___ Professional FreeSWITCH Consulting Services:
> >>> consulting at freeswitch.org <mailto:consulting at freeswitch.org>
> >>> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>
> >>>
> >>> Official FreeSWITCH Sites
> >>> http://www.freeswitch.org <http://www.freeswitch.org/>
> >>> http://confluence.freeswitch.org <http://confluence.freeswitch.org/>
> >>> http://www.cluecon.com <http://www.cluecon.com/>
> >>>
> >>> FreeSWITCH-users mailing list
> >>> FreeSWITCH-users at lists.freeswitch.org <mailto:FreeSWITCH-users at lists.freeswitch.org>
> >>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users>
> >>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-use <http://lists.freeswitch.org/mailman/options/freeswitch-use>
> >>> rs
> >>> http://www.freeswitch.org <http://www.freeswitch.org/>
> >>
> >>
> >> --
> >> Peng Yong
> >>
> >> _________________________________________________________________________
> >> Professional FreeSWITCH Consulting Services:
> >> consulting at freeswitch.org <mailto:consulting at freeswitch.org>
> >> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>
> >>
> >> Official FreeSWITCH Sites
> >> http://www.freeswitch.org <http://www.freeswitch.org/>
> >> http://confluence.freeswitch.org <http://confluence.freeswitch.org/>
> >> http://www.cluecon.com <http://www.cluecon.com/>
> >>
> >> FreeSWITCH-users mailing list
> >> FreeSWITCH-users at lists.freeswitch.org <mailto:FreeSWITCH-users at lists.freeswitch.org>
> >> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users>
> >> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users>
> >> http://www.freeswitch.org <http://www.freeswitch.org/>
> >> _________________________________________________________________________
> >> Professional FreeSWITCH Consulting Services:
> >> consulting at freeswitch.org <mailto:consulting at freeswitch.org>
> >> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>
> >>
> >> Official FreeSWITCH Sites
> >> http://www.freeswitch.org <http://www.freeswitch.org/>
> >> http://confluence.freeswitch.org <http://confluence.freeswitch.org/>
> >> http://www.cluecon.com <http://www.cluecon.com/>
> >>
> >> FreeSWITCH-users mailing list
> >> FreeSWITCH-users at lists.freeswitch.org <mailto:FreeSWITCH-users at lists.freeswitch.org>
> >> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users>
> >> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users>
> >> http://www.freeswitch.org <http://www.freeswitch.org/>
> >
> >
>
>
>
> _________________________________________________________________________
> Professional FreeSWITCH Consulting Services:
> consulting at freeswitch.org <mailto:consulting at freeswitch.org>
> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>
>
> Official FreeSWITCH Sites
> http://www.freeswitch.org <http://www.freeswitch.org/>
> http://confluence.freeswitch.org <http://confluence.freeswitch.org/>
> http://www.cluecon.com <http://www.cluecon.com/>
>
> FreeSWITCH-users mailing list
> FreeSWITCH-users at lists.freeswitch.org <mailto:FreeSWITCH-users at lists.freeswitch.org>
> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users>
> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users>
> http://www.freeswitch.org <http://www.freeswitch.org/>
>
> _________________________________________________________________________
> Professional FreeSWITCH Consulting Services:
> consulting at freeswitch.org
> http://www.freeswitchsolutions.com
>
> Official FreeSWITCH Sites
> http://www.freeswitch.org
> http://confluence.freeswitch.org
> http://www.cluecon.com
>
> FreeSWITCH-users mailing list
> FreeSWITCH-users at lists.freeswitch.org
> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
> http://www.freeswitch.org
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.freeswitch.org/pipermail/freeswitch-users/attachments/20150211/ae027083/attachment-0001.html
Join us at ClueCon 2016 Aug 8-12, 2016
More information about the FreeSWITCH-users
mailing list