[Freeswitch-users] FS freeze with 100% CPU rate frequently

Anthony Minessale anthony.minessale at gmail.com
Tue Dec 15 02:24:19 MSK 2015


I don't know if this is on the wiki or not but I have detailed this process
many times if you really want to know what is causing it.

1) Save the output from this command:

top -b -H -p `cat /usr/local/freeswitch/run/freeswitch.pid` -n 1

2) get a gcore:

gcore `cat /usr/local/freeswitch/run/freeswitch.pid`


open the corefile in gdb, do "info threads" find the pid that matches the
thread that is 100%cpu


switch to that thread by the number gdb assigned to it (e.g. thread 12)

get a bt... as usual with a crash......











On Mon, Dec 14, 2015 at 2:51 PM, Eric Ni <xyangni at gmail.com> wrote:

> To avoid any ODBC related issues, I have recompiled the FS without ODBC
> support. I use lua curl to submit data to a php page. Thus, no need for DB
> support in FS.
> The total volume of calls is about 50-200 per day. During busy days, on
> average it stuck in 100% CPU once every 2 days. But the actual time and
> frequency is unpredictable.
>
> On Mon, Dec 14, 2015 at 6:27 PM, Luis Daniel Lucio Quiroz <
> luis.daniel.lucio at gmail.com> wrote:
>
>> +1 Chris, I have many VPS running FS without issues.
>>
>> Anyway, Eric has not given any useful information to help him. Not only
>> release, but architecture as well. Are you using a specific xml handler?
>> how the xml handler feeds? what is your ulimit parameters?
>>
>> In my experience, when DB struggles and connection brakes, ODBC does not
>> recover nicely always. 100% cpu utilization is, in sometimes linked to
>> zombie processes. Freeswitch may be waiting for a zombie process.
>>
>> I think this is more a sysadmin issue than voip.
>>
>> Luis Daniel Lucio Quiroz
>> CISSP, CISM, CISA
>> Linux, VoIP and much more fun
>> www.okay.com.mx
>>
>> Need LCR? Check out LCR for FusionPBX with FreeSWITCH
>> Need Billing? Check out Billing for FusionPBX with FreeSWITCH
>>
>> 2015-12-14 13:14 GMT-05:00 Chris Tunbridge <blasterjr at gmail.com>:
>>
>>> Just throwing my 2cents into this conversation.
>>>
>>> I am currently operating 10 servers in virtual environments among
>>> multiple cloud providers, this includes the following: Amazon EC2, Linode,
>>> Digital Ocean.
>>>
>>> My experience so far has been overall good, with the exception that a
>>> few times I've had to have linode move my VM to a less saturated node,
>>> digital ocean isn't any better in this regard as they're highly over
>>> subscribed.
>>>
>>> AWS has been decent but as stated previously, Physical hardware will
>>> give you the best results.
>>>
>>> As for Ubuntu, i -am- currently running all of my VM's on Ubuntu 14.04
>>> 64bit, i had some hurdles dealing with ODBC + MySQL, ended up rolling my
>>> own packages to fix them, but this is not a proper solution.
>>>
>>> I am currently testing Debian + 1.6 with my setup and its going really
>>> well.
>>>
>>> I am also in the process of moving to Physical Hardware as well because
>>> of the increased performance, up front its more expensive, but you end up
>>> with higher call capacity, clearer audio under load, and less headaches due
>>> to circumstances that are outside of your control.
>>>
>>> On Mon, Dec 14, 2015 at 10:51 AM, Giovanni Maruzzelli <gmaruzz at gmail.com
>>> > wrote:
>>>
>>>> I would not use Linode, it adds a layer of uncertainty, because most of
>>>> voip (and freeswitch) deployments are on actual metal hardware, and any
>>>> additional layer will distance your install from mainstream.
>>>>
>>>> Also, definitely not use Ubuntu. Use Debian 8 instead.
>>>>
>>>> Also, consider moving to FreeSWITCH 1.6, 1.4 is rapidly approaching
>>>> end-of-life.
>>>>
>>>> That said, (and I strongly suggest you go to real hardware, Debian 8,
>>>> FS 1.6 if you want things to go smooth), if you really want to do the
>>>> investigation, this page can help you:
>>>> https://freeswitch.org/confluence/display/FREESWITCH/Troubleshooting+Debugging
>>>>
>>>> -giovanni
>>>>
>>>> On Mon, Dec 14, 2015 at 6:28 PM, Eric Ni <xyangni at gmail.com> wrote:
>>>>
>>>>> It is FreeSWITCH Version 1.4.23+git~20151001T183159Z~1665168d37~64bit
>>>>> (git 1665168 2015-10-01 18:31:59Z 64bit)
>>>>> running on ubuntu 14.04, Linode VPS
>>>>>
>>>>> On Mon, Dec 14, 2015 at 12:47 AM, Giovanni Maruzzelli <
>>>>> gmaruzz at gmail.com> wrote:
>>>>>
>>>>>> what freeswitch version/operating system version/freeswitch code
>>>>>> version (from fs_cli "version" command), what hardware platform?
>>>>>>
>>>>>> Consult http://confluence.freeswitch.org for information on how to
>>>>>> debug, and *particularly* on how to report a problem/bug.
>>>>>>
>>>>>>
>>>>>> On Mon, Dec 14, 2015 at 1:30 AM, Eric Ni <xyangni at gmail.com> wrote:
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> My FS freeze with 100% CPU rate frequently. When it happens, there
>>>>>>> is no strange network traffic and no log at all. The last thing logged is
>>>>>>> just the processing of a normal phone call. Then everything stopped. How
>>>>>>> can I debug or find any clue about this issue? Thanks.
>>>>>>>
>>>>>>>
>>>>>>> _________________________________________________________________________
>>>>>>> Professional FreeSWITCH Consulting Services:
>>>>>>> consulting at freeswitch.org
>>>>>>> http://www.freeswitchsolutions.com
>>>>>>>
>>>>>>> Official FreeSWITCH Sites
>>>>>>> http://www.freeswitch.org
>>>>>>> http://confluence.freeswitch.org
>>>>>>> http://www.cluecon.com
>>>>>>>
>>>>>>> FreeSWITCH-users mailing list
>>>>>>> FreeSWITCH-users at lists.freeswitch.org
>>>>>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>>>>>>> UNSUBSCRIBE:
>>>>>>> http://lists.freeswitch.org/mailman/options/freeswitch-users
>>>>>>> http://www.freeswitch.org
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Sincerely,
>>>>>>
>>>>>> Giovanni Maruzzelli
>>>>>> Cell : +39-347-2665618
>>>>>>
>>>>>>
>>>>>> _________________________________________________________________________
>>>>>> Professional FreeSWITCH Consulting Services:
>>>>>> consulting at freeswitch.org
>>>>>> http://www.freeswitchsolutions.com
>>>>>>
>>>>>> Official FreeSWITCH Sites
>>>>>> http://www.freeswitch.org
>>>>>> http://confluence.freeswitch.org
>>>>>> http://www.cluecon.com
>>>>>>
>>>>>> FreeSWITCH-users mailing list
>>>>>> FreeSWITCH-users at lists.freeswitch.org
>>>>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>>>>>> UNSUBSCRIBE:
>>>>>> http://lists.freeswitch.org/mailman/options/freeswitch-users
>>>>>> http://www.freeswitch.org
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> _________________________________________________________________________
>>>>> Professional FreeSWITCH Consulting Services:
>>>>> consulting at freeswitch.org
>>>>> http://www.freeswitchsolutions.com
>>>>>
>>>>> Official FreeSWITCH Sites
>>>>> http://www.freeswitch.org
>>>>> http://confluence.freeswitch.org
>>>>> http://www.cluecon.com
>>>>>
>>>>> FreeSWITCH-users mailing list
>>>>> FreeSWITCH-users at lists.freeswitch.org
>>>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>>>>> UNSUBSCRIBE:
>>>>> http://lists.freeswitch.org/mailman/options/freeswitch-users
>>>>> http://www.freeswitch.org
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Sincerely,
>>>>
>>>> Giovanni Maruzzelli
>>>> Cell : +39-347-2665618
>>>>
>>>>
>>>> _________________________________________________________________________
>>>> Professional FreeSWITCH Consulting Services:
>>>> consulting at freeswitch.org
>>>> http://www.freeswitchsolutions.com
>>>>
>>>> Official FreeSWITCH Sites
>>>> http://www.freeswitch.org
>>>> http://confluence.freeswitch.org
>>>> http://www.cluecon.com
>>>>
>>>> FreeSWITCH-users mailing list
>>>> FreeSWITCH-users at lists.freeswitch.org
>>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>>>> UNSUBSCRIBE:
>>>> http://lists.freeswitch.org/mailman/options/freeswitch-users
>>>> http://www.freeswitch.org
>>>>
>>>
>>>
>>> _________________________________________________________________________
>>> Professional FreeSWITCH Consulting Services:
>>> consulting at freeswitch.org
>>> http://www.freeswitchsolutions.com
>>>
>>> Official FreeSWITCH Sites
>>> http://www.freeswitch.org
>>> http://confluence.freeswitch.org
>>> http://www.cluecon.com
>>>
>>> FreeSWITCH-users mailing list
>>> FreeSWITCH-users at lists.freeswitch.org
>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>>> http://www.freeswitch.org
>>>
>>
>>
>> _________________________________________________________________________
>> Professional FreeSWITCH Consulting Services:
>> consulting at freeswitch.org
>> http://www.freeswitchsolutions.com
>>
>> Official FreeSWITCH Sites
>> http://www.freeswitch.org
>> http://confluence.freeswitch.org
>> http://www.cluecon.com
>>
>> FreeSWITCH-users mailing list
>> FreeSWITCH-users at lists.freeswitch.org
>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>> http://www.freeswitch.org
>>
>
>
> _________________________________________________________________________
> Professional FreeSWITCH Consulting Services:
> consulting at freeswitch.org
> http://www.freeswitchsolutions.com
>
> Official FreeSWITCH Sites
> http://www.freeswitch.org
> http://confluence.freeswitch.org
> http://www.cluecon.com
>
> FreeSWITCH-users mailing list
> FreeSWITCH-users at lists.freeswitch.org
> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
> http://www.freeswitch.org
>



-- 
Anthony Minessale II       ♬ @anthmfs  ♬ @FreeSWITCH  ♬

☞ http://freeswitch.org/http://cluecon.com/http://twitter.com/FreeSWITCH
☞ irc.freenode.net #freeswitch ☞ *http://freeswitch.org/g+
<http://freeswitch.org/g+>*

ClueCon Weekly Development Call
☎ sip:888 at conference.freeswitch.org  ☎ +19193869900

https://www.youtube.com/watch?v=9XXgW34t40s
https://www.youtube.com/watch?v=NLaDpGQuZDA
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.freeswitch.org/pipermail/freeswitch-users/attachments/20151214/290210f3/attachment-0001.html 


Join us at ClueCon 2016 Aug 8-12, 2016
More information about the FreeSWITCH-users mailing list