[Freeswitch-users] Trouble Shooting Hung Sofia Profile
Geoff Mina
gmina at connectfirst.com
Thu May 24 15:10:47 UTC 2018
Greetings,
We previously performed all of the suggested changes to our Freeswitch
installation. We enabled the cache on the XML Curl user endpoint as well
as enabling the thread per registration setting on the internal profile.
We had another event today where the Internal profile was completely hung.
It was unable to process registrations until we restarted. All of the
registrations had expired on the timer, and thus the call processing
stopped as well.
We are running FreeSWITCH Version 1.6.19~64bit ( 64bit) installed from Yum
repo on a CentOS7 server. I have two questions:
1 - Any other known issues regarding hung sofia profiles when using XML
Curl? The internal profile is also handling registrations exclusively from
Websockets (if that makes a difference).
2 - What can we do in the future to get information regarding the hung
process for further troubleshooting. There is nothing in the logs, so I
think we need to generate a core file. Any specific mechanism to generate
the core file that will yield the most interesting results?
Thanks,
Geoff
On Wed, Apr 25, 2018 at 9:57 AM, Tony Bourdeaux <tony at intelecenter.com>
wrote:
> Thanks Giovanni
>
> On Tue, Apr 24, 2018 at 9:27 PM, Giovanni Maruzzelli <gmaruzz at gmail.com>
> wrote:
>
>> Tony, Geoff,
>>
>> registrations are served by one sofia thread, by default, and if the
>> backend keep the registration from succeeding, that can badly affect things.
>>
>> You may want to look into this:
>> inbound-reg-in-new-thread
>>
>> For each inbound register, launch a new thread to process it, e.g. for
>> when using heavier backends
>>
>> <param name="inbound-reg-in-new-thread" value="true"/>
>>
>>
>> https://freeswitch.org/confluence/display/FREESWITCH/Sofia+C
>> onfiguration+Files
>>
>> -giovanni
>>
>>
>> On 25 April 2018 at 05:48, Tony Bourdeaux <tony at intelecenter.com> wrote:
>>
>>> Geoff-
>>>
>>> in Directory for a user can set cacheable=true like this:
>>>
>>> <user id='1000' cacheable='true'>
>>> <params>
>>> <param name='password' value='password123'/>
>>> </params>
>>> <variables>
>>> <variable name='toll_allow' value='domestic,international,local'/>
>>>
>>> <variable name='accountcode' value='1000'/>
>>> <variable name='user_context' value='defaukt'/>
>>> <variable name='effective_caller_id_name' value='Extension
>>> 1000'/>
>>> <variable name='effective_caller_id_number' value='1000'/>
>>> <variable name='outbound_caller_id_name'
>>> value='$${outbound_caller_name}'/>
>>> <variable name='outbound_caller_id_number'
>>> value='$${outbound_caller_id}'/>
>>> </variables>
>>> </user>
>>>
>>> See this link: https://freeswitch.org/conflu
>>> ence/display/FREESWITCH/mod_xml_curl#Caching_objects
>>>
>>> And then the user is stored in memory so re-register authentication
>>> comes from memory rather than another lookup.
>>>
>>> If the user is deleted/disabled or changes password then the cache
>>> should be cleared for that user. Like this: xml_flush_cache id 1000
>>> domainname
>>>
>>> See below for reference:
>>>
>>> If you then make a change to the directory you should run the
>>> xml_flush_cache command to clear, some examples:
>>>
>>> # This clears items for user 1001
>>> xml_flush_cache id 1002 domain-name
>>>
>>> # This clears all items
>>> xml_flush_cache
>>>
>>> You may also wish to enable an expiry on the cache entries by setting
>>> the cacheable attribute to a numeric value which would be the number of
>>> milliseconds, see http://jira.freeswitch.org/browse/FS-4871
>>>
>>> <user id="1002" cacheable="60000">
>>>
>>> will cache the result for 60 seconds (60000 milliseconds)
>>>
>>>
>>> *ALSO-*
>>>
>>> Preloading in the config files also reduces requests:
>>>
>>> In freeswitch.xml replace the section for dialplan with a pre-process
>>> wget statement to load the dialplan:
>>>
>>>
>>> *Something like this:*
>>>
>>> <section name="dialplan" description="Regex/XML Dialplan">
>>>
>>> <X-PRE-PROCESS cmd="exec" data="wget --post-data
>>> 'SomePOSTVariable=SomePOSTValue' -q --output-document=-
>>> https://someURLtheReturnsDialplan/api/ICSwitch/ICDialplan" />
>>>
>>>
>>> <!-- (Important: Note the ' - '. This instructs wget to output the
>>> retrieved document to stdout.) -->
>>> <!-- (to test: "wget -post-data 'SomePOSTVariable=SomePOSTValue'
>>> https://someURLtheReturnsDialplan/api/ICSwitch/ICDialplan") -->
>>>
>>> <!-- <##X-PRE-PROCESS cmd="include" data="dialplan/*.xml"/> -->
>>>
>>> </section>
>>>
>>>
>>> Hope this helps.
>>>
>>> Thanks,
>>>
>>> Tony
>>>
>>> On Tue, Apr 24, 2018 at 8:05 PM, Geoff Mina <gmina at connectfirst.com>
>>> wrote:
>>>
>>>> First, thanks a lot for the response we use mod_xml_curl very heavily.
>>>> While I don’t think our local host Apache server is lagging, it’s possible
>>>> this related. Any tips on caching directory requests?
>>>>
>>>> I don’t see anything directly related to mod_xml_curl that enables
>>>> cache.
>>>>
>>>> Thanks,
>>>> Geoff
>>>>
>>>>
>>>>
>>>>
>>>> On Apr 24, 2018, at 8:40 PM, Tony Bourdeaux <tony at intelecenter.com>
>>>> wrote:
>>>>
>>>> Geoff-
>>>>
>>>> saw this behavior when using mod_xml_curl for Directory and had many
>>>> authentication requests to Directory service that was very slow to
>>>> respond. Sofia stopped responding to any new requests. Fixed with caching
>>>> the Directory requests.
>>>>
>>>> might help.
>>>>
>>>> Thanks.
>>>>
>>>> On Tue, Apr 24, 2018 at 5:30 PM, Geoff Mina <gmina at connectfirst.com>
>>>> wrote:
>>>>
>>>>> Anyone have any pointers on the best way to troubleshoot hung Sofia
>>>>> profiles?
>>>>>
>>>>> We are on 1.6.19 installed via Yum on CentOS 7 and have had consistent
>>>>> system hangs every few days. You can see the SIP message come in on the
>>>>> siptrace logs and then there is never a response.
>>>>>
>>>>> Process restart required to correct. CLI is functional. Nothing
>>>>> interesting in logs.
>>>>>
>>>>> Any pointers greatly appreciated.
>>>>>
>>>>> Thanks.
>>>>> --
>>>>> GEOFF MINA
>>>>> Chief Executive Officer
>>>>> Connect First / Contact Center Solutions, Built Better.
>>>>>
>>>>> 2545 Central Ave #200, Boulder, CO 80301
>>>>> 720.335.5924
>>>>> Connect First / Contact Center Solutions, Built Better
>>>>> www.connectfirst.com
>>>>>
>>>>> This email and any files transmitted with it are confidential and are
>>>>> intended solely for the use of the individual or entity to whom they are
>>>>> addressed. If you have received this email in error, please notify the
>>>>> system manager.
>>>>>
>>>>> ____________________________________________________________
>>>>> _____________
>>>>> Professional FreeSWITCH Consulting Services:
>>>>> consulting at freeswitch.org
>>>>> http://www.freeswitchsolutions.com
>>>>>
>>>>> Official FreeSWITCH Sites
>>>>> http://www.freeswitch.org
>>>>> http://confluence.freeswitch.org
>>>>> http://www.cluecon.com
>>>>>
>>>>> FreeSWITCH-users mailing list
>>>>> FreeSWITCH-users at lists.freeswitch.org
>>>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>>>>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/free
>>>>> switch-users
>>>>> http://www.freeswitch.org
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>>
>>>>
>>>> *T**ony Bourdeaux*
>>>>
>>>>
>>>>
>>>> * Intelecenter, LLC*
>>>>
>>>> ph: 805-703-8277
>>>>
>>>> Skype: tony.bourdeaux
>>>>
>>>>
>>>>
>>>> "This message and any attachments are solely for the intended recipient
>>>> and may contain confidential or privileged information. If you are not the
>>>> intended recipient, any disclosure, copying, use, or distribution of the
>>>> information included in this message and any attachments is prohibited. If
>>>> you have received this communication in error, please notify me by reply
>>>> e-mail and immediately and permanently delete this message and any
>>>> attachments."
>>>>
>>>>
>>>>
>>>> ____________________________________________________________
>>>> _____________
>>>> Professional FreeSWITCH Consulting Services:
>>>> consulting at freeswitch.org
>>>> http://www.freeswitchsolutions.com
>>>>
>>>> Official FreeSWITCH Sites
>>>> http://www.freeswitch.org
>>>> http://confluence.freeswitch.org
>>>> http://www.cluecon.com
>>>>
>>>> FreeSWITCH-users mailing list
>>>> FreeSWITCH-users at lists.freeswitch.org
>>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>>>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/free
>>>> switch-users
>>>> http://www.freeswitch.org
>>>>
>>>>
>>>> ____________________________________________________________
>>>> _____________
>>>> Professional FreeSWITCH Consulting Services:
>>>> consulting at freeswitch.org
>>>> http://www.freeswitchsolutions.com
>>>>
>>>> Official FreeSWITCH Sites
>>>> http://www.freeswitch.org
>>>> http://confluence.freeswitch.org
>>>> http://www.cluecon.com
>>>>
>>>> FreeSWITCH-users mailing list
>>>> FreeSWITCH-users at lists.freeswitch.org
>>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>>>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/free
>>>> switch-users
>>>> http://www.freeswitch.org
>>>>
>>>
>>>
>>>
>>> --
>>>
>>>
>>> *T**ony Bourdeaux*
>>>
>>>
>>>
>>> * Intelecenter, LLC*
>>>
>>> ph: 805-703-8277
>>>
>>> Skype: tony.bourdeaux
>>>
>>>
>>>
>>> "This message and any attachments are solely for the intended recipient
>>> and may contain confidential or privileged information. If you are not the
>>> intended recipient, any disclosure, copying, use, or distribution of the
>>> information included in this message and any attachments is prohibited. If
>>> you have received this communication in error, please notify me by reply
>>> e-mail and immediately and permanently delete this message and any
>>> attachments."
>>>
>>>
>>>
>>> ____________________________________________________________
>>> _____________
>>> Professional FreeSWITCH Consulting Services:
>>> consulting at freeswitch.org
>>> http://www.freeswitchsolutions.com
>>>
>>> Official FreeSWITCH Sites
>>> http://www.freeswitch.org
>>> http://confluence.freeswitch.org
>>> http://www.cluecon.com
>>>
>>> FreeSWITCH-users mailing list
>>> FreeSWITCH-users at lists.freeswitch.org
>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>>> http://www.freeswitch.org
>>>
>>
>>
>>
>> --
>>
>> Sincerely,
>>
>> Giovanni Maruzzelli
>> OpenTelecom.IT
>> cell: +39 347 266 56 18
>>
>> _________________________________________________________________________
>> Professional FreeSWITCH Consulting Services:
>> consulting at freeswitch.org
>> http://www.freeswitchsolutions.com
>>
>> Official FreeSWITCH Sites
>> http://www.freeswitch.org
>> http://confluence.freeswitch.org
>> http://www.cluecon.com
>>
>> FreeSWITCH-users mailing list
>> FreeSWITCH-users at lists.freeswitch.org
>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>> http://www.freeswitch.org
>>
>
>
>
> --
>
>
> *T**ony Bourdeaux*
>
>
>
> * Intelecenter, LLC*
>
> ph: 805-703-8277
>
> Skype: tony.bourdeaux
>
>
>
> "This message and any attachments are solely for the intended recipient
> and may contain confidential or privileged information. If you are not the
> intended recipient, any disclosure, copying, use, or distribution of the
> information included in this message and any attachments is prohibited. If
> you have received this communication in error, please notify me by reply
> e-mail and immediately and permanently delete this message and any
> attachments."
>
>
>
> _________________________________________________________________________
> Professional FreeSWITCH Consulting Services:
> consulting at freeswitch.org
> http://www.freeswitchsolutions.com
>
> Official FreeSWITCH Sites
> http://www.freeswitch.org
> http://confluence.freeswitch.org
> http://www.cluecon.com
>
> FreeSWITCH-users mailing list
> FreeSWITCH-users at lists.freeswitch.org
> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
> http://www.freeswitch.org
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.freeswitch.org/pipermail/freeswitch-users/attachments/20180524/47eeda11/attachment-0001.html>
More information about the FreeSWITCH-users
mailing list