Anyone have any pointers on the best way to troubleshoot hung Sofia profiles? We are on 1.6.19 installed via Yum on CentOS 7 and have had consistent system hangs every few days. You can see the SIP message come in on the siptrace logs and then there is never a response. Process restart required to correct. CLI is functional. Nothing interesting in logs. Any pointers greatly appreciated. Thanks. -- GEOFF MINA Chief Executive Officer Connect First / Contact Center Solutions, Built Better. 2545 Central Ave #200, Boulder, CO 80301 720.335.5924 Connect First / Contact Center Solutions, Built Better www.connectfirst.com This email and any files transmitted with it are confidential and are intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error, please notify the system manager.
Geoff- saw this behavior when using mod_xml_curl for Directory and had many authentication requests to Directory service that was very slow to respond. Sofia stopped responding to any new requests. Fixed with caching the Directory requests. might help. Thanks. On Tue, Apr 24, 2018 at 5:30 PM, Geoff Mina <gmina@connectfirst.com> wrote:
Anyone have any pointers on the best way to troubleshoot hung Sofia profiles?
We are on 1.6.19 installed via Yum on CentOS 7 and have had consistent system hangs every few days. You can see the SIP message come in on the siptrace logs and then there is never a response.
Process restart required to correct. CLI is functional. Nothing interesting in logs.
Any pointers greatly appreciated.
Thanks. -- GEOFF MINA Chief Executive Officer Connect First / Contact Center Solutions, Built Better.
2545 Central Ave #200, Boulder, CO 80301 720.335.5924 Connect First / Contact Center Solutions, Built Better www.connectfirst.com
This email and any files transmitted with it are confidential and are intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error, please notify the system manager.
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- *T**ony Bourdeaux* * Intelecenter, LLC* ph: 805-703-8277 Skype: tony.bourdeaux "This message and any attachments are solely for the intended recipient and may contain confidential or privileged information. If you are not the intended recipient, any disclosure, copying, use, or distribution of the information included in this message and any attachments is prohibited. If you have received this communication in error, please notify me by reply e-mail and immediately and permanently delete this message and any attachments."
First, thanks a lot for the response we use mod_xml_curl very heavily. While I don’t think our local host Apache server is lagging, it’s possible this related. Any tips on caching directory requests? I don’t see anything directly related to mod_xml_curl that enables cache. Thanks, Geoff
On Apr 24, 2018, at 8:40 PM, Tony Bourdeaux <tony@intelecenter.com> wrote:
Geoff-
saw this behavior when using mod_xml_curl for Directory and had many authentication requests to Directory service that was very slow to respond. Sofia stopped responding to any new requests. Fixed with caching the Directory requests.
might help.
Thanks.
On Tue, Apr 24, 2018 at 5:30 PM, Geoff Mina <gmina@connectfirst.com> wrote: Anyone have any pointers on the best way to troubleshoot hung Sofia profiles?
We are on 1.6.19 installed via Yum on CentOS 7 and have had consistent system hangs every few days. You can see the SIP message come in on the siptrace logs and then there is never a response.
Process restart required to correct. CLI is functional. Nothing interesting in logs.
Any pointers greatly appreciated.
Thanks. -- GEOFF MINA Chief Executive Officer Connect First / Contact Center Solutions, Built Better. >> 2545 Central Ave #200, Boulder, CO 80301 720.335.5924 Connect First / Contact Center Solutions, Built Better www.connectfirst.com >> This email and any files transmitted with it are confidential and are intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error, please notify the system manager.
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
--
Tony Bourdeaux
Intelecenter, LLC ph: 805-703-8277 Skype: tony.bourdeaux
"This message and any attachments are solely for the intended recipient and may contain confidential or privileged information. If you are not the intended recipient, any disclosure, copying, use, or distribution of the information included in this message and any attachments is prohibited. If you have received this communication in error, please notify me by reply e-mail and immediately and permanently delete this message and any attachments."
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Geoff- in Directory for a user can set cacheable=true like this: <user id='1000' cacheable='true'> <params> <param name='password' value='password123'/> </params> <variables> <variable name='toll_allow' value='domestic,international,local'/> <variable name='accountcode' value='1000'/> <variable name='user_context' value='defaukt'/> <variable name='effective_caller_id_name' value='Extension 1000'/> <variable name='effective_caller_id_number' value='1000'/> <variable name='outbound_caller_id_name' value='$${outbound_caller_name}'/> <variable name='outbound_caller_id_number' value='$${outbound_caller_id}'/> </variables> </user> See this link: https://freeswitch.org/confluence/display/FREESWITCH/mod_xml_curl#Caching_ob... And then the user is stored in memory so re-register authentication comes from memory rather than another lookup. If the user is deleted/disabled or changes password then the cache should be cleared for that user. Like this: xml_flush_cache id 1000 domainname See below for reference: If you then make a change to the directory you should run the xml_flush_cache command to clear, some examples: # This clears items for user 1001 xml_flush_cache id 1002 domain-name # This clears all items xml_flush_cache You may also wish to enable an expiry on the cache entries by setting the cacheable attribute to a numeric value which would be the number of milliseconds, see http://jira.freeswitch.org/browse/FS-4871 <user id="1002" cacheable="60000"> will cache the result for 60 seconds (60000 milliseconds) *ALSO-* Preloading in the config files also reduces requests: In freeswitch.xml replace the section for dialplan with a pre-process wget statement to load the dialplan: *Something like this:* <section name="dialplan" description="Regex/XML Dialplan"> <X-PRE-PROCESS cmd="exec" data="wget --post-data 'SomePOSTVariable=SomePOSTValue' -q --output-document=- https://someURLtheReturnsDialplan/api/ICSwitch/ICDialplan" /> <!-- (Important: Note the ' - '. This instructs wget to output the retrieved document to stdout.) --> <!-- (to test: "wget -post-data 'SomePOSTVariable=SomePOSTValue' https://someURLtheReturnsDialplan/api/ICSwitch/ICDialplan") --> <!-- <##X-PRE-PROCESS cmd="include" data="dialplan/*.xml"/> --> </section> Hope this helps. Thanks, Tony On Tue, Apr 24, 2018 at 8:05 PM, Geoff Mina <gmina@connectfirst.com> wrote:
First, thanks a lot for the response we use mod_xml_curl very heavily. While I don’t think our local host Apache server is lagging, it’s possible this related. Any tips on caching directory requests?
I don’t see anything directly related to mod_xml_curl that enables cache.
Thanks, Geoff
On Apr 24, 2018, at 8:40 PM, Tony Bourdeaux <tony@intelecenter.com> wrote:
Geoff-
saw this behavior when using mod_xml_curl for Directory and had many authentication requests to Directory service that was very slow to respond. Sofia stopped responding to any new requests. Fixed with caching the Directory requests.
might help.
Thanks.
On Tue, Apr 24, 2018 at 5:30 PM, Geoff Mina <gmina@connectfirst.com> wrote:
Anyone have any pointers on the best way to troubleshoot hung Sofia profiles?
We are on 1.6.19 installed via Yum on CentOS 7 and have had consistent system hangs every few days. You can see the SIP message come in on the siptrace logs and then there is never a response.
Process restart required to correct. CLI is functional. Nothing interesting in logs.
Any pointers greatly appreciated.
Thanks. -- GEOFF MINA Chief Executive Officer Connect First / Contact Center Solutions, Built Better.
2545 Central Ave #200, Boulder, CO 80301 720.335.5924 Connect First / Contact Center Solutions, Built Better www.connectfirst.com
This email and any files transmitted with it are confidential and are intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error, please notify the system manager.
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
--
*T**ony Bourdeaux*
* Intelecenter, LLC*
ph: 805-703-8277
Skype: tony.bourdeaux
"This message and any attachments are solely for the intended recipient and may contain confidential or privileged information. If you are not the intended recipient, any disclosure, copying, use, or distribution of the information included in this message and any attachments is prohibited. If you have received this communication in error, please notify me by reply e-mail and immediately and permanently delete this message and any attachments."
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- *T**ony Bourdeaux* * Intelecenter, LLC* ph: 805-703-8277 Skype: tony.bourdeaux "This message and any attachments are solely for the intended recipient and may contain confidential or privileged information. If you are not the intended recipient, any disclosure, copying, use, or distribution of the information included in this message and any attachments is prohibited. If you have received this communication in error, please notify me by reply e-mail and immediately and permanently delete this message and any attachments."
Tony, Geoff, registrations are served by one sofia thread, by default, and if the backend keep the registration from succeeding, that can badly affect things. You may want to look into this: inbound-reg-in-new-thread For each inbound register, launch a new thread to process it, e.g. for when using heavier backends <param name="inbound-reg-in-new-thread" value="true"/> https://freeswitch.org/confluence/display/FREESWITCH/ Sofia+Configuration+Files -giovanni On 25 April 2018 at 05:48, Tony Bourdeaux <tony@intelecenter.com> wrote:
Geoff-
in Directory for a user can set cacheable=true like this:
<user id='1000' cacheable='true'> <params> <param name='password' value='password123'/> </params> <variables> <variable name='toll_allow' value='domestic,international,local'/> <variable name='accountcode' value='1000'/> <variable name='user_context' value='defaukt'/> <variable name='effective_caller_id_name' value='Extension 1000'/> <variable name='effective_caller_id_number' value='1000'/> <variable name='outbound_caller_id_name' value='$${outbound_caller_name}'/> <variable name='outbound_caller_id_number' value='$${outbound_caller_id}'/> </variables> </user>
See this link: https://freeswitch.org/confluence/display/FREESWITCH/mod_ xml_curl#Caching_objects
And then the user is stored in memory so re-register authentication comes from memory rather than another lookup.
If the user is deleted/disabled or changes password then the cache should be cleared for that user. Like this: xml_flush_cache id 1000 domainname
See below for reference:
If you then make a change to the directory you should run the xml_flush_cache command to clear, some examples:
# This clears items for user 1001 xml_flush_cache id 1002 domain-name
# This clears all items xml_flush_cache
You may also wish to enable an expiry on the cache entries by setting the cacheable attribute to a numeric value which would be the number of milliseconds, see http://jira.freeswitch.org/browse/FS-4871
<user id="1002" cacheable="60000">
will cache the result for 60 seconds (60000 milliseconds)
*ALSO-*
Preloading in the config files also reduces requests:
In freeswitch.xml replace the section for dialplan with a pre-process wget statement to load the dialplan:
*Something like this:*
<section name="dialplan" description="Regex/XML Dialplan">
<X-PRE-PROCESS cmd="exec" data="wget --post-data 'SomePOSTVariable=SomePOSTValue' -q --output-document=- https://someURLtheReturnsDialplan/api/ICSwitch/ICDialplan" />
<!-- (Important: Note the ' - '. This instructs wget to output the retrieved document to stdout.) --> <!-- (to test: "wget -post-data 'SomePOSTVariable=SomePOSTValue' https://someURLtheReturnsDialplan/api/ICSwitch/ICDialplan") -->
<!-- <##X-PRE-PROCESS cmd="include" data="dialplan/*.xml"/> -->
</section>
Hope this helps.
Thanks,
Tony
On Tue, Apr 24, 2018 at 8:05 PM, Geoff Mina <gmina@connectfirst.com> wrote:
First, thanks a lot for the response we use mod_xml_curl very heavily. While I don’t think our local host Apache server is lagging, it’s possible this related. Any tips on caching directory requests?
I don’t see anything directly related to mod_xml_curl that enables cache.
Thanks, Geoff
On Apr 24, 2018, at 8:40 PM, Tony Bourdeaux <tony@intelecenter.com> wrote:
Geoff-
saw this behavior when using mod_xml_curl for Directory and had many authentication requests to Directory service that was very slow to respond. Sofia stopped responding to any new requests. Fixed with caching the Directory requests.
might help.
Thanks.
On Tue, Apr 24, 2018 at 5:30 PM, Geoff Mina <gmina@connectfirst.com> wrote:
Anyone have any pointers on the best way to troubleshoot hung Sofia profiles?
We are on 1.6.19 installed via Yum on CentOS 7 and have had consistent system hangs every few days. You can see the SIP message come in on the siptrace logs and then there is never a response.
Process restart required to correct. CLI is functional. Nothing interesting in logs.
Any pointers greatly appreciated.
Thanks. -- GEOFF MINA Chief Executive Officer Connect First / Contact Center Solutions, Built Better.
2545 Central Ave #200, Boulder, CO 80301 720.335.5924 Connect First / Contact Center Solutions, Built Better www.connectfirst.com
This email and any files transmitted with it are confidential and are intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error, please notify the system manager.
____________________________________________________________ _____________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
--
*T**ony Bourdeaux*
* Intelecenter, LLC*
ph: 805-703-8277
Skype: tony.bourdeaux
"This message and any attachments are solely for the intended recipient and may contain confidential or privileged information. If you are not the intended recipient, any disclosure, copying, use, or distribution of the information included in this message and any attachments is prohibited. If you have received this communication in error, please notify me by reply e-mail and immediately and permanently delete this message and any attachments."
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
--
*T**ony Bourdeaux*
* Intelecenter, LLC*
ph: 805-703-8277
Skype: tony.bourdeaux
"This message and any attachments are solely for the intended recipient and may contain confidential or privileged information. If you are not the intended recipient, any disclosure, copying, use, or distribution of the information included in this message and any attachments is prohibited. If you have received this communication in error, please notify me by reply e-mail and immediately and permanently delete this message and any attachments."
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Sincerely, Giovanni Maruzzelli OpenTelecom.IT cell: +39 347 266 56 18
Thanks to both of you for the additional information. We have enabled caching, multi-threaded-registrations, as well as a timeout on the mod_xml_curl configuration. Hopefully this resolves our issues going forward. Thanks, Geoff On Tue, Apr 24, 2018 at 10:27 PM, Giovanni Maruzzelli <gmaruzz@gmail.com> wrote:
Tony, Geoff,
registrations are served by one sofia thread, by default, and if the backend keep the registration from succeeding, that can badly affect things.
You may want to look into this: inbound-reg-in-new-thread
For each inbound register, launch a new thread to process it, e.g. for when using heavier backends
<param name="inbound-reg-in-new-thread" value="true"/>
https://freeswitch.org/confluence/display/FREESWITCH/Sofia+ Configuration+Files
-giovanni
On 25 April 2018 at 05:48, Tony Bourdeaux <tony@intelecenter.com> wrote:
Geoff-
in Directory for a user can set cacheable=true like this:
<user id='1000' cacheable='true'> <params> <param name='password' value='password123'/> </params> <variables> <variable name='toll_allow' value='domestic,international,local'/> <variable name='accountcode' value='1000'/> <variable name='user_context' value='defaukt'/> <variable name='effective_caller_id_name' value='Extension 1000'/> <variable name='effective_caller_id_number' value='1000'/> <variable name='outbound_caller_id_name' value='$${outbound_caller_name}'/> <variable name='outbound_caller_id_number' value='$${outbound_caller_id}'/> </variables> </user>
See this link: https://freeswitch.org/conflu ence/display/FREESWITCH/mod_xml_curl#Caching_objects
And then the user is stored in memory so re-register authentication comes from memory rather than another lookup.
If the user is deleted/disabled or changes password then the cache should be cleared for that user. Like this: xml_flush_cache id 1000 domainname
See below for reference:
If you then make a change to the directory you should run the xml_flush_cache command to clear, some examples:
# This clears items for user 1001 xml_flush_cache id 1002 domain-name
# This clears all items xml_flush_cache
You may also wish to enable an expiry on the cache entries by setting the cacheable attribute to a numeric value which would be the number of milliseconds, see http://jira.freeswitch.org/browse/FS-4871
<user id="1002" cacheable="60000">
will cache the result for 60 seconds (60000 milliseconds)
*ALSO-*
Preloading in the config files also reduces requests:
In freeswitch.xml replace the section for dialplan with a pre-process wget statement to load the dialplan:
*Something like this:*
<section name="dialplan" description="Regex/XML Dialplan">
<X-PRE-PROCESS cmd="exec" data="wget --post-data 'SomePOSTVariable=SomePOSTValue' -q --output-document=- https://someURLtheReturnsDialplan/api/ICSwitch/ICDialplan" />
<!-- (Important: Note the ' - '. This instructs wget to output the retrieved document to stdout.) --> <!-- (to test: "wget -post-data 'SomePOSTVariable=SomePOSTValue' https://someURLtheReturnsDialplan/api/ICSwitch/ICDialplan") -->
<!-- <##X-PRE-PROCESS cmd="include" data="dialplan/*.xml"/> -->
</section>
Hope this helps.
Thanks,
Tony
On Tue, Apr 24, 2018 at 8:05 PM, Geoff Mina <gmina@connectfirst.com> wrote:
First, thanks a lot for the response we use mod_xml_curl very heavily. While I don’t think our local host Apache server is lagging, it’s possible this related. Any tips on caching directory requests?
I don’t see anything directly related to mod_xml_curl that enables cache.
Thanks, Geoff
On Apr 24, 2018, at 8:40 PM, Tony Bourdeaux <tony@intelecenter.com> wrote:
Geoff-
saw this behavior when using mod_xml_curl for Directory and had many authentication requests to Directory service that was very slow to respond. Sofia stopped responding to any new requests. Fixed with caching the Directory requests.
might help.
Thanks.
On Tue, Apr 24, 2018 at 5:30 PM, Geoff Mina <gmina@connectfirst.com> wrote:
Anyone have any pointers on the best way to troubleshoot hung Sofia profiles?
We are on 1.6.19 installed via Yum on CentOS 7 and have had consistent system hangs every few days. You can see the SIP message come in on the siptrace logs and then there is never a response.
Process restart required to correct. CLI is functional. Nothing interesting in logs.
Any pointers greatly appreciated.
Thanks. -- GEOFF MINA Chief Executive Officer Connect First / Contact Center Solutions, Built Better.
2545 Central Ave #200, Boulder, CO 80301 720.335.5924 Connect First / Contact Center Solutions, Built Better www.connectfirst.com
This email and any files transmitted with it are confidential and are intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error, please notify the system manager.
____________________________________________________________ _____________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/free switch-users http://www.freeswitch.org
--
*T**ony Bourdeaux*
* Intelecenter, LLC*
ph: 805-703-8277
Skype: tony.bourdeaux
"This message and any attachments are solely for the intended recipient and may contain confidential or privileged information. If you are not the intended recipient, any disclosure, copying, use, or distribution of the information included in this message and any attachments is prohibited. If you have received this communication in error, please notify me by reply e-mail and immediately and permanently delete this message and any attachments."
____________________________________________________________ _____________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
____________________________________________________________ _____________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
--
*T**ony Bourdeaux*
* Intelecenter, LLC*
ph: 805-703-8277
Skype: tony.bourdeaux
"This message and any attachments are solely for the intended recipient and may contain confidential or privileged information. If you are not the intended recipient, any disclosure, copying, use, or distribution of the information included in this message and any attachments is prohibited. If you have received this communication in error, please notify me by reply e-mail and immediately and permanently delete this message and any attachments."
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
--
Sincerely,
Giovanni Maruzzelli OpenTelecom.IT cell: +39 347 266 56 18
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Thanks Giovanni On Tue, Apr 24, 2018 at 9:27 PM, Giovanni Maruzzelli <gmaruzz@gmail.com> wrote:
Tony, Geoff,
registrations are served by one sofia thread, by default, and if the backend keep the registration from succeeding, that can badly affect things.
You may want to look into this: inbound-reg-in-new-thread
For each inbound register, launch a new thread to process it, e.g. for when using heavier backends
<param name="inbound-reg-in-new-thread" value="true"/>
https://freeswitch.org/confluence/display/FREESWITCH/Sofia+ Configuration+Files
-giovanni
On 25 April 2018 at 05:48, Tony Bourdeaux <tony@intelecenter.com> wrote:
Geoff-
in Directory for a user can set cacheable=true like this:
<user id='1000' cacheable='true'> <params> <param name='password' value='password123'/> </params> <variables> <variable name='toll_allow' value='domestic,international,local'/> <variable name='accountcode' value='1000'/> <variable name='user_context' value='defaukt'/> <variable name='effective_caller_id_name' value='Extension 1000'/> <variable name='effective_caller_id_number' value='1000'/> <variable name='outbound_caller_id_name' value='$${outbound_caller_name}'/> <variable name='outbound_caller_id_number' value='$${outbound_caller_id}'/> </variables> </user>
See this link: https://freeswitch.org/conflu ence/display/FREESWITCH/mod_xml_curl#Caching_objects
And then the user is stored in memory so re-register authentication comes from memory rather than another lookup.
If the user is deleted/disabled or changes password then the cache should be cleared for that user. Like this: xml_flush_cache id 1000 domainname
See below for reference:
If you then make a change to the directory you should run the xml_flush_cache command to clear, some examples:
# This clears items for user 1001 xml_flush_cache id 1002 domain-name
# This clears all items xml_flush_cache
You may also wish to enable an expiry on the cache entries by setting the cacheable attribute to a numeric value which would be the number of milliseconds, see http://jira.freeswitch.org/browse/FS-4871
<user id="1002" cacheable="60000">
will cache the result for 60 seconds (60000 milliseconds)
*ALSO-*
Preloading in the config files also reduces requests:
In freeswitch.xml replace the section for dialplan with a pre-process wget statement to load the dialplan:
*Something like this:*
<section name="dialplan" description="Regex/XML Dialplan">
<X-PRE-PROCESS cmd="exec" data="wget --post-data 'SomePOSTVariable=SomePOSTValue' -q --output-document=- https://someURLtheReturnsDialplan/api/ICSwitch/ICDialplan" />
<!-- (Important: Note the ' - '. This instructs wget to output the retrieved document to stdout.) --> <!-- (to test: "wget -post-data 'SomePOSTVariable=SomePOSTValue' https://someURLtheReturnsDialplan/api/ICSwitch/ICDialplan") -->
<!-- <##X-PRE-PROCESS cmd="include" data="dialplan/*.xml"/> -->
</section>
Hope this helps.
Thanks,
Tony
On Tue, Apr 24, 2018 at 8:05 PM, Geoff Mina <gmina@connectfirst.com> wrote:
First, thanks a lot for the response we use mod_xml_curl very heavily. While I don’t think our local host Apache server is lagging, it’s possible this related. Any tips on caching directory requests?
I don’t see anything directly related to mod_xml_curl that enables cache.
Thanks, Geoff
On Apr 24, 2018, at 8:40 PM, Tony Bourdeaux <tony@intelecenter.com> wrote:
Geoff-
saw this behavior when using mod_xml_curl for Directory and had many authentication requests to Directory service that was very slow to respond. Sofia stopped responding to any new requests. Fixed with caching the Directory requests.
might help.
Thanks.
On Tue, Apr 24, 2018 at 5:30 PM, Geoff Mina <gmina@connectfirst.com> wrote:
Anyone have any pointers on the best way to troubleshoot hung Sofia profiles?
We are on 1.6.19 installed via Yum on CentOS 7 and have had consistent system hangs every few days. You can see the SIP message come in on the siptrace logs and then there is never a response.
Process restart required to correct. CLI is functional. Nothing interesting in logs.
Any pointers greatly appreciated.
Thanks. -- GEOFF MINA Chief Executive Officer Connect First / Contact Center Solutions, Built Better.
2545 Central Ave #200, Boulder, CO 80301 720.335.5924 Connect First / Contact Center Solutions, Built Better www.connectfirst.com
This email and any files transmitted with it are confidential and are intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error, please notify the system manager.
____________________________________________________________ _____________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/free switch-users http://www.freeswitch.org
--
*T**ony Bourdeaux*
* Intelecenter, LLC*
ph: 805-703-8277
Skype: tony.bourdeaux
"This message and any attachments are solely for the intended recipient and may contain confidential or privileged information. If you are not the intended recipient, any disclosure, copying, use, or distribution of the information included in this message and any attachments is prohibited. If you have received this communication in error, please notify me by reply e-mail and immediately and permanently delete this message and any attachments."
____________________________________________________________ _____________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
____________________________________________________________ _____________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
--
*T**ony Bourdeaux*
* Intelecenter, LLC*
ph: 805-703-8277
Skype: tony.bourdeaux
"This message and any attachments are solely for the intended recipient and may contain confidential or privileged information. If you are not the intended recipient, any disclosure, copying, use, or distribution of the information included in this message and any attachments is prohibited. If you have received this communication in error, please notify me by reply e-mail and immediately and permanently delete this message and any attachments."
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
--
Sincerely,
Giovanni Maruzzelli OpenTelecom.IT cell: +39 347 266 56 18
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- *T**ony Bourdeaux* * Intelecenter, LLC* ph: 805-703-8277 Skype: tony.bourdeaux "This message and any attachments are solely for the intended recipient and may contain confidential or privileged information. If you are not the intended recipient, any disclosure, copying, use, or distribution of the information included in this message and any attachments is prohibited. If you have received this communication in error, please notify me by reply e-mail and immediately and permanently delete this message and any attachments."
Greetings, We previously performed all of the suggested changes to our Freeswitch installation. We enabled the cache on the XML Curl user endpoint as well as enabling the thread per registration setting on the internal profile. We had another event today where the Internal profile was completely hung. It was unable to process registrations until we restarted. All of the registrations had expired on the timer, and thus the call processing stopped as well. We are running FreeSWITCH Version 1.6.19~64bit ( 64bit) installed from Yum repo on a CentOS7 server. I have two questions: 1 - Any other known issues regarding hung sofia profiles when using XML Curl? The internal profile is also handling registrations exclusively from Websockets (if that makes a difference). 2 - What can we do in the future to get information regarding the hung process for further troubleshooting. There is nothing in the logs, so I think we need to generate a core file. Any specific mechanism to generate the core file that will yield the most interesting results? Thanks, Geoff On Wed, Apr 25, 2018 at 9:57 AM, Tony Bourdeaux <tony@intelecenter.com> wrote:
Thanks Giovanni
On Tue, Apr 24, 2018 at 9:27 PM, Giovanni Maruzzelli <gmaruzz@gmail.com> wrote:
Tony, Geoff,
registrations are served by one sofia thread, by default, and if the backend keep the registration from succeeding, that can badly affect things.
You may want to look into this: inbound-reg-in-new-thread
For each inbound register, launch a new thread to process it, e.g. for when using heavier backends
<param name="inbound-reg-in-new-thread" value="true"/>
https://freeswitch.org/confluence/display/FREESWITCH/Sofia+C onfiguration+Files
-giovanni
On 25 April 2018 at 05:48, Tony Bourdeaux <tony@intelecenter.com> wrote:
Geoff-
in Directory for a user can set cacheable=true like this:
<user id='1000' cacheable='true'> <params> <param name='password' value='password123'/> </params> <variables> <variable name='toll_allow' value='domestic,international,local'/>
<variable name='accountcode' value='1000'/> <variable name='user_context' value='defaukt'/> <variable name='effective_caller_id_name' value='Extension 1000'/> <variable name='effective_caller_id_number' value='1000'/> <variable name='outbound_caller_id_name' value='$${outbound_caller_name}'/> <variable name='outbound_caller_id_number' value='$${outbound_caller_id}'/> </variables> </user>
See this link: https://freeswitch.org/conflu ence/display/FREESWITCH/mod_xml_curl#Caching_objects
And then the user is stored in memory so re-register authentication comes from memory rather than another lookup.
If the user is deleted/disabled or changes password then the cache should be cleared for that user. Like this: xml_flush_cache id 1000 domainname
See below for reference:
If you then make a change to the directory you should run the xml_flush_cache command to clear, some examples:
# This clears items for user 1001 xml_flush_cache id 1002 domain-name
# This clears all items xml_flush_cache
You may also wish to enable an expiry on the cache entries by setting the cacheable attribute to a numeric value which would be the number of milliseconds, see http://jira.freeswitch.org/browse/FS-4871
<user id="1002" cacheable="60000">
will cache the result for 60 seconds (60000 milliseconds)
*ALSO-*
Preloading in the config files also reduces requests:
In freeswitch.xml replace the section for dialplan with a pre-process wget statement to load the dialplan:
*Something like this:*
<section name="dialplan" description="Regex/XML Dialplan">
<X-PRE-PROCESS cmd="exec" data="wget --post-data 'SomePOSTVariable=SomePOSTValue' -q --output-document=- https://someURLtheReturnsDialplan/api/ICSwitch/ICDialplan" />
<!-- (Important: Note the ' - '. This instructs wget to output the retrieved document to stdout.) --> <!-- (to test: "wget -post-data 'SomePOSTVariable=SomePOSTValue' https://someURLtheReturnsDialplan/api/ICSwitch/ICDialplan") -->
<!-- <##X-PRE-PROCESS cmd="include" data="dialplan/*.xml"/> -->
</section>
Hope this helps.
Thanks,
Tony
On Tue, Apr 24, 2018 at 8:05 PM, Geoff Mina <gmina@connectfirst.com> wrote:
First, thanks a lot for the response we use mod_xml_curl very heavily. While I don’t think our local host Apache server is lagging, it’s possible this related. Any tips on caching directory requests?
I don’t see anything directly related to mod_xml_curl that enables cache.
Thanks, Geoff
On Apr 24, 2018, at 8:40 PM, Tony Bourdeaux <tony@intelecenter.com> wrote:
Geoff-
saw this behavior when using mod_xml_curl for Directory and had many authentication requests to Directory service that was very slow to respond. Sofia stopped responding to any new requests. Fixed with caching the Directory requests.
might help.
Thanks.
On Tue, Apr 24, 2018 at 5:30 PM, Geoff Mina <gmina@connectfirst.com> wrote:
Anyone have any pointers on the best way to troubleshoot hung Sofia profiles?
We are on 1.6.19 installed via Yum on CentOS 7 and have had consistent system hangs every few days. You can see the SIP message come in on the siptrace logs and then there is never a response.
Process restart required to correct. CLI is functional. Nothing interesting in logs.
Any pointers greatly appreciated.
Thanks. -- GEOFF MINA Chief Executive Officer Connect First / Contact Center Solutions, Built Better.
2545 Central Ave #200, Boulder, CO 80301 720.335.5924 Connect First / Contact Center Solutions, Built Better www.connectfirst.com
This email and any files transmitted with it are confidential and are intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error, please notify the system manager.
____________________________________________________________ _____________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/free switch-users http://www.freeswitch.org
--
*T**ony Bourdeaux*
* Intelecenter, LLC*
ph: 805-703-8277
Skype: tony.bourdeaux
"This message and any attachments are solely for the intended recipient and may contain confidential or privileged information. If you are not the intended recipient, any disclosure, copying, use, or distribution of the information included in this message and any attachments is prohibited. If you have received this communication in error, please notify me by reply e-mail and immediately and permanently delete this message and any attachments."
____________________________________________________________ _____________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/free switch-users http://www.freeswitch.org
____________________________________________________________ _____________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/free switch-users http://www.freeswitch.org
--
*T**ony Bourdeaux*
* Intelecenter, LLC*
ph: 805-703-8277
Skype: tony.bourdeaux
"This message and any attachments are solely for the intended recipient and may contain confidential or privileged information. If you are not the intended recipient, any disclosure, copying, use, or distribution of the information included in this message and any attachments is prohibited. If you have received this communication in error, please notify me by reply e-mail and immediately and permanently delete this message and any attachments."
____________________________________________________________ _____________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
--
Sincerely,
Giovanni Maruzzelli OpenTelecom.IT cell: +39 347 266 56 18
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
--
*T**ony Bourdeaux*
* Intelecenter, LLC*
ph: 805-703-8277
Skype: tony.bourdeaux
"This message and any attachments are solely for the intended recipient and may contain confidential or privileged information. If you are not the intended recipient, any disclosure, copying, use, or distribution of the information included in this message and any attachments is prohibited. If you have received this communication in error, please notify me by reply e-mail and immediately and permanently delete this message and any attachments."
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
participants (3)
-
Geoff Mina
-
Giovanni Maruzzelli
-
Tony Bourdeaux