Mike, with sofia loglevel all 9, I can see that sometimes (frequency hard to guess), during 4-5 secondes, FS writes those messages in the log for each REGISTER or OPTIONS request: nta.c:3012 agent_recv_request() nta: OPTIONS (102) going to existing OPTIONS transaction nta.c:3012 agent_recv_request() nta: REGISTER (116849) going to existing REGISTER transaction It’s like it considers it’s already dealing with a such request (which it never replied to). A typical regular flow of logs for a REGISTER which was responded to is: nta.c:3085 agent_recv_request() nta: REGISTER (108692) going to a default leg nua_server.c:102 nua_stack_process_request() nua: nua_stack_process_request: entering nua_stack.c:899 nh_create() nua: nh_create: entering nua_common.c:108 nh_create_handle() nua: nh_create_handle: entering nua_params.c:480 nua_stack_set_params() nua: nua_stack_set_params: entering soa.c:280 soa_clone() soa_clone(static::0x7fda40001930, 0x7fda40001130, 0x7fda40039330) called soa.c:403 soa_set_params() soa_set_params(static::0x7fda40207f40, ...) called nua_stack.c:271 nua_stack_event() nua(0x7fda40039330): event i_register 100 Trying nua_stack.c:359 nua_application_event() nua: nua_application_event: entering nua.c:366 nua_handle_magic() nua: nua_handle_magic: entering nua.c:879 nua_respond() nua: nua_respond: entering nua_stack.c:529 nua_signal() nua(0x7fda40039330): sent signal r_respond nua.c:921 nua_handle_destroy() nua: nua_handle_destroy: entering nua_stack.c:529 nua_signal() nua(0x7fda40039330): sent signal r_destroy nua.c:366 nua_handle_magic() nua: nua_handle_magic: entering nua.c:921 nua_handle_destroy() nua: nua_handle_destroy: entering nua_stack.c:573 nua_stack_signal() nua(0x7fda40039330): recv signal r_respond 200 OK When it fails to respond, it is: nta.c:3085 agent_recv_request() nta: REGISTER (108693) going to a default leg nua_server.c:102 nua_stack_process_request() nua: nua_stack_process_request: entering nua_stack.c:899 nh_create() nua: nh_create: entering nua_common.c:108 nh_create_handle() nua: nh_create_handle: entering nua_params.c:480 nua_stack_set_params() nua: nua_stack_set_params: entering soa.c:280 soa_clone() soa_clone(static::0x7fda40001930, 0x7fda40001130, 0x7fda402dc590) called soa.c:403 soa_set_params() soa_set_params(static::0x7fda4014f880, ...) called nua_stack.c:271 nua_stack_event() nua(0x7fda402dc590): event i_register 100 Trying nua_stack.c:359 nua_application_event() nua: nua_application_event: entering It’s difficult to know which lines are related in the log, but when FS does not answer the 200 OK, I am definitely missing a line like: nua_stack.c:529 nua_signal() nua(0x7fda40039330): sent signal r_respond David Ponzone Direction Technique email: david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr> tel: 01 74 03 18 97 gsm: 06 66 98 76 34 Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr <blocked::http://www.ipeva.fr/> - www.ipeva-studio.com <blocked::http://www.ipeva-studio.com/> Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

Le 17 mars 2017 à 23:08, Michael Jerris <mike@jerris.com> a écrit :

you can try sofia loglevel all 9

see if that tells you anything when we get one we don't respond to... also get latest 1.6 and see if that helps On Fri, Mar 17, 2017 at 5:19 PM David Villasmil <david.villasmil.work@gmail.com <mailto:david.villasmil.work@gmail.com>> wrote: How's the memory use? On Fri, Mar 17, 2017 at 10:09 PM David Ponzone <david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr>> wrote: All,

I noticed recently that sometimes FS (1.6.6) does not honor REGISTER or OPTIONS requests coming from some customers. Those customers register every 30 seconds, and FS does not answer to around 20-30 REGISTERs each day. I am trying to understand that, as the server is far from loaded (max 100 concurrent calls on a Dell R610).

Can anyone recommend some debugging steps to try to narrow this down ? Any known issue of this sort in 1.6.6 ?

Thank you

David Ponzone Direction Technique email: david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr> tel: 01 74 03 18 97 gsm: 06 66 98 76 34

Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr <> - www.ipeva-studio.com <>

Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>

Official FreeSWITCH Sites http://www.freeswitch.org <http://www.freeswitch.org/> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users> http://www.freeswitch.org <http://www.freeswitch.org/>_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>

Official FreeSWITCH Sites http://www.freeswitch.org <http://www.freeswitch.org/> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users> http://www.freeswitch.org <http://www.freeswitch.org/>_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com

Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org

Hi,

nta.c:3012 agent_recv_request() nta: OPTIONS (102) going to existing OPTIONS transaction nta.c:3012 agent_recv_request() nta: REGISTER (116849) going to existing REGISTER transaction

These means that sofia is considering these requests as retransmissions (transaction found in sofia's internal htable). In this case, you should also see a retransmission log like "nta: re-received %s request, retransmitting %u reply". The nua_application_event is calling a mod_sofia callback for incoming register request. So it looks like mod_sofia does not answer for some reason. Can you check if you get the following esl custom events: "sofia::register_attempt", "sofia::pre_register" and "sofia::register" for the failed register? It will help to tell at which point the processing stops. Also, is your core-db in-memory? If not, you may try to move it in ram. Best Regards, Vallimamod . -- Vallimamod Abdullah SIP Solutions vma@sipsolutions.fr tel:+33662606897 .

On 18 Mar 2017, at 20:04, David Ponzone <david.ponzone@ipeva.fr> wrote:

Mike,

with sofia loglevel all 9, I can see that sometimes (frequency hard to guess), during 4-5 secondes, FS writes those messages in the log for each REGISTER or OPTIONS request:

nta.c:3012 agent_recv_request() nta: OPTIONS (102) going to existing OPTIONS transaction nta.c:3012 agent_recv_request() nta: REGISTER (116849) going to existing REGISTER transaction

It’s like it considers it’s already dealing with a such request (which it never replied to).

A typical regular flow of logs for a REGISTER which was responded to is:

nta.c:3085 agent_recv_request() nta: REGISTER (108692) going to a default leg nua_server.c:102 nua_stack_process_request() nua: nua_stack_process_request: entering nua_stack.c:899 nh_create() nua: nh_create: entering nua_common.c:108 nh_create_handle() nua: nh_create_handle: entering nua_params.c:480 nua_stack_set_params() nua: nua_stack_set_params: entering soa.c:280 soa_clone() soa_clone(static::0x7fda40001930, 0x7fda40001130, 0x7fda40039330) called soa.c:403 soa_set_params() soa_set_params(static::0x7fda40207f40, ...) called nua_stack.c:271 nua_stack_event() nua(0x7fda40039330): event i_register 100 Trying nua_stack.c:359 nua_application_event() nua: nua_application_event: entering nua.c:366 nua_handle_magic() nua: nua_handle_magic: entering nua.c:879 nua_respond() nua: nua_respond: entering nua_stack.c:529 nua_signal() nua(0x7fda40039330): sent signal r_respond nua.c:921 nua_handle_destroy() nua: nua_handle_destroy: entering nua_stack.c:529 nua_signal() nua(0x7fda40039330): sent signal r_destroy nua.c:366 nua_handle_magic() nua: nua_handle_magic: entering nua.c:921 nua_handle_destroy() nua: nua_handle_destroy: entering nua_stack.c:573 nua_stack_signal() nua(0x7fda40039330): recv signal r_respond 200 OK

When it fails to respond, it is:

nta.c:3085 agent_recv_request() nta: REGISTER (108693) going to a default leg nua_server.c:102 nua_stack_process_request() nua: nua_stack_process_request: entering nua_stack.c:899 nh_create() nua: nh_create: entering nua_common.c:108 nh_create_handle() nua: nh_create_handle: entering nua_params.c:480 nua_stack_set_params() nua: nua_stack_set_params: entering soa.c:280 soa_clone() soa_clone(static::0x7fda40001930, 0x7fda40001130, 0x7fda402dc590) called soa.c:403 soa_set_params() soa_set_params(static::0x7fda4014f880, ...) called nua_stack.c:271 nua_stack_event() nua(0x7fda402dc590): event i_register 100 Trying nua_stack.c:359 nua_application_event() nua: nua_application_event: entering

It’s difficult to know which lines are related in the log, but when FS does not answer the 200 OK, I am definitely missing a line like:

nua_stack.c:529 nua_signal() nua(0x7fda40039330): sent signal r_respond

David Ponzone Direction Technique email: david.ponzone@ipeva.fr tel: 01 74 03 18 97 gsm: 06 66 98 76 34

Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr - www.ipeva-studio.com

Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

...

Le 17 mars 2017 à 23:08, Michael Jerris <mike@jerris.com> a écrit :

you can try sofia loglevel all 9

see if that tells you anything when we get one we don't respond to... also get latest 1.6 and see if that helps On Fri, Mar 17, 2017 at 5:19 PM David Villasmil <david.villasmil.work@gmail.com> wrote: How's the memory use? On Fri, Mar 17, 2017 at 10:09 PM David Ponzone <david.ponzone@ipeva.fr> wrote: All,

I noticed recently that sometimes FS (1.6.6) does not honor REGISTER or OPTIONS requests coming from some customers. Those customers register every 30 seconds, and FS does not answer to around 20-30 REGISTERs each day. I am trying to understand that, as the server is far from loaded (max 100 concurrent calls on a Dell R610).

Can anyone recommend some debugging steps to try to narrow this down ? Any known issue of this sort in 1.6.6 ?

Thank you

David Ponzone Direction Technique email: david.ponzone@ipeva.fr tel: 01 74 03 18 97 gsm: 06 66 98 76 34

Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr - www.ipeva-studio.com

Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com

Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org _________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com

Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org _________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com

Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com

Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org

It sounds like database blocking to me. You’d need to confirm by getting a core file while its blocking or by adding some more debug.

On Mar 21, 2017, at 5:03 AM, David Ponzone <david.ponzone@ipeva.fr> wrote:

Abdullah,

Actually, I have the ESL events (sofia::register_attempt and sofia::register) but they show up 5 seconds after the initial REGISTER. When they show up, I can see the 200 OK being sent to the client right away. So it’s like nua_application_event is calling the mod_sofia callback with a delay.

I can also confirm that during this frozen moment, another profile listening on port 5080 is normally answering to INVITE requests. This would suggest that the issue is related only to this specific profile listening on 5070, not to all profiles.

I will move core-db to tmpfs, as anyway it can only improve the overall performances. I will then upgrade to latest 1.6. Unless you see another option… I am opened to suggestions as it’s possible that some debug/logging is currently missing in FS as the logs should say why it’s stalling for 4-5 seconds. It’s not having a significant impact at the moment, so I can « play » a little bit with it.

David Ponzone Direction Technique email: david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr> tel: 01 74 03 18 97 gsm: 06 66 98 76 34

Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr <blocked::http://www.ipeva.fr/> - www.ipeva-studio.com <blocked::http://www.ipeva-studio.com/>

Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

...

Le 19 mars 2017 à 14:35, Vallimamod Abdullah <vma@vallimamod.org <mailto:vma@vallimamod.org>> a écrit :

Hi,

...

nta.c:3012 agent_recv_request() nta: OPTIONS (102) going to existing OPTIONS transaction nta.c:3012 agent_recv_request() nta: REGISTER (116849) going to existing REGISTER transaction

These means that sofia is considering these requests as retransmissions (transaction found in sofia's internal htable). In this case, you should also see a retransmission log like "nta: re-received %s request, retransmitting %u reply".

The nua_application_event is calling a mod_sofia callback for incoming register request. So it looks like mod_sofia does not answer for some reason. Can you check if you get the following esl custom events: "sofia::register_attempt", "sofia::pre_register" and "sofia::register" for the failed register? It will help to tell at which point the processing stops.

Also, is your core-db in-memory? If not, you may try to move it in ram.

Best Regards, Vallimamod .

-- Vallimamod Abdullah SIP Solutions vma@sipsolutions.fr <mailto:vma@sipsolutions.fr> tel:+33662606897 .

...

On 18 Mar 2017, at 20:04, David Ponzone <david.ponzone@ipeva.fr> wrote:

Mike,

with sofia loglevel all 9, I can see that sometimes (frequency hard to guess), during 4-5 secondes, FS writes those messages in the log for each REGISTER or OPTIONS request:

nta.c:3012 agent_recv_request() nta: OPTIONS (102) going to existing OPTIONS transaction nta.c:3012 agent_recv_request() nta: REGISTER (116849) going to existing REGISTER transaction

It’s like it considers it’s already dealing with a such request (which it never replied to).

A typical regular flow of logs for a REGISTER which was responded to is:

nta.c:3085 agent_recv_request() nta: REGISTER (108692) going to a default leg nua_server.c:102 nua_stack_process_request() nua: nua_stack_process_request: entering nua_stack.c:899 nh_create() nua: nh_create: entering nua_common.c:108 nh_create_handle() nua: nh_create_handle: entering nua_params.c:480 nua_stack_set_params() nua: nua_stack_set_params: entering soa.c:280 soa_clone() soa_clone(static::0x7fda40001930, 0x7fda40001130, 0x7fda40039330) called soa.c:403 soa_set_params() soa_set_params(static::0x7fda40207f40, ...) called nua_stack.c:271 nua_stack_event() nua(0x7fda40039330): event i_register 100 Trying nua_stack.c:359 nua_application_event() nua: nua_application_event: entering nua.c:366 nua_handle_magic() nua: nua_handle_magic: entering nua.c:879 nua_respond() nua: nua_respond: entering nua_stack.c:529 nua_signal() nua(0x7fda40039330): sent signal r_respond nua.c:921 nua_handle_destroy() nua: nua_handle_destroy: entering nua_stack.c:529 nua_signal() nua(0x7fda40039330): sent signal r_destroy nua.c:366 nua_handle_magic() nua: nua_handle_magic: entering nua.c:921 nua_handle_destroy() nua: nua_handle_destroy: entering nua_stack.c:573 nua_stack_signal() nua(0x7fda40039330): recv signal r_respond 200 OK

When it fails to respond, it is:

nta.c:3085 agent_recv_request() nta: REGISTER (108693) going to a default leg nua_server.c:102 nua_stack_process_request() nua: nua_stack_process_request: entering nua_stack.c:899 nh_create() nua: nh_create: entering nua_common.c:108 nh_create_handle() nua: nh_create_handle: entering nua_params.c:480 nua_stack_set_params() nua: nua_stack_set_params: entering soa.c:280 soa_clone() soa_clone(static::0x7fda40001930, 0x7fda40001130, 0x7fda402dc590) called soa.c:403 soa_set_params() soa_set_params(static::0x7fda4014f880, ...) called nua_stack.c:271 nua_stack_event() nua(0x7fda402dc590): event i_register 100 Trying nua_stack.c:359 nua_application_event() nua: nua_application_event: entering

It’s difficult to know which lines are related in the log, but when FS does not answer the 200 OK, I am definitely missing a line like:

nua_stack.c:529 nua_signal() nua(0x7fda40039330): sent signal r_respond

David Ponzone Direction Technique email: david.ponzone@ipeva.fr tel: 01 74 03 18 97 gsm: 06 66 98 76 34

Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr - www.ipeva-studio.com

Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

...

Le 17 mars 2017 à 23:08, Michael Jerris <mike@jerris.com> a écrit :

you can try sofia loglevel all 9

see if that tells you anything when we get one we don't respond to... also get latest 1.6 and see if that helps On Fri, Mar 17, 2017 at 5:19 PM David Villasmil <david.villasmil.work@gmail.com> wrote: How's the memory use? On Fri, Mar 17, 2017 at 10:09 PM David Ponzone <david.ponzone@ipeva.fr> wrote: All,

I noticed recently that sometimes FS (1.6.6) does not honor REGISTER or OPTIONS requests coming from some customers. Those customers register every 30 seconds, and FS does not answer to around 20-30 REGISTERs each day. I am trying to understand that, as the server is far from loaded (max 100 concurrent calls on a Dell R610).

Can anyone recommend some debugging steps to try to narrow this down ? Any known issue of this sort in 1.6.6 ?

Thank you

David Ponzone Direction Technique email: david.ponzone@ipeva.fr tel: 01 74 03 18 97 gsm: 06 66 98 76 34

Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr - www.ipeva-studio.com

Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com

Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org _________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com

Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org _________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com

Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com

Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com

Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com

Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org

I use purely static config files for directory. I upgraded to 1.6.15 and moved core-db to tmpfs, and interestingly, the issue is still there. It just happened in front of my eyes (I have a tail -F log/freeswitch.log | grep 'existing REGISTER’ running, and a tshark on port 5070 at the same time). David Ponzone Direction Technique email: david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr> tel: 01 74 03 18 97 gsm: 06 66 98 76 34 Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr <blocked::http://www.ipeva.fr/> - www.ipeva-studio.com <blocked::http://www.ipeva-studio.com/> Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

Le 21 mars 2017 à 14:27, Vallimamod Abdullah <vma@vallimamod.org> a écrit :

Hi,

The sofia::register_attempt is sent just after authenticating the user. So the 5s delay you have would imply that freeswitch is having trouble getting the directory data. It would also explain the retransmission logs you see in libsofia.

Do you use xml-curl or any dynamic directory lookup? If not, the best move is, as you said, to update to latest 1.6 with tmpfs core-db and test again.

Best Regards, -- Vallimamod Abdullah SIP Solutions vma@sipsolutions.fr tel:+33662606897 .

...

On 21 Mar 2017, at 10:03, David Ponzone <david.ponzone@ipeva.fr> wrote:

Abdullah,

Actually, I have the ESL events (sofia::register_attempt and sofia::register) but they show up 5 seconds after the initial REGISTER. When they show up, I can see the 200 OK being sent to the client right away. So it’s like nua_application_event is calling the mod_sofia callback with a delay.

I can also confirm that during this frozen moment, another profile listening on port 5080 is normally answering to INVITE requests. This would suggest that the issue is related only to this specific profile listening on 5070, not to all profiles.

I will move core-db to tmpfs, as anyway it can only improve the overall performances. I will then upgrade to latest 1.6. Unless you see another option… I am opened to suggestions as it’s possible that some debug/logging is currently missing in FS as the logs should say why it’s stalling for 4-5 seconds. It’s not having a significant impact at the moment, so I can « play » a little bit with it.

David Ponzone Direction Technique email: david.ponzone@ipeva.fr tel: 01 74 03 18 97 gsm: 06 66 98 76 34

Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr - www.ipeva-studio.com

Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

...

Le 19 mars 2017 à 14:35, Vallimamod Abdullah <vma@vallimamod.org> a écrit :

Hi,

...

nta.c:3012 agent_recv_request() nta: OPTIONS (102) going to existing OPTIONS transaction nta.c:3012 agent_recv_request() nta: REGISTER (116849) going to existing REGISTER transaction

These means that sofia is considering these requests as retransmissions (transaction found in sofia's internal htable). In this case, you should also see a retransmission log like "nta: re-received %s request, retransmitting %u reply".

The nua_application_event is calling a mod_sofia callback for incoming register request. So it looks like mod_sofia does not answer for some reason. Can you check if you get the following esl custom events: "sofia::register_attempt", "sofia::pre_register" and "sofia::register" for the failed register? It will help to tell at which point the processing stops.

Also, is your core-db in-memory? If not, you may try to move it in ram.

Best Regards, Vallimamod .

-- Vallimamod Abdullah SIP Solutions vma@sipsolutions.fr tel:+33662606897 .

...

On 18 Mar 2017, at 20:04, David Ponzone <david.ponzone@ipeva.fr> wrote:

Mike,

with sofia loglevel all 9, I can see that sometimes (frequency hard to guess), during 4-5 secondes, FS writes those messages in the log for each REGISTER or OPTIONS request:

nta.c:3012 agent_recv_request() nta: OPTIONS (102) going to existing OPTIONS transaction nta.c:3012 agent_recv_request() nta: REGISTER (116849) going to existing REGISTER transaction

It’s like it considers it’s already dealing with a such request (which it never replied to).

A typical regular flow of logs for a REGISTER which was responded to is:

nta.c:3085 agent_recv_request() nta: REGISTER (108692) going to a default leg nua_server.c:102 nua_stack_process_request() nua: nua_stack_process_request: entering nua_stack.c:899 nh_create() nua: nh_create: entering nua_common.c:108 nh_create_handle() nua: nh_create_handle: entering nua_params.c:480 nua_stack_set_params() nua: nua_stack_set_params: entering soa.c:280 soa_clone() soa_clone(static::0x7fda40001930, 0x7fda40001130, 0x7fda40039330) called soa.c:403 soa_set_params() soa_set_params(static::0x7fda40207f40, ...) called nua_stack.c:271 nua_stack_event() nua(0x7fda40039330): event i_register 100 Trying nua_stack.c:359 nua_application_event() nua: nua_application_event: entering nua.c:366 nua_handle_magic() nua: nua_handle_magic: entering nua.c:879 nua_respond() nua: nua_respond: entering nua_stack.c:529 nua_signal() nua(0x7fda40039330): sent signal r_respond nua.c:921 nua_handle_destroy() nua: nua_handle_destroy: entering nua_stack.c:529 nua_signal() nua(0x7fda40039330): sent signal r_destroy nua.c:366 nua_handle_magic() nua: nua_handle_magic: entering nua.c:921 nua_handle_destroy() nua: nua_handle_destroy: entering nua_stack.c:573 nua_stack_signal() nua(0x7fda40039330): recv signal r_respond 200 OK

When it fails to respond, it is:

nta.c:3085 agent_recv_request() nta: REGISTER (108693) going to a default leg nua_server.c:102 nua_stack_process_request() nua: nua_stack_process_request: entering nua_stack.c:899 nh_create() nua: nh_create: entering nua_common.c:108 nh_create_handle() nua: nh_create_handle: entering nua_params.c:480 nua_stack_set_params() nua: nua_stack_set_params: entering soa.c:280 soa_clone() soa_clone(static::0x7fda40001930, 0x7fda40001130, 0x7fda402dc590) called soa.c:403 soa_set_params() soa_set_params(static::0x7fda4014f880, ...) called nua_stack.c:271 nua_stack_event() nua(0x7fda402dc590): event i_register 100 Trying nua_stack.c:359 nua_application_event() nua: nua_application_event: entering

It’s difficult to know which lines are related in the log, but when FS does not answer the 200 OK, I am definitely missing a line like:

nua_stack.c:529 nua_signal() nua(0x7fda40039330): sent signal r_respond

David Ponzone Direction Technique email: david.ponzone@ipeva.fr tel: 01 74 03 18 97 gsm: 06 66 98 76 34

Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr - www.ipeva-studio.com

Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

...

Le 17 mars 2017 à 23:08, Michael Jerris <mike@jerris.com> a écrit :

you can try sofia loglevel all 9

see if that tells you anything when we get one we don't respond to... also get latest 1.6 and see if that helps On Fri, Mar 17, 2017 at 5:19 PM David Villasmil <david.villasmil.work@gmail.com> wrote: How's the memory use? On Fri, Mar 17, 2017 at 10:09 PM David Ponzone <david.ponzone@ipeva.fr> wrote: All,

I noticed recently that sometimes FS (1.6.6) does not honor REGISTER or OPTIONS requests coming from some customers. Those customers register every 30 seconds, and FS does not answer to around 20-30 REGISTERs each day. I am trying to understand that, as the server is far from loaded (max 100 concurrent calls on a Dell R610).

Can anyone recommend some debugging steps to try to narrow this down ? Any known issue of this sort in 1.6.6 ?

Thank you

David Ponzone Direction Technique email: david.ponzone@ipeva.fr tel: 01 74 03 18 97 gsm: 06 66 98 76 34

Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr - www.ipeva-studio.com

Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com

Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org

Hi, That's very strange. Especially for options as the fsw reply 200 ok without any specific check (actually, only if the profile param sip-options-respond-503-on-busy is not set. You may re-test after disabling this param if it is set, but I am not sure it will make any difference.) Have you noticed any difference between the failed REGISTER or OPTIONS requests and the normal ones? Is it happening only for one customer or indifferently? Also you said that you had no pb with another profile running on port 5080. Is it possible for you to test a failing customer with that profile? Best Regards, -- Vallimamod Abdullah SIP Solutions vma@sipsolutions.fr tel:+33662606897 .

On 22 Mar 2017, at 11:57, David Ponzone <david.ponzone@ipeva.fr> wrote:

I can now confirm that while FS does not reply to REGISTER/OPTIONS/NOTIFY requests, it replies to INVITE/CANCEL requests normally.

David Ponzone Direction Technique email: david.ponzone@ipeva.fr tel: 01 74 03 18 97 gsm: 06 66 98 76 34

Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr - www.ipeva-studio.com

Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

...

Le 22 mars 2017 à 08:22, David Ponzone <david.ponzone@ipeva.fr> a écrit :

I use purely static config files for directory. I upgraded to 1.6.15 and moved core-db to tmpfs, and interestingly, the issue is still there. It just happened in front of my eyes (I have a tail -F log/freeswitch.log | grep 'existing REGISTER’ running, and a tshark on port 5070 at the same time).

David Ponzone Direction Technique email: david.ponzone@ipeva.fr tel: 01 74 03 18 97 gsm: 06 66 98 76 34

Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr - www.ipeva-studio.com

Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

...

Le 21 mars 2017 à 14:27, Vallimamod Abdullah <vma@vallimamod.org> a écrit :

Hi,

The sofia::register_attempt is sent just after authenticating the user. So the 5s delay you have would imply that freeswitch is having trouble getting the directory data. It would also explain the retransmission logs you see in libsofia.

Do you use xml-curl or any dynamic directory lookup? If not, the best move is, as you said, to update to latest 1.6 with tmpfs core-db and test again.

Best Regards, -- Vallimamod Abdullah SIP Solutions vma@sipsolutions.fr tel:+33662606897 .

...

On 21 Mar 2017, at 10:03, David Ponzone <david.ponzone@ipeva.fr> wrote:

Abdullah,

Actually, I have the ESL events (sofia::register_attempt and sofia::register) but they show up 5 seconds after the initial REGISTER. When they show up, I can see the 200 OK being sent to the client right away. So it’s like nua_application_event is calling the mod_sofia callback with a delay.

I can also confirm that during this frozen moment, another profile listening on port 5080 is normally answering to INVITE requests. This would suggest that the issue is related only to this specific profile listening on 5070, not to all profiles.

I will move core-db to tmpfs, as anyway it can only improve the overall performances. I will then upgrade to latest 1.6. Unless you see another option… I am opened to suggestions as it’s possible that some debug/logging is currently missing in FS as the logs should say why it’s stalling for 4-5 seconds. It’s not having a significant impact at the moment, so I can « play » a little bit with it.

David Ponzone Direction Technique email: david.ponzone@ipeva.fr tel: 01 74 03 18 97 gsm: 06 66 98 76 34

Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr - www.ipeva-studio.com

Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

...

Le 19 mars 2017 à 14:35, Vallimamod Abdullah <vma@vallimamod.org> a écrit :

Hi,

...

nta.c:3012 agent_recv_request() nta: OPTIONS (102) going to existing OPTIONS transaction nta.c:3012 agent_recv_request() nta: REGISTER (116849) going to existing REGISTER transaction

These means that sofia is considering these requests as retransmissions (transaction found in sofia's internal htable). In this case, you should also see a retransmission log like "nta: re-received %s request, retransmitting %u reply".

The nua_application_event is calling a mod_sofia callback for incoming register request. So it looks like mod_sofia does not answer for some reason. Can you check if you get the following esl custom events: "sofia::register_attempt", "sofia::pre_register" and "sofia::register" for the failed register? It will help to tell at which point the processing stops.

Also, is your core-db in-memory? If not, you may try to move it in ram.

Best Regards, Vallimamod .

-- Vallimamod Abdullah SIP Solutions vma@sipsolutions.fr tel:+33662606897 .

...

On 18 Mar 2017, at 20:04, David Ponzone <david.ponzone@ipeva.fr> wrote:

Mike,

with sofia loglevel all 9, I can see that sometimes (frequency hard to guess), during 4-5 secondes, FS writes those messages in the log for each REGISTER or OPTIONS request:

nta.c:3012 agent_recv_request() nta: OPTIONS (102) going to existing OPTIONS transaction nta.c:3012 agent_recv_request() nta: REGISTER (116849) going to existing REGISTER transaction

It’s like it considers it’s already dealing with a such request (which it never replied to).

A typical regular flow of logs for a REGISTER which was responded to is:

nta.c:3085 agent_recv_request() nta: REGISTER (108692) going to a default leg nua_server.c:102 nua_stack_process_request() nua: nua_stack_process_request: entering nua_stack.c:899 nh_create() nua: nh_create: entering nua_common.c:108 nh_create_handle() nua: nh_create_handle: entering nua_params.c:480 nua_stack_set_params() nua: nua_stack_set_params: entering soa.c:280 soa_clone() soa_clone(static::0x7fda40001930, 0x7fda40001130, 0x7fda40039330) called soa.c:403 soa_set_params() soa_set_params(static::0x7fda40207f40, ...) called nua_stack.c:271 nua_stack_event() nua(0x7fda40039330): event i_register 100 Trying nua_stack.c:359 nua_application_event() nua: nua_application_event: entering nua.c:366 nua_handle_magic() nua: nua_handle_magic: entering nua.c:879 nua_respond() nua: nua_respond: entering nua_stack.c:529 nua_signal() nua(0x7fda40039330): sent signal r_respond nua.c:921 nua_handle_destroy() nua: nua_handle_destroy: entering nua_stack.c:529 nua_signal() nua(0x7fda40039330): sent signal r_destroy nua.c:366 nua_handle_magic() nua: nua_handle_magic: entering nua.c:921 nua_handle_destroy() nua: nua_handle_destroy: entering nua_stack.c:573 nua_stack_signal() nua(0x7fda40039330): recv signal r_respond 200 OK

When it fails to respond, it is:

nta.c:3085 agent_recv_request() nta: REGISTER (108693) going to a default leg nua_server.c:102 nua_stack_process_request() nua: nua_stack_process_request: entering nua_stack.c:899 nh_create() nua: nh_create: entering nua_common.c:108 nh_create_handle() nua: nh_create_handle: entering nua_params.c:480 nua_stack_set_params() nua: nua_stack_set_params: entering soa.c:280 soa_clone() soa_clone(static::0x7fda40001930, 0x7fda40001130, 0x7fda402dc590) called soa.c:403 soa_set_params() soa_set_params(static::0x7fda4014f880, ...) called nua_stack.c:271 nua_stack_event() nua(0x7fda402dc590): event i_register 100 Trying nua_stack.c:359 nua_application_event() nua: nua_application_event: entering

It’s difficult to know which lines are related in the log, but when FS does not answer the 200 OK, I am definitely missing a line like:

nua_stack.c:529 nua_signal() nua(0x7fda40039330): sent signal r_respond

David Ponzone Direction Technique email: david.ponzone@ipeva.fr tel: 01 74 03 18 97 gsm: 06 66 98 76 34

Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr - www.ipeva-studio.com

Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

> Le 17 mars 2017 à 23:08, Michael Jerris <mike@jerris.com> a écrit : > > you can try sofia loglevel all 9 > > see if that tells you anything when we get one we don't respond to... also get latest 1.6 and see if that helps > On Fri, Mar 17, 2017 at 5:19 PM David Villasmil <david.villasmil.work@gmail.com> wrote: > How's the memory use? > On Fri, Mar 17, 2017 at 10:09 PM David Ponzone <david.ponzone@ipeva.fr> wrote: > All, > > I noticed recently that sometimes FS (1.6.6) does not honor REGISTER or OPTIONS requests coming from some customers. > Those customers register every 30 seconds, and FS does not answer to around 20-30 REGISTERs each day. > I am trying to understand that, as the server is far from loaded (max 100 concurrent calls on a Dell R610). > > Can anyone recommend some debugging steps to try to narrow this down ? > Any known issue of this sort in 1.6.6 ? > > Thank you > > David Ponzone Direction Technique > email: david.ponzone@ipeva.fr > tel: 01 74 03 18 97 > gsm: 06 66 98 76 34 > > Service Client IPeva > tel: 0811 46 26 26 > www.ipeva.fr - www.ipeva-studio.com > > Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur. >

Just wondering, how many users do you have registered? On Mon, Mar 27, 2017 at 2:05 PM David Ponzone <david.ponzone@ipeva.fr> wrote:

Abdullah,

Le 22 mars 2017 à 12:59, Vallimamod Abdullah <vma@vallimamod.org> a écrit :

That's very strange. Especially for options as the fsw reply 200 ok without any specific check (actually, only if the profile param sip-options-respond-503-on-busy is not set. You may re-test after disabling this param if it is set, but I am not sure it will make any difference.)

It’s not set.

Have you noticed any difference between the failed REGISTER or OPTIONS requests and the normal ones?

Nope, but I’ll try to check again.

Is it happening only for one customer or indifferently?

Indifferently. When it freezes for 4-5 seconds, I can see REGISTER attempts coming from several customers that remain unanswered.

Also you said that you had no pb with another profile running on port 5080. Is it possible for you to test a failing customer with that profile?

The other profiles don’t allow REGISTER. I created a new profile allowing REGISTER on port 5072, and it’s the same. That means it doesn’t come from iptables as I have no filters on port 5072 at the moment.

Best Regards, -- Vallimamod Abdullah SIP Solutions vma@sipsolutions.fr tel:+33662606897 .

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com

Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org

Really weird, you need to do some deep debugging with Sofia debug... i have ~3500 registrations working ok. On Mon, Mar 27, 2017 at 5:23 PM David Ponzone <david.ponzone@ipeva.fr> wrote:

On this box, around 30.

David Ponzone Direction Technique email: david.ponzone@ipeva.fr tel: 01 74 03 18 97 gsm: 06 66 98 76 34

Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr - www.ipeva-studio.com

*Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. **IPeva** décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.*

Le 27 mars 2017 à 14:27, David Villasmil <david.villasmil.work@gmail.com> a écrit :

Just wondering, how many users do you have registered? On Mon, Mar 27, 2017 at 2:05 PM David Ponzone <david.ponzone@ipeva.fr> wrote:

Abdullah,

Le 22 mars 2017 à 12:59, Vallimamod Abdullah <vma@vallimamod.org> a écrit :

That's very strange. Especially for options as the fsw reply 200 ok without any specific check (actually, only if the profile param sip-options-respond-503-on-busy is not set. You may re-test after disabling this param if it is set, but I am not sure it will make any difference.)

It’s not set.

Have you noticed any difference between the failed REGISTER or OPTIONS requests and the normal ones?

Nope, but I’ll try to check again.

Is it happening only for one customer or indifferently?

Indifferently. When it freezes for 4-5 seconds, I can see REGISTER attempts coming from several customers that remain unanswered.

Also you said that you had no pb with another profile running on port 5080. Is it possible for you to test a failing customer with that profile?

The other profiles don’t allow REGISTER. I created a new profile allowing REGISTER on port 5072, and it’s the same. That means it doesn’t come from iptables as I have no filters on port 5072 at the moment.

Best Regards, -- Vallimamod Abdullah SIP Solutions vma@sipsolutions.fr tel:+33662606897 <+33662606897> .

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com

Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com

Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com

Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org

Brian, I know, and I checked that. I have some anti-DOS iptables rules on port 5070. But I have nothing filtering on port 5072 and the issue is still there. No fail2ban activity neither. David Ponzone Direction Technique email: david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr> tel: 01 74 03 18 97 gsm: 06 66 98 76 34 Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr <blocked::http://www.ipeva.fr/> - www.ipeva-studio.com <blocked::http://www.ipeva-studio.com/> Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

Le 27 mars 2017 à 18:58, Brian West <brian@freeswitch.org> a écrit :

Just a reminder, You'll see packets in wireshark even if the firewall is up, So this does sound like an iptables snafu. I can't count the times this one has gotten me.

/b

On Mon, Mar 27, 2017 at 10:28 AM, David Villasmil <david.villasmil.work@gmail.com <mailto:david.villasmil.work@gmail.com>> wrote: Really weird, you need to do some deep debugging with Sofia debug... i have ~3500 registrations working ok.

On Mon, Mar 27, 2017 at 5:23 PM David Ponzone <david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr>> wrote: On this box, around 30.

David Ponzone Direction Technique email: david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr> tel: 01 74 03 18 97 gsm: 06 66 98 76 34

Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr <> - www.ipeva-studio.com <>

Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

...

Le 27 mars 2017 à 14:27, David Villasmil <david.villasmil.work@gmail.com <mailto:david.villasmil.work@gmail.com>> a écrit :

Just wondering, how many users do you have registered? On Mon, Mar 27, 2017 at 2:05 PM David Ponzone <david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr>> wrote: Abdullah,

...

Le 22 mars 2017 à 12:59, Vallimamod Abdullah <vma@vallimamod.org <mailto:vma@vallimamod.org>> a écrit :

...

That's very strange. Especially for options as the fsw reply 200 ok without any specific check (actually, only if the profile param sip-options-respond-503-on-busy is not set. You may re-test after disabling this param if it is set, but I am not sure it will make any difference.)

It’s not set.

...

Have you noticed any difference between the failed REGISTER or OPTIONS requests and the normal ones?

Nope, but I’ll try to check again.

...

Is it happening only for one customer or indifferently?

Indifferently. When it freezes for 4-5 seconds, I can see REGISTER attempts coming from several customers that remain unanswered.

...

Also you said that you had no pb with another profile running on port 5080. Is it possible for you to test a failing customer with that profile?

The other profiles don’t allow REGISTER. I created a new profile allowing REGISTER on port 5072, and it’s the same. That means it doesn’t come from iptables as I have no filters on port 5072 at the moment.

...

Best Regards, -- Vallimamod Abdullah SIP Solutions vma@sipsolutions.fr <mailto:vma@sipsolutions.fr> tel:+33662606897 <tel:+33662606897> .

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>

Official FreeSWITCH Sites http://www.freeswitch.org <http://www.freeswitch.org/> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users> http://www.freeswitch.org <http://www.freeswitch.org/>_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>

Official FreeSWITCH Sites http://www.freeswitch.org <http://www.freeswitch.org/> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users> http://www.freeswitch.org <http://www.freeswitch.org/>

---

Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>

Official FreeSWITCH Sites http://www.freeswitch.org <http://www.freeswitch.org/> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users> http://www.freeswitch.org <http://www.freeswitch.org/> _________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>

Official FreeSWITCH Sites http://www.freeswitch.org <http://www.freeswitch.org/> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users> http://www.freeswitch.org <http://www.freeswitch.org/>

-- Brian West brian@freeswitch.org <mailto:brian@freeswitch.org> Twitter: @FreeSWITCH , @briankwest

http://www.freeswitchbook.com <http://www.freeswitchbook.com/> http://www.freeswitchcookbook.com <http://www.freeswitchcookbook.com/>

Allison prompts for FreeSWITCH:

https://www.gofundme.com/allison-prompts-for-freeswitch <https://www.gofundme.com/allison-prompts-for-freeswitch> Got Bugs? Report them here <https://freeswitch.org/jira>! | Reddit: /r/freeswitch <https://www.reddit.com/r/freeswitch> T:+19184209001 | F:+19184209002 | M:+1918424WEST (9378) Skype:briankwest

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com

Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org

hi, Not sure if already answer, try yo set: fs_cli -x "sofia global siptrace on" fs_cli -x "fsctl debug_level 10" fs_cli -x "sofia loglevel all 9" fs_cli -x "sofia tracelevel alert " fs_cli -x "fsctl debug_sql " fs_cli -x "sofia global debug presence" Did you try last git master? On 03/28/2017 09:30 AM, David Ponzone wrote:

Brian,

would you have any recommended actions to try to debug REGISTER requests at the sofia level ? fsctl debug_level 9 does not help as I can’t see any logs from sofia_reg.c

David PonzoneDirection Technique email: david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr> tel: 01 74 03 18 97 gsm: 06 66 98 76 34

Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr <blocked::http://www.ipeva.fr/> - www.ipeva-studio.com <blocked::http://www.ipeva-studio.com/>

/Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. /*/IPeva/*/ décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur./ / /

...

Le 27 mars 2017 à 18:58, Brian West <brian@freeswitch.org <mailto:brian@freeswitch.org>> a écrit :

Just a reminder, You'll see packets in wireshark even if the firewall is up, So this does sound like an iptables snafu. I can't count the times this one has gotten me.

/b

On Mon, Mar 27, 2017 at 10:28 AM, David Villasmil <david.villasmil.work@gmail.com <mailto:david.villasmil.work@gmail.com>> wrote:

Really weird, you need to do some deep debugging with Sofia debug... i have ~3500 registrations working ok.

On Mon, Mar 27, 2017 at 5:23 PM David Ponzone <david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr>> wrote:

On this box, around 30.

David PonzoneDirection Technique email: david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr> tel: 01 74 03 18 97 gsm: 06 66 98 76 34

Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr- www.ipeva-studio.com

/Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. /*/IPeva/*/ décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur./ / /

...

Le 27 mars 2017 à 14:27, David Villasmil <david.villasmil.work@gmail.com <mailto:david.villasmil.work@gmail.com>> a écrit :

Just wondering, how many users do you have registered? On Mon, Mar 27, 2017 at 2:05 PM David Ponzone <david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr>> wrote:

Abdullah,

...

Le 22 mars 2017 à 12:59, Vallimamod Abdullah <vma@vallimamod.org <mailto:vma@vallimamod.org>> a écrit :

...

That's very strange. Especially for options as the fsw reply 200 ok without any specific check (actually, only if the profile param sip-options-respond-503-on-busy is not set. You may re-test after disabling this param if it is set, but I am not sure it will make any difference.)

It’s not set.

...

Have you noticed any difference between the failed REGISTER or OPTIONS requests and the normal ones?

Nope, but I’ll try to check again.

...

Is it happening only for one customer or indifferently?

Indifferently. When it freezes for 4-5 seconds, I can see REGISTER attempts coming from several customers that remain unanswered.

...

Also you said that you had no pb with another profile running on port 5080. Is it possible for you to test a failing customer with that profile?

The other profiles don’t allow REGISTER. I created a new profile allowing REGISTER on port 5072, and it’s the same. That means it doesn’t come from iptables as I have no filters on port 5072 at the moment.

...

Best Regards, -- Vallimamod Abdullah SIP Solutions vma@sipsolutions.fr <mailto:vma@sipsolutions.fr> tel:+33662606897 .

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>

Official FreeSWITCH Sites http://www.freeswitch.org <http://www.freeswitch.org/> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users> http://www.freeswitch.org <http://www.freeswitch.org/>

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>

Official FreeSWITCH Sites http://www.freeswitch.org <http://www.freeswitch.org/> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users> http://www.freeswitch.org <http://www.freeswitch.org/>

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>

Official FreeSWITCH Sites http://www.freeswitch.org <http://www.freeswitch.org/> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users> http://www.freeswitch.org <http://www.freeswitch.org/>

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>

Official FreeSWITCH Sites http://www.freeswitch.org <http://www.freeswitch.org/> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users> http://www.freeswitch.org <http://www.freeswitch.org/>

--

*/Brian West/* brian@freeswitch.org <mailto:brian@freeswitch.org>

*/Twitter: @FreeSWITCH , @briankwest/*

http://www.freeswitchbook.com <http://www.freeswitchbook.com/> http://www.freeswitchcookbook.com <http://www.freeswitchcookbook.com/>

Allison prompts for FreeSWITCH:

*https://www.gofundme.com/allison-prompts-for-freeswitch*

Got Bugs? Report them here <https://freeswitch.org/jira>! | Reddit: /r/freeswitch <https://www.reddit.com/r/freeswitch>

*T:*+19184209001 | *F:*+19184209002 | *M:*+1918424WEST (9378) *Skype:*briankwest

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com

Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com

Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org

-- Saludos / Regards / Cumprimentos, António silva

With all debug enabled for switch_core_sqldb.c in mod_logfile, I don’t see anything relevant when the issue happens: the usual CORE RUN QUEUE lines and quite a bunch of lines: switch_core_sqldb.c:1791 Reuse Unused Cached DB handle db="sofia_reg_with_auth-5072",type="core_db" [CORE_DB] but I have quite a bunch of them all the time. Nothing particular. If anyone can recommend a debug level which could allow me to pinpoint this… David Ponzone Direction Technique email: david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr> tel: 01 74 03 18 97 gsm: 06 66 98 76 34 Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr <blocked::http://www.ipeva.fr/> - www.ipeva-studio.com <blocked::http://www.ipeva-studio.com/> Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

Le 28 mars 2017 à 17:50, David Ponzone <david.ponzone@ipeva.fr> a écrit :

fsctl debug_sql while the issue happened between 17:45:16 and 17:45:20

2017-03-28 17:45:15.571490 [CRIT] switch_core_sqldb.c:2127 CORE RUN QUEUE [0|0|0|0]--[24] 2017-03-28 17:45:16.031560 [CRIT] switch_core_sqldb.c:2127 CORE RUN QUEUE [0|0|0|0]--[20] 2017-03-28 17:45:16.551552 [CRIT] switch_core_sqldb.c:2127 CORE RUN QUEUE [0|0|0|0]--[15] 2017-03-28 17:45:16.831522 [CRIT] switch_core_sqldb.c:2127 CORE RUN QUEUE [0|0|0|0]--[15] 2017-03-28 17:45:17.071520 [CRIT] switch_core_sqldb.c:2127 CORE RUN QUEUE [0|0|0|0]--[18] 2017-03-28 17:45:17.691518 [CRIT] switch_core_sqldb.c:2127 CORE RUN QUEUE [0|0|0|0]--[16] 2017-03-28 17:45:18.191518 [CRIT] switch_core_sqldb.c:2127 CORE RUN QUEUE [0|0|0|0]--[1] 2017-03-28 17:45:18.471519 [CRIT] switch_core_sqldb.c:2127 CORE RUN QUEUE [0|0|0|0]--[40] 2017-03-28 17:45:19.971548 [CRIT] switch_core_sqldb.c:2127 CORE RUN QUEUE [0|0|0|0]--[6] 2017-03-28 17:45:20.191520 [CRIT] switch_core_sqldb.c:2127 CORE RUN QUEUE [0|0|0|0]--[44] 2017-03-28 17:45:20.791514 [CRIT] switch_core_sqldb.c:2127 CORE RUN QUEUE [0|0|0|0]--[18] 2017-03-28 17:45:21.111494 [CRIT] switch_core_sqldb.c:2127 CORE RUN QUEUE [0|0|0|0]--[4]

I don’t see anything odd.

I added more debug logs, hoping to get something useful…

David Ponzone Direction Technique email: david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr> tel: 01 74 03 18 97 gsm: 06 66 98 76 34

Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr <blocked::http://www.ipeva.fr/> - www.ipeva-studio.com <blocked::http://www.ipeva-studio.com/>

Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

...

Le 28 mars 2017 à 10:05, Antonio Silva <asilva@wirelessmundi.com <mailto:asilva@wirelessmundi.com>> a écrit :

hi,

Not sure if already answer, try yo set:

fs_cli -x "sofia global siptrace on" fs_cli -x "fsctl debug_level 10" fs_cli -x "sofia loglevel all 9" fs_cli -x "sofia tracelevel alert " fs_cli -x "fsctl debug_sql " fs_cli -x "sofia global debug presence"

Did you try last git master?

On 03/28/2017 09:30 AM, David Ponzone wrote:

...

Brian,

would you have any recommended actions to try to debug REGISTER requests at the sofia level ? fsctl debug_level 9 does not help as I can’t see any logs from sofia_reg.c

David Ponzone Direction Technique email: david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr> tel: 01 74 03 18 97 gsm: 06 66 98 76 34

Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr <blocked::http://www.ipeva.fr/> - www.ipeva-studio.com <blocked::http://www.ipeva-studio.com/>

Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

...

Le 27 mars 2017 à 18:58, Brian West <brian@freeswitch.org <mailto:brian@freeswitch.org>> a écrit :

Just a reminder, You'll see packets in wireshark even if the firewall is up, So this does sound like an iptables snafu. I can't count the times this one has gotten me.

/b

On Mon, Mar 27, 2017 at 10:28 AM, David Villasmil <david.villasmil.work@gmail.com <mailto:david.villasmil.work@gmail.com>> wrote: Really weird, you need to do some deep debugging with Sofia debug... i have ~3500 registrations working ok.

On Mon, Mar 27, 2017 at 5:23 PM David Ponzone <david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr>> wrote: On this box, around 30.

David Ponzone Direction Technique email: david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr> tel: 01 74 03 18 97 gsm: 06 66 98 76 34

Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr <> - www.ipeva-studio.com <>

Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

...

Le 27 mars 2017 à 14:27, David Villasmil <david.villasmil.work@gmail.com <mailto:david.villasmil.work@gmail.com>> a écrit :

Just wondering, how many users do you have registered? On Mon, Mar 27, 2017 at 2:05 PM David Ponzone <david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr>> wrote: Abdullah,

...

Le 22 mars 2017 à 12:59, Vallimamod Abdullah <vma@vallimamod.org <mailto:vma@vallimamod.org>> a écrit :

...

That's very strange. Especially for options as the fsw reply 200 ok without any specific check (actually, only if the profile param sip-options-respond-503-on-busy is not set. You may re-test after disabling this param if it is set, but I am not sure it will make any difference.)

It’s not set.

...

Have you noticed any difference between the failed REGISTER or OPTIONS requests and the normal ones?

Nope, but I’ll try to check again.

...

Is it happening only for one customer or indifferently?

Indifferently. When it freezes for 4-5 seconds, I can see REGISTER attempts coming from several customers that remain unanswered.

...

Also you said that you had no pb with another profile running on port 5080. Is it possible for you to test a failing customer with that profile?

The other profiles don’t allow REGISTER. I created a new profile allowing REGISTER on port 5072, and it’s the same. That means it doesn’t come from iptables as I have no filters on port 5072 at the moment.

...

Best Regards, -- Vallimamod Abdullah SIP Solutions vma@sipsolutions.fr <mailto:vma@sipsolutions.fr> tel:+33662606897 <tel:+33662606897> .

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>

Official FreeSWITCH Sites http://www.freeswitch.org <http://www.freeswitch.org/> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users> http://www.freeswitch.org <http://www.freeswitch.org/>_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>

Official FreeSWITCH Sites http://www.freeswitch.org <http://www.freeswitch.org/> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users> http://www.freeswitch.org <http://www.freeswitch.org/>

---

Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>

Official FreeSWITCH Sites http://www.freeswitch.org <http://www.freeswitch.org/> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users> http://www.freeswitch.org <http://www.freeswitch.org/> _________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>

Official FreeSWITCH Sites http://www.freeswitch.org <http://www.freeswitch.org/> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users> http://www.freeswitch.org <http://www.freeswitch.org/>

-- Brian West brian@freeswitch.org <mailto:brian@freeswitch.org> Twitter: @FreeSWITCH , @briankwest

http://www.freeswitchbook.com <http://www.freeswitchbook.com/> http://www.freeswitchcookbook.com <http://www.freeswitchcookbook.com/>

Allison prompts for FreeSWITCH:

https://www.gofundme.com/allison-prompts-for-freeswitch <https://www.gofundme.com/allison-prompts-for-freeswitch> Got Bugs? Report them here <https://freeswitch.org/jira>! | Reddit: /r/freeswitch <https://www.reddit.com/r/freeswitch> T:+19184209001 | F:+19184209002 | M:+1918424WEST (9378) Skype:briankwest

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>

Official FreeSWITCH Sites http://www.freeswitch.org <http://www.freeswitch.org/> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users> http://www.freeswitch.org <http://www.freeswitch.org/>

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>

Official FreeSWITCH Sites http://www.freeswitch.org <http://www.freeswitch.org/> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users> http://www.freeswitch.org <http://www.freeswitch.org/> --

Saludos / Regards / Cumprimentos, António silva _________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com

Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org

David, running which release ? David Ponzone Direction Technique email: david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr> tel: 01 74 03 18 97 gsm: 06 66 98 76 34 Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr <blocked::http://www.ipeva.fr/> - www.ipeva-studio.com <blocked::http://www.ipeva-studio.com/> Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

Le 27 mars 2017 à 17:28, David Villasmil <david.villasmil.work@gmail.com> a écrit :

Really weird, you need to do some deep debugging with Sofia debug... i have ~3500 registrations working ok. On Mon, Mar 27, 2017 at 5:23 PM David Ponzone <david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr>> wrote: On this box, around 30.

David Ponzone Direction Technique email: david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr> tel: 01 74 03 18 97 gsm: 06 66 98 76 34

Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr <> - www.ipeva-studio.com <>

Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

...

Le 27 mars 2017 à 14:27, David Villasmil <david.villasmil.work@gmail.com <mailto:david.villasmil.work@gmail.com>> a écrit :

Just wondering, how many users do you have registered? On Mon, Mar 27, 2017 at 2:05 PM David Ponzone <david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr>> wrote: Abdullah,

...

Le 22 mars 2017 à 12:59, Vallimamod Abdullah <vma@vallimamod.org <mailto:vma@vallimamod.org>> a écrit :

...

That's very strange. Especially for options as the fsw reply 200 ok without any specific check (actually, only if the profile param sip-options-respond-503-on-busy is not set. You may re-test after disabling this param if it is set, but I am not sure it will make any difference.)

It’s not set.

...

Have you noticed any difference between the failed REGISTER or OPTIONS requests and the normal ones?

Nope, but I’ll try to check again.

...

Is it happening only for one customer or indifferently?

Indifferently. When it freezes for 4-5 seconds, I can see REGISTER attempts coming from several customers that remain unanswered.

...

Also you said that you had no pb with another profile running on port 5080. Is it possible for you to test a failing customer with that profile?

The other profiles don’t allow REGISTER. I created a new profile allowing REGISTER on port 5072, and it’s the same. That means it doesn’t come from iptables as I have no filters on port 5072 at the moment.

...

Best Regards, -- Vallimamod Abdullah SIP Solutions vma@sipsolutions.fr <mailto:vma@sipsolutions.fr> tel:+33662606897 <tel:+33662606897> .

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>

Official FreeSWITCH Sites http://www.freeswitch.org <http://www.freeswitch.org/> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users> http://www.freeswitch.org <http://www.freeswitch.org/>_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>

Official FreeSWITCH Sites http://www.freeswitch.org <http://www.freeswitch.org/> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users> http://www.freeswitch.org <http://www.freeswitch.org/>

---

Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>

Official FreeSWITCH Sites http://www.freeswitch.org <http://www.freeswitch.org/> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users> http://www.freeswitch.org <http://www.freeswitch.org/>_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com

Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org

Regis, I have fail2ban running on the host, but 4-5 seconds of halt when adding a rule to a chain ? I was not even aware adding a rule was pausing trafic. I will check that hypothesis anyway, because I have not many ones left… David Ponzone Direction Technique email: david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr> tel: 01 74 03 18 97 gsm: 06 66 98 76 34 Service Client IPeva tel: 0811 46 26 26 www.ipeva.fr <blocked::http://www.ipeva.fr/> - www.ipeva-studio.com <blocked::http://www.ipeva-studio.com/> Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

Le 23 mars 2017 à 08:52, Regis M <regis.freeswitch.org@tornad.net> a écrit :

Hi David,,

Have you check if it's a a firewall automatic reload rules or something like that that could block traffic between network and freeswitch during a little time ?

Regards,

Regis

2017-03-22 11:57 GMT+01:00 David Ponzone <david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr>>: I can now confirm that while FS does not reply to REGISTER/OPTIONS/NOTIFY requests, it replies to INVITE/CANCEL requests normally.

David Ponzone Direction Technique email: david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr> tel: 01 74 03 18 97 <tel:01%2074%2003%2018%2097> gsm: 06 66 98 76 34 <tel:06%2066%2098%2076%2034>

Service Client IPeva tel: 0811 46 26 26 <tel:0%20811%2046%2026%2026> www.ipeva.fr <> - www.ipeva-studio.com <>

Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

...

Le 22 mars 2017 à 08:22, David Ponzone <david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr>> a écrit :

I use purely static config files for directory. I upgraded to 1.6.15 and moved core-db to tmpfs, and interestingly, the issue is still there. It just happened in front of my eyes (I have a tail -F log/freeswitch.log | grep 'existing REGISTER’ running, and a tshark on port 5070 at the same time).

David Ponzone Direction Technique email: david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr> tel: 01 74 03 18 97 <tel:01%2074%2003%2018%2097> gsm: 06 66 98 76 34 <tel:06%2066%2098%2076%2034>

Service Client IPeva tel: 0811 46 26 26 <tel:0%20811%2046%2026%2026> www.ipeva.fr <> - www.ipeva-studio.com <>

Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

...

Le 21 mars 2017 à 14:27, Vallimamod Abdullah <vma@vallimamod.org <mailto:vma@vallimamod.org>> a écrit :

Hi,

The sofia::register_attempt is sent just after authenticating the user. So the 5s delay you have would imply that freeswitch is having trouble getting the directory data. It would also explain the retransmission logs you see in libsofia.

Do you use xml-curl or any dynamic directory lookup? If not, the best move is, as you said, to update to latest 1.6 with tmpfs core-db and test again.

Best Regards, -- Vallimamod Abdullah SIP Solutions vma@sipsolutions.fr <mailto:vma@sipsolutions.fr> tel:+33662606897 <tel:+33662606897> .

...

On 21 Mar 2017, at 10:03, David Ponzone <david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr>> wrote:

Abdullah,

Actually, I have the ESL events (sofia::register_attempt and sofia::register) but they show up 5 seconds after the initial REGISTER. When they show up, I can see the 200 OK being sent to the client right away. So it’s like nua_application_event is calling the mod_sofia callback with a delay.

I can also confirm that during this frozen moment, another profile listening on port 5080 is normally answering to INVITE requests. This would suggest that the issue is related only to this specific profile listening on 5070, not to all profiles.

I will move core-db to tmpfs, as anyway it can only improve the overall performances. I will then upgrade to latest 1.6. Unless you see another option… I am opened to suggestions as it’s possible that some debug/logging is currently missing in FS as the logs should say why it’s stalling for 4-5 seconds. It’s not having a significant impact at the moment, so I can « play » a little bit with it.

David Ponzone Direction Technique email: david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr> tel: 01 74 03 18 97 <tel:01%2074%2003%2018%2097> gsm: 06 66 98 76 34 <tel:06%2066%2098%2076%2034>

Service Client IPeva tel: 0811 46 26 26 <tel:0%20811%2046%2026%2026> www.ipeva.fr <http://www.ipeva.fr/> - www.ipeva-studio.com <http://www.ipeva-studio.com/>

Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

...

Le 19 mars 2017 à 14:35, Vallimamod Abdullah <vma@vallimamod.org <mailto:vma@vallimamod.org>> a écrit :

Hi,

...

nta.c:3012 agent_recv_request() nta: OPTIONS (102) going to existing OPTIONS transaction nta.c:3012 agent_recv_request() nta: REGISTER (116849) going to existing REGISTER transaction

These means that sofia is considering these requests as retransmissions (transaction found in sofia's internal htable). In this case, you should also see a retransmission log like "nta: re-received %s request, retransmitting %u reply".

The nua_application_event is calling a mod_sofia callback for incoming register request. So it looks like mod_sofia does not answer for some reason. Can you check if you get the following esl custom events: "sofia::register_attempt", "sofia::pre_register" and "sofia::register" for the failed register? It will help to tell at which point the processing stops.

Also, is your core-db in-memory? If not, you may try to move it in ram.

Best Regards, Vallimamod .

-- Vallimamod Abdullah SIP Solutions vma@sipsolutions.fr <mailto:vma@sipsolutions.fr> tel:+33662606897 <tel:06%2062%2060%2068%2097> .

...

On 18 Mar 2017, at 20:04, David Ponzone <david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr>> wrote:

Mike,

with sofia loglevel all 9, I can see that sometimes (frequency hard to guess), during 4-5 secondes, FS writes those messages in the log for each REGISTER or OPTIONS request:

nta.c:3012 agent_recv_request() nta: OPTIONS (102) going to existing OPTIONS transaction nta.c:3012 agent_recv_request() nta: REGISTER (116849) going to existing REGISTER transaction

It’s like it considers it’s already dealing with a such request (which it never replied to).

A typical regular flow of logs for a REGISTER which was responded to is:

nta.c:3085 agent_recv_request() nta: REGISTER (108692) going to a default leg nua_server.c:102 nua_stack_process_request() nua: nua_stack_process_request: entering nua_stack.c:899 nh_create() nua: nh_create: entering nua_common.c:108 nh_create_handle() nua: nh_create_handle: entering nua_params.c:480 nua_stack_set_params() nua: nua_stack_set_params: entering soa.c:280 soa_clone() soa_clone(static::0x7fda40001930, 0x7fda40001130, 0x7fda40039330) called soa.c:403 soa_set_params() soa_set_params(static::0x7fda40207f40, ...) called nua_stack.c:271 nua_stack_event() nua(0x7fda40039330): event i_register 100 Trying nua_stack.c:359 nua_application_event() nua: nua_application_event: entering nua.c:366 nua_handle_magic() nua: nua_handle_magic: entering nua.c:879 nua_respond() nua: nua_respond: entering nua_stack.c:529 nua_signal() nua(0x7fda40039330): sent signal r_respond nua.c:921 nua_handle_destroy() nua: nua_handle_destroy: entering nua_stack.c:529 nua_signal() nua(0x7fda40039330): sent signal r_destroy nua.c:366 nua_handle_magic() nua: nua_handle_magic: entering nua.c:921 nua_handle_destroy() nua: nua_handle_destroy: entering nua_stack.c:573 nua_stack_signal() nua(0x7fda40039330): recv signal r_respond 200 OK

When it fails to respond, it is:

nta.c:3085 agent_recv_request() nta: REGISTER (108693) going to a default leg nua_server.c:102 nua_stack_process_request() nua: nua_stack_process_request: entering nua_stack.c:899 nh_create() nua: nh_create: entering nua_common.c:108 nh_create_handle() nua: nh_create_handle: entering nua_params.c:480 nua_stack_set_params() nua: nua_stack_set_params: entering soa.c:280 soa_clone() soa_clone(static::0x7fda40001930, 0x7fda40001130, 0x7fda402dc590) called soa.c:403 soa_set_params() soa_set_params(static::0x7fda4014f880, ...) called nua_stack.c:271 nua_stack_event() nua(0x7fda402dc590): event i_register 100 Trying nua_stack.c:359 nua_application_event() nua: nua_application_event: entering

It’s difficult to know which lines are related in the log, but when FS does not answer the 200 OK, I am definitely missing a line like:

nua_stack.c:529 nua_signal() nua(0x7fda40039330): sent signal r_respond

David Ponzone Direction Technique email: david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr> tel: 01 74 03 18 97 <tel:01%2074%2003%2018%2097> gsm: 06 66 98 76 34 <tel:06%2066%2098%2076%2034>

Service Client IPeva tel: 0811 46 26 26 <tel:0%20811%2046%2026%2026> www.ipeva.fr <http://www.ipeva.fr/> - www.ipeva-studio.com <http://www.ipeva-studio.com/>

Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur.

> Le 17 mars 2017 à 23:08, Michael Jerris <mike@jerris.com <mailto:mike@jerris.com>> a écrit : > > you can try sofia loglevel all 9 > > see if that tells you anything when we get one we don't respond to... also get latest 1.6 and see if that helps > On Fri, Mar 17, 2017 at 5:19 PM David Villasmil <david.villasmil.work@gmail.com <mailto:david.villasmil.work@gmail.com>> wrote: > How's the memory use? > On Fri, Mar 17, 2017 at 10:09 PM David Ponzone <david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr>> wrote: > All, > > I noticed recently that sometimes FS (1.6.6) does not honor REGISTER or OPTIONS requests coming from some customers. > Those customers register every 30 seconds, and FS does not answer to around 20-30 REGISTERs each day. > I am trying to understand that, as the server is far from loaded (max 100 concurrent calls on a Dell R610). > > Can anyone recommend some debugging steps to try to narrow this down ? > Any known issue of this sort in 1.6.6 ? > > Thank you > > David Ponzone Direction Technique > email: david.ponzone@ipeva.fr <mailto:david.ponzone@ipeva.fr> > tel: 01 74 03 18 97 <tel:01%2074%2003%2018%2097> > gsm: 06 66 98 76 34 <tel:06%2066%2098%2076%2034> > > Service Client IPeva > tel: 0811 46 26 26 <tel:0%20811%2046%2026%2026> > www.ipeva.fr <http://www.ipeva.fr/> - www.ipeva-studio.com <http://www.ipeva-studio.com/> > > Ce message et toutes les pièces jointes sont confidentiels et établis à l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisée est interdite. Tout message électronique est susceptible d'altération. IPeva décline toute responsabilité au titre de ce message s'il a été altéré, déformé ou falsifié. Si vous n'êtes pas destinataire de ce message, merci de le détruire immédiatement et d'avertir l'expéditeur. >

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>

Official FreeSWITCH Sites http://www.freeswitch.org <http://www.freeswitch.org/> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users> http://www.freeswitch.org <http://www.freeswitch.org/>

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com <http://www.freeswitchsolutions.com/>

Official FreeSWITCH Sites http://www.freeswitch.org <http://www.freeswitch.org/> http://confluence.freeswitch.org <http://confluence.freeswitch.org/> http://www.cluecon.com <http://www.cluecon.com/>

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users <http://lists.freeswitch.org/mailman/options/freeswitch-users> http://www.freeswitch.org <http://www.freeswitch.org/>

_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com

Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com

FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org