[Freeswitch-users] RE - Internal Interface suddenly freezes

Sat Apr 9 18:57:01 UTC 2022

Hi All

I have the same problem. Freeswitch stop responding every few hours (7
hours - 12 hours). Then a restart was required. I tired
different hardwares(Server Motherboard, cpu, memory and disks)
https://pastebin.freeswitch.org/view/dfbbab9e

Server is idle and Lots of Memory

https://imgur.com/a/4c3ZbRt

*Environment*

Freeswitch core database is postgres
Freeswitch Configuration via xml_curl ( php,pdo,mysql)
Freeswitch Dialplan ( lua, odbc, mysql)
300 Phones Registered
Call volume is less than 10 calls per minute.
Weekends not more than 10 calls per day. I do not think Freeswitch Dialplan
( lua, odbc, mysql)   is a problem.
I believe the issue is related to xml_curl ( php,pdo,mysql) and the
registration
Server has lots of resources. https://imgur.com/a/4c3ZbRt

I upgraded from FreeSWITCH (Version 1.4.23 git 1665168 2015-10-01 18:31:59Z
64bit) is ready, to Debian 11, Freeswitch 1.10.X all the versions have the
same issues.

Can you please let me know the right direction to troubleshoot this issue?

Thank you
Lloyd

On Thu, Nov 4, 2021 at 8:56 AM John Covici <covici at ccs.covici.com> wrote:

> Those sound like  profile parameters to me -- are you sure about where
> they go?
>
> On Thu, 04 Nov 2021 05:58:07 -0400,
> Rémi MARAND wrote:
> >
> > [1  <multipart/alternative (fr-FR) (7bit)>]
> > [1.1  <text/plain; iso-8859-1 (quoted-printable)>]
> > Hello,
> >
> > We have upgraded to 1.10.6 and use mod_mariadb as advised.
> >
> > Unfortunately, we still have these registrations stops. it is not
> frequent and difficult to reproduce.
> >
> > I would like to test the multi-thread registration as preconized, I
> tried but there is no corresponding info in logs.
> >
> > Should you confirm that the parameters :
> > <param name="inbound-reg-in-new-thread" value="true"/>
> > <param name="max-reg-threads" value="16"/>
> > Must be inserted in the "global_settings" part of the sofia.conf.xml
> file ??
> > How should I check the effective multithread registration process ??
> >
> > Best regards.
> >
> > Rémi Marand.
> >
> > De : FreeSWITCH-users <freeswitch-users-bounces at lists.freeswitch.org>
> De la part de Stefan Kainz
> > Envoyé : mardi 25 mai 2021 13:15
> > À : FreeSWITCH Users Help <freeswitch-users at lists.freeswitch.org>
> > Objet : Re: [Freeswitch-users] RE - Internal Interface suddenly freezes
> >
> > Thank you.
> >
> > We will try 1.10.6 with mod_mariadb this week!
> >
> > Thanks!
> >
> > Von: FreeSWITCH-users <freeswitch-users-bounces at lists.freeswitch.org
> <mailto:freeswitch-users-bounces at lists.freeswitch.org>> Im Auftrag von
> Rémi MARAND
> > Gesendet: Montag, 24. Mai 2021 19:24
> > An: FreeSWITCH Users Help <freeswitch-users at lists.freeswitch.org<mailto:
> freeswitch-users at lists.freeswitch.org>>
> > Betreff: Re: [Freeswitch-users] RE - Internal Interface suddenly freezes
> >
> > Hello,
> >
> > Thank you for the various information about this incident on the
> userlist and github.
> >
> > We are using Postgresql on Freeswitch server itself.
> > The version of Freeswitch is  1.10.5-release-17-25569c1631~64bit On
> Debian 10.
> >
> > I cannot reproduce the problem on our development environment with
> thousands of registrations and thousands of calls, for this reason I
> suspect some unexpected behavior of the web client, and I note that a few
> TCP connections: on wss:7443 remain after the Register they carry is
> completed.
> > I am looking for a solution on the Freeswitch side to close them on
> inactivity timeout.
> >
> > If we are successful in causing the problem, we will release the core as
> you recommend.
> > As for the transition to version 1.10.6, this is a track that we will
> try.
> >
> > Best Regards.
> >
> > remi.marand at odigo.com<mailto:remi.marand at odigo.com>
> >
> > De : FreeSWITCH-users <freeswitch-users-bounces at lists.freeswitch.org
> <mailto:freeswitch-users-bounces at lists.freeswitch.org>> De la part de
> Stefan Kainz
> > Envoyé : lundi 24 mai 2021 17:42
> > À : FreeSWITCH Users Help
> > Objet : Re: [Freeswitch-users] RE - Internal Interface suddenly freezes
> >
> > Another one :)
> >
> > At this point we have a script that restarts freeswitch every time this
> happens.
> > We don't really have a solution for this so far, and are out of things
> to test ...
> >
> > May I ask if you have an external interface in your setup? Does that
> interface freeze too?
> > We have a external interface, and it looks like it doesn't happen to
> that one.
> > We also have a third interface called "alternate_routing", which doesn't
> handle registrations or presence. Like the external interface it doesn't
> freeze.
> >
> > Do you use Mariadb/ODBC for odbc-core?
> >
> > Im hoping the GitHub-issue gets some attention soon.
> > Maybe it helps if some of you also post a backtrace when this happens.
> >
> > To your problem, can you confirm that this isn't some sort of
> SYN-Flood-Attack?
> > Maybe check the IP's that are connected. I think its pretty easy to find
> out if those are real-users or hackers.
> >
> > Regards,
> >
> > On 22.05.2021, at 08:22, Rémi MARAND <remi.marand at odigo.com<mailto:
> remi.marand at odigo.com>> wrote:
> >
> > Hello,
> >
> > It seems we have the same problem, it doesn't happen often, but the
> Register part of internal profile does crash.
> >
> > I observe that the number of connections established on the WSS port
> (7443) sometimes exceeds the number of active registrations. (netstat
> -tpa)..
> > It could be really important (2 or 3 times the number of Registrations),
> it could of course be a software problem on the WebRTC (Front) client side.
> >
> > Is there a way on the Freeswitch side in the configuration to disconnect
> TLS connections that are no longer registered? On timeout for example.
> >
> > Best regards.
> >
> > Rémi Marand.
> > remi.marand at odigo.com<mailto:remi.marand at odigo.com>
> >
> > De : FreeSWITCH-users <freeswitch-users-bounces at lists.freeswitch.org
> <mailto:freeswitch-users-bounces at lists.freeswitch.org>> De la part de
> Kakiman Expert
> > Envoyé : vendredi 30 avril 2021 15:34
> > À : freeswitch-users at lists.freeswitch.org<mailto:
> freeswitch-users at lists.freeswitch.org>
> > Objet : [Freeswitch-users] RE - Internal Interface suddenly freezes
> >
> > hello
> >
> > Did you find any solution to this issue ?
> >
> > I am in production with 1.10.5 version and since a week, I have the same
> issue.
> > The internal profile is out of service and registration is impossible.
> >
> > and we don't have any answer to "sofia status profile internal" , the
> prompt in fs_cli keeps waiting.
> >
> > the only way to solve is to restart freeswitch
> >
> > thanks
> > regards
> >
> > _________________________________________________________________________
> >
> > The FreeSWITCH project is sponsored by SignalWire https://signalwire.com
> <
> https://fra01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fsignalwire.com%2F&data=04%7C01%7Cremi.marand%40odigo.com%7C1a1c567c37914d1539d308d91f72a98a%7Cbfa2632f99e14088a16c21c08ca1b899%7C1%7C0%7C637575399601498302%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=nI4%2Fw2TpoEcAj25qrv5jXi%2BkeS7cH%2B5YYZsRLhB3gDk%3D&reserved=0
> >
> > Enhance your FreeSWITCH install with disruptive priced SMS and PSTN
> services.
> > Build your next product on our scalable cloud platform.
> >
> > Join our online community to chat in real time
> https://signalwire.community<
> https://fra01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fsignalwire.community%2F&data=04%7C01%7Cremi.marand%40odigo.com%7C1a1c567c37914d1539d308d91f72a98a%7Cbfa2632f99e14088a16c21c08ca1b899%7C1%7C0%7C637575399601508300%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=QRKf2cMFqwzkoeW9ER1JNXvd5LlELiQ22ffvGhNuSFI%3D&reserved=0
> >
> >
> > Professional FreeSWITCH Services
> > sales at freeswitch.com<mailto:sales at freeswitch.com>
> > https://freeswitch.com<
> https://fra01.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffreeswitch.com%2F&data=04%7C01%7Cremi.marand%40odigo.com%7C1a1c567c37914d1539d308d91f72a98a%7Cbfa2632f99e14088a16c21c08ca1b899%7C1%7C0%7C637575399601508300%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=N3rvLIw1tfZOspZifnMY0lhNKSXYgbnXyQqttxNJSkA%3D&reserved=0
> >
> >
> > Official FreeSWITCH Sites
> > https://freeswitch.com/oss<
> https://fra01.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffreeswitch.com%2Foss&data=04%7C01%7Cremi.marand%40odigo.com%7C1a1c567c37914d1539d308d91f72a98a%7Cbfa2632f99e14088a16c21c08ca1b899%7C1%7C0%7C637575399601518294%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=f9PA82VD5%2BZ4IsR06R0KMbT3PxxAhIBc7aZbbH52NEo%3D&reserved=0
> >
> > https://freeswitch.org/confluence<
> https://fra01.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffreeswitch.org%2Fconfluence&data=04%7C01%7Cremi.marand%40odigo.com%7C1a1c567c37914d1539d308d91f72a98a%7Cbfa2632f99e14088a16c21c08ca1b899%7C1%7C0%7C637575399601528287%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=Ne1rfKiT47f4eSvnCNLuYunOjNHNu2jWGB9uc9pKsgI%3D&reserved=0
> >
> > https://cluecon.com<
> https://fra01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcluecon.com%2F&data=04%7C01%7Cremi.marand%40odigo.com%7C1a1c567c37914d1539d308d91f72a98a%7Cbfa2632f99e14088a16c21c08ca1b899%7C1%7C0%7C637575399601528287%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=lJMgs8FbTJaTG0tHCBvAACBHwbjMTapZPIKlG%2BtBaHQ%3D&reserved=0
> >
> >
> > FreeSWITCH-users mailing list
> > FreeSWITCH-users at lists.freeswitch.org<mailto:
> FreeSWITCH-users at lists.freeswitch.org>
> > http://lists.freeswitch.org/mailman/listinfo/freeswitch-users<
> https://fra01.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.freeswitch.org%2Fmailman%2Flistinfo%2Ffreeswitch-users&data=04%7C01%7Cremi.marand%40odigo.com%7C1a1c567c37914d1539d308d91f72a98a%7Cbfa2632f99e14088a16c21c08ca1b899%7C1%7C0%7C637575399601538281%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=uH0OcML3zMXfSsT774wcbny5uIu9XeeJ4DDSwDLmlnA%3D&reserved=0
> >
> > UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
> <
> https://fra01.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.freeswitch.org%2Fmailman%2Foptions%2Ffreeswitch-users&data=04%7C01%7Cremi.marand%40odigo.com%7C1a1c567c37914d1539d308d91f72a98a%7Cbfa2632f99e14088a16c21c08ca1b899%7C1%7C0%7C637575399601538281%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=oTCYvgGw7YOlNI0Rdl0HikDXPDusZsKqohcdAGea144%3D&reserved=0
> >
> > https://freeswitch.com<
> https://fra01.safelinks.protection.outlook.com/?url=https%3A%2F%2Ffreeswitch.com%2F&data=04%7C01%7Cremi.marand%40odigo.com%7C1a1c567c37914d1539d308d91f72a98a%7Cbfa2632f99e14088a16c21c08ca1b899%7C1%7C0%7C637575399601548273%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=gNzAm1XomPmMlc5%2B3N%2BH5HrHeyZVtFiMB%2FV0a3OZPyQ%3D&reserved=0
> >
> >
> > [1.2  <text/html; iso-8859-1 (quoted-printable)>]
> > [2  <text/plain; utf-8 (base64)>]
> > _________________________________________________________________________
> >
> > The FreeSWITCH project is sponsored by SignalWire https://signalwire.com
> > Enhance your FreeSWITCH install with disruptive priced SMS and PSTN
> services.
> > Build your next product on our scalable cloud platform.
> >
> > Join our online community to chat in real time
> https://signalwire.community
> >
> > Professional FreeSWITCH Services
> > sales at freeswitch.com
> > https://freeswitch.com
> >
> > Official FreeSWITCH Sites
> > https://freeswitch.com/oss
> > https://freeswitch.org/confluence
> > https://cluecon.com
> >
> > FreeSWITCH-users mailing list
> > FreeSWITCH-users at lists.freeswitch.org
> > http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
> > UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
> > https://freeswitch.com
>
> --
> Your life is like a penny.  You're going to lose it.  The question is:
> How do
> you spend it?
>
>          John Covici wb2una
>          covici at ccs.covici.com
>
> _________________________________________________________________________
>
> The FreeSWITCH project is sponsored by SignalWire https://signalwire.com
> Enhance your FreeSWITCH install with disruptive priced SMS and PSTN
> services.
> Build your next product on our scalable cloud platform.
>
> Join our online community to chat in real time
> https://signalwire.community
>
> Professional FreeSWITCH Services
> sales at freeswitch.com
> https://freeswitch.com
>
> Official FreeSWITCH Sites
> https://freeswitch.com/oss
> https://freeswitch.org/confluence
> https://cluecon.com
>
> FreeSWITCH-users mailing list
> FreeSWITCH-users at lists.freeswitch.org
> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
> https://freeswitch.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.freeswitch.org/pipermail/freeswitch-users/attachments/20220409/ccb75076/attachment-0001.html>