[Freeswitch-users] Already hung channels in 'show channels' output never go away

Anthony Minessale anthony.minessale at gmail.com
Wed Mar 16 20:56:46 MSK 2011


can you also get some console traces on debug level of the traffic
happening on the box.


On Wed, Mar 16, 2011 at 12:55 PM, Anthony Minessale
<anthony.minessale at gmail.com> wrote:
> yes you probably found a use case where the rwlock is not released
> Can you open a JIRA and upload a gcore of the box when it's in the stuck state.
>
>
> On Wed, Mar 16, 2011 at 3:15 AM, Dmitry Sytchev <kbdfck at gmail.com> wrote:
>> I missed I'm using mod_hash for mod_hash_limit, calling
>> execute("limit","hash $realm $key")
>> and
>> api("limit_usage","hash $realm $key")
>> from perl ESL. And there are messages on FS shutdown (from hash_limit
>> cleanup task?)
>> Maybe using mod_hash_limit affect channel destroy sequence in some way?
>> hash_dump shows nothing after channel hangup, but channel which was hungup
>> first stays in channel list forever :(
>> 2011-03-16 11:12:07.454839 [ERR] switch_loadable_module.c:489 Giving up on
>> 'sofia' waiting for existing references.
>>
>> 2011-03-16 11:12:07.944692 [CRIT] sofia.c:1646 Waiting for 2 session(s)
>> 2011-03-16 11:12:08.944692 [CRIT] sofia.c:1646 Waiting for 2 session(s)
>> 2011-03-16 11:12:09.944693 [CRIT] sofia.c:1646 Waiting for 2 session(s)
>> 2011-03-16 11:12:10.944678 [CRIT] sofia.c:1646 Waiting for 2 session(s)
>>
>>
>>
>> 2011/3/12 Anthony Minessale <anthony.minessale at gmail.com>
>>>
>>> this sounds odd,
>>> are you on the latest GIT build?
>>>
>>> try doing a gcore on the box when its like that and run gdb on it and
>>> do thread apply all bt
>>>
>>>
>>> On Fri, Mar 11, 2011 at 3:38 PM, Dmitry Sytchev <kbdfck at gmail.com> wrote:
>>> > I use cdr_xml only. If the call fails before entering ESL script, seems
>>> > there are no stuck records, but they appear after some actions in ESL
>>> > even
>>> > if there was no bridge attempt.
>>> >
>>> > 2011/3/11 Anthony Minessale <anthony.minessale at gmail.com>
>>> >>
>>> >> that looks like they are all stuck in the CDR module.
>>> >> What module are you using?
>>> >>
>>> >>
>>> >>
>>> >> On Fri, Mar 11, 2011 at 5:58 AM, Dmitry Sytchev <kbdfck at gmail.com>
>>> >> wrote:
>>> >> > I think this is not the case, but anyway, what to do with these hung
>>> >> > channels?
>>> >> > Maybe I'm doing something wrong while bridging or processing events?
>>> >> > Maybe
>>> >> > unprocessed events can affect channel destroy procedure?
>>> >> > 2011/3/11 Avi Marcus <avi at avimarcus.net>
>>> >> >>
>>> >> >> Regarding ram usage, I'd imagine this is the case:
>>> >> >> http://www.linuxatemyram.com/
>>> >> >> -Avi
>>> >> >>
>>> >> >> On Fri, Mar 11, 2011 at 12:33 PM, Dmitry Sytchev <kbdfck at gmail.com>
>>> >> >> wrote:
>>> >> >>>
>>> >> >>> BTW, uuid_dump 7ae28028-4bc2-11e0-a92f-452f3d3d66ea returns with
>>> >> >>> -ERR
>>> >> >>> No
>>> >> >>> such channel.
>>> >> >>>
>>> >> >>> 2011/3/11 Dmitry Sytchev <kbdfck at gmail.com>
>>> >> >>>>
>>> >> >>>> Hi All
>>> >> >>>> I'm using Perl ESL outbound script to bridge incoming call to sip
>>> >> >>>> endpoint. I'm doing execute("bridge","sofia/user/somebody"), then
>>> >> >>>> processing
>>> >> >>>> events like CHANNEL_HANGUP and EXECUTE_COMPLETE to determine
>>> >> >>>> bridge
>>> >> >>>> result.
>>> >> >>>> Everything works fine, but original incoming call channel is never
>>> >> >>>> removed
>>> >> >>>> from list:
>>> >> >>>> After few calls I see original incoming channels in 'show
>>> >> >>>> channels'
>>> >> >>>> output:
>>> >> >>>> 7ae28028-4bc2-11e0-a92f-452f3d3d66ea,inbound,2011-03-11
>>> >> >>>>
>>> >> >>>>
>>> >> >>>> 12:32:27,1299835947,sofia/external/xxxx at 85.x.x.199,CS_REPORTING,622xxxx,622xxxx,85.114.x.x,622xxxx,hangup,USER_BUSY,XML,route_in,,,,,,,,xxx.xxx.ru,,,HANGUP,,,,
>>> >> >>>> 883c9eb6-4bc2-11e0-a935-452f3d3d66ea,inbound,2011-03-11
>>> >> >>>>
>>> >> >>>>
>>> >> >>>> 12:32:50,1299835970,sofia/external/xxxx at 85.x.x.199,CS_REPORTING,622xxxx,622xxxx,85.114.x.x,622xxxx,hangup,USER_BUSY,XML,route_in,,,,,,,,xxx.xxx.ru,,,HANGUP,,,,
>>> >> >>>> 9f6a0f92-4bc2-11e0-a93b-452f3d3d66ea,inbound,2011-03-11
>>> >> >>>>
>>> >> >>>>
>>> >> >>>> 12:33:29,1299836009,sofia/external/xxxx at 85.x.x.199,CS_REPORTING,622xxxx,622xxxx,85.114.x.x,622xxxx,hangup,USER_BUSY,XML,route_in,,,,,,,,xxx.xxx.ru,,,HANGUP,,,
>>> >> >>>> Also, when I try to stop freeswitch i see these messages on
>>> >> >>>> console:
>>> >> >>>> 2011-03-11 15:28:22.517063 [CRIT] sofia.c:1632 Waiting for 13
>>> >> >>>> session(s)
>>> >> >>>> 2011-03-11 15:28:22.701034 [CRIT] sofia.c:1632 Waiting for 3
>>> >> >>>> session(s)
>>> >> >>>> 2011-03-11 15:28:23.517064 [CRIT] sofia.c:1632 Waiting for 13
>>> >> >>>> session(s)
>>> >> >>>> 2011-03-11 15:28:23.701033 [CRIT] sofia.c:1632 Waiting for 3
>>> >> >>>> session(s)
>>> >> >>>> 2011-03-11 15:28:24.517062 [CRIT] sofia.c:1632 Waiting for 13
>>> >> >>>> session(s)
>>> >> >>>> 2011-03-11 15:28:24.705036 [CRIT] sofia.c:1632 Waiting for 3
>>> >> >>>> session(s)
>>> >> >>>> 2011-03-11 15:28:25.517064 [CRIT] sofia.c:1632 Waiting for 13
>>> >> >>>> session(s)
>>> >> >>>> 2011-03-11 15:28:25.709031 [CRIT] sofia.c:1632 Waiting for 3
>>> >> >>>> session(s)
>>> >> >>>> 2011-03-11 15:28:26.517065 [CRIT] sofia.c:1632 Waiting for 13
>>> >> >>>> session(s)
>>> >> >>>>
>>> >> >>>> Why these channels are not removed from list? I also noticed that
>>> >> >>>> memory
>>> >> >>>> consumption by freeswitch process constantly grows call by call.
>>> >> >>>>
>>> >> >>>> --
>>> >> >>>> Best regards,
>>> >> >>>>
>>> >> >>>> Dmitry Sytchev,
>>> >> >>>> IT Engineer
>>> >> >>>
>>> >> >>>
>>> >> >>>
>>> >> >>> --
>>> >> >>> Best regards,
>>> >> >>>
>>> >> >>> Dmitry Sytchev,
>>> >> >>> IT Engineer
>>> >> >>>
>>> >> >>> _______________________________________________
>>> >> >>> FreeSWITCH-users mailing list
>>> >> >>> FreeSWITCH-users at lists.freeswitch.org
>>> >> >>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>>> >> >>>
>>> >> >>>
>>> >> >>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>>> >> >>> http://www.freeswitch.org
>>> >> >>>
>>> >> >>
>>> >> >>
>>> >> >> _______________________________________________
>>> >> >> FreeSWITCH-users mailing list
>>> >> >> FreeSWITCH-users at lists.freeswitch.org
>>> >> >> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>>> >> >>
>>> >> >>
>>> >> >> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>>> >> >> http://www.freeswitch.org
>>> >> >>
>>> >> >
>>> >> >
>>> >> >
>>> >> > --
>>> >> > Best regards,
>>> >> >
>>> >> > Dmitry Sytchev,
>>> >> > IT Engineer
>>> >> >
>>> >> > _______________________________________________
>>> >> > FreeSWITCH-users mailing list
>>> >> > FreeSWITCH-users at lists.freeswitch.org
>>> >> > http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>>> >> >
>>> >> > UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>>> >> > http://www.freeswitch.org
>>> >> >
>>> >> >
>>> >>
>>> >>
>>> >>
>>> >> --
>>> >> Anthony Minessale II
>>> >>
>>> >> FreeSWITCH http://www.freeswitch.org/
>>> >> ClueCon http://www.cluecon.com/
>>> >> Twitter: http://twitter.com/FreeSWITCH_wire
>>> >>
>>> >> AIM: anthm
>>> >> MSN:anthony_minessale at hotmail.com
>>> >> GTALK/JABBER/PAYPAL:anthony.minessale at gmail.com
>>> >> IRC: irc.freenode.net #freeswitch
>>> >>
>>> >> FreeSWITCH Developer Conference
>>> >> sip:888 at conference.freeswitch.org
>>> >> googletalk:conf+888 at conference.freeswitch.org
>>> >> pstn:+19193869900
>>> >>
>>> >> _______________________________________________
>>> >> FreeSWITCH-users mailing list
>>> >> FreeSWITCH-users at lists.freeswitch.org
>>> >> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>>> >>
>>> >> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>>> >> http://www.freeswitch.org
>>> >
>>> >
>>> >
>>> > --
>>> > Best regards,
>>> >
>>> > Dmitry Sytchev,
>>> > IT Engineer
>>> >
>>> > _______________________________________________
>>> > FreeSWITCH-users mailing list
>>> > FreeSWITCH-users at lists.freeswitch.org
>>> > http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>>> > UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>>> > http://www.freeswitch.org
>>> >
>>> >
>>>
>>>
>>>
>>> --
>>> Anthony Minessale II
>>>
>>> FreeSWITCH http://www.freeswitch.org/
>>> ClueCon http://www.cluecon.com/
>>> Twitter: http://twitter.com/FreeSWITCH_wire
>>>
>>> AIM: anthm
>>> MSN:anthony_minessale at hotmail.com
>>> GTALK/JABBER/PAYPAL:anthony.minessale at gmail.com
>>> IRC: irc.freenode.net #freeswitch
>>>
>>> FreeSWITCH Developer Conference
>>> sip:888 at conference.freeswitch.org
>>> googletalk:conf+888 at conference.freeswitch.org
>>> pstn:+19193869900
>>>
>>> _______________________________________________
>>> FreeSWITCH-users mailing list
>>> FreeSWITCH-users at lists.freeswitch.org
>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>>> http://www.freeswitch.org
>>
>>
>>
>> --
>> Best regards,
>>
>> Dmitry Sytchev,
>> IT Engineer
>>
>> _______________________________________________
>> FreeSWITCH-users mailing list
>> FreeSWITCH-users at lists.freeswitch.org
>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>> http://www.freeswitch.org
>>
>>
>
>
>
> --
> Anthony Minessale II
>
> FreeSWITCH http://www.freeswitch.org/
> ClueCon http://www.cluecon.com/
> Twitter: http://twitter.com/FreeSWITCH_wire
>
> AIM: anthm
> MSN:anthony_minessale at hotmail.com
> GTALK/JABBER/PAYPAL:anthony.minessale at gmail.com
> IRC: irc.freenode.net #freeswitch
>
> FreeSWITCH Developer Conference
> sip:888 at conference.freeswitch.org
> googletalk:conf+888 at conference.freeswitch.org
> pstn:+19193869900
>



-- 
Anthony Minessale II

FreeSWITCH http://www.freeswitch.org/
ClueCon http://www.cluecon.com/
Twitter: http://twitter.com/FreeSWITCH_wire

AIM: anthm
MSN:anthony_minessale at hotmail.com
GTALK/JABBER/PAYPAL:anthony.minessale at gmail.com
IRC: irc.freenode.net #freeswitch

FreeSWITCH Developer Conference
sip:888 at conference.freeswitch.org
googletalk:conf+888 at conference.freeswitch.org
pstn:+19193869900



More information about the FreeSWITCH-users mailing list