[Freeswitch-users] Already hung channels in 'show channels' output never go away

Wed Mar 16 20:55:15 MSK 2011

yes you probably found a use case where the rwlock is not released
Can you open a JIRA and upload a gcore of the box when it's in the stuck state.

On Wed, Mar 16, 2011 at 3:15 AM, Dmitry Sytchev <kbdfck at gmail.com> wrote:
> I missed I'm using mod_hash for mod_hash_limit, calling
> execute("limit","hash $realm $key")
> and
> api("limit_usage","hash $realm $key")
> from perl ESL. And there are messages on FS shutdown (from hash_limit
> cleanup task?)
> Maybe using mod_hash_limit affect channel destroy sequence in some way?
> hash_dump shows nothing after channel hangup, but channel which was hungup
> first stays in channel list forever :(
> 2011-03-16 11:12:07.454839 [ERR] switch_loadable_module.c:489 Giving up on
> 'sofia' waiting for existing references.
>
> 2011-03-16 11:12:07.944692 [CRIT] sofia.c:1646 Waiting for 2 session(s)
> 2011-03-16 11:12:08.944692 [CRIT] sofia.c:1646 Waiting for 2 session(s)
> 2011-03-16 11:12:09.944693 [CRIT] sofia.c:1646 Waiting for 2 session(s)
> 2011-03-16 11:12:10.944678 [CRIT] sofia.c:1646 Waiting for 2 session(s)
>
>
>
> 2011/3/12 Anthony Minessale <anthony.minessale at gmail.com>
>>
>> this sounds odd,
>> are you on the latest GIT build?
>>
>> try doing a gcore on the box when its like that and run gdb on it and
>> do thread apply all bt
>>
>>
>> On Fri, Mar 11, 2011 at 3:38 PM, Dmitry Sytchev <kbdfck at gmail.com> wrote:
>> > I use cdr_xml only. If the call fails before entering ESL script, seems
>> > there are no stuck records, but they appear after some actions in ESL
>> > even
>> > if there was no bridge attempt.
>> >
>> > 2011/3/11 Anthony Minessale <anthony.minessale at gmail.com>
>> >>
>> >> that looks like they are all stuck in the CDR module.
>> >> What module are you using?
>> >>
>> >>
>> >>
>> >> On Fri, Mar 11, 2011 at 5:58 AM, Dmitry Sytchev <kbdfck at gmail.com>
>> >> wrote:
>> >> > I think this is not the case, but anyway, what to do with these hung
>> >> > channels?
>> >> > Maybe I'm doing something wrong while bridging or processing events?
>> >> > Maybe
>> >> > unprocessed events can affect channel destroy procedure?
>> >> > 2011/3/11 Avi Marcus <avi at avimarcus.net>
>> >> >>
>> >> >> Regarding ram usage, I'd imagine this is the case:
>> >> >> http://www.linuxatemyram.com/
>> >> >> -Avi
>> >> >>
>> >> >> On Fri, Mar 11, 2011 at 12:33 PM, Dmitry Sytchev <kbdfck at gmail.com>
>> >> >> wrote:
>> >> >>>
>> >> >>> BTW, uuid_dump 7ae28028-4bc2-11e0-a92f-452f3d3d66ea returns with
>> >> >>> -ERR
>> >> >>> No
>> >> >>> such channel.
>> >> >>>
>> >> >>> 2011/3/11 Dmitry Sytchev <kbdfck at gmail.com>
>> >> >>>>
>> >> >>>> Hi All
>> >> >>>> I'm using Perl ESL outbound script to bridge incoming call to sip
>> >> >>>> endpoint. I'm doing execute("bridge","sofia/user/somebody"), then
>> >> >>>> processing
>> >> >>>> events like CHANNEL_HANGUP and EXECUTE_COMPLETE to determine
>> >> >>>> bridge
>> >> >>>> result.
>> >> >>>> Everything works fine, but original incoming call channel is never
>> >> >>>> removed
>> >> >>>> from list:
>> >> >>>> After few calls I see original incoming channels in 'show
>> >> >>>> channels'
>> >> >>>> output:
>> >> >>>> 7ae28028-4bc2-11e0-a92f-452f3d3d66ea,inbound,2011-03-11
>> >> >>>>
>> >> >>>>
>> >> >>>> 12:32:27,1299835947,sofia/external/xxxx at 85.x.x.199,CS_REPORTING,622xxxx,622xxxx,85.114.x.x,622xxxx,hangup,USER_BUSY,XML,route_in,,,,,,,,xxx.xxx.ru,,,HANGUP,,,,
>> >> >>>> 883c9eb6-4bc2-11e0-a935-452f3d3d66ea,inbound,2011-03-11
>> >> >>>>
>> >> >>>>
>> >> >>>> 12:32:50,1299835970,sofia/external/xxxx at 85.x.x.199,CS_REPORTING,622xxxx,622xxxx,85.114.x.x,622xxxx,hangup,USER_BUSY,XML,route_in,,,,,,,,xxx.xxx.ru,,,HANGUP,,,,
>> >> >>>> 9f6a0f92-4bc2-11e0-a93b-452f3d3d66ea,inbound,2011-03-11
>> >> >>>>
>> >> >>>>
>> >> >>>> 12:33:29,1299836009,sofia/external/xxxx at 85.x.x.199,CS_REPORTING,622xxxx,622xxxx,85.114.x.x,622xxxx,hangup,USER_BUSY,XML,route_in,,,,,,,,xxx.xxx.ru,,,HANGUP,,,
>> >> >>>> Also, when I try to stop freeswitch i see these messages on
>> >> >>>> console:
>> >> >>>> 2011-03-11 15:28:22.517063 [CRIT] sofia.c:1632 Waiting for 13
>> >> >>>> session(s)
>> >> >>>> 2011-03-11 15:28:22.701034 [CRIT] sofia.c:1632 Waiting for 3
>> >> >>>> session(s)
>> >> >>>> 2011-03-11 15:28:23.517064 [CRIT] sofia.c:1632 Waiting for 13
>> >> >>>> session(s)
>> >> >>>> 2011-03-11 15:28:23.701033 [CRIT] sofia.c:1632 Waiting for 3
>> >> >>>> session(s)
>> >> >>>> 2011-03-11 15:28:24.517062 [CRIT] sofia.c:1632 Waiting for 13
>> >> >>>> session(s)
>> >> >>>> 2011-03-11 15:28:24.705036 [CRIT] sofia.c:1632 Waiting for 3
>> >> >>>> session(s)
>> >> >>>> 2011-03-11 15:28:25.517064 [CRIT] sofia.c:1632 Waiting for 13
>> >> >>>> session(s)
>> >> >>>> 2011-03-11 15:28:25.709031 [CRIT] sofia.c:1632 Waiting for 3
>> >> >>>> session(s)
>> >> >>>> 2011-03-11 15:28:26.517065 [CRIT] sofia.c:1632 Waiting for 13
>> >> >>>> session(s)
>> >> >>>>
>> >> >>>> Why these channels are not removed from list? I also noticed that
>> >> >>>> memory
>> >> >>>> consumption by freeswitch process constantly grows call by call.
>> >> >>>>
>> >> >>>> --
>> >> >>>> Best regards,
>> >> >>>>
>> >> >>>> Dmitry Sytchev,
>> >> >>>> IT Engineer
>> >> >>>
>> >> >>>
>> >> >>>
>> >> >>> --
>> >> >>> Best regards,
>> >> >>>
>> >> >>> Dmitry Sytchev,
>> >> >>> IT Engineer
>> >> >>>
>> >> >>> _______________________________________________
>> >> >>> FreeSWITCH-users mailing list
>> >> >>> FreeSWITCH-users at lists.freeswitch.org
>> >> >>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>> >> >>>
>> >> >>>
>> >> >>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>> >> >>> http://www.freeswitch.org
>> >> >>>
>> >> >>
>> >> >>
>> >> >> _______________________________________________
>> >> >> FreeSWITCH-users mailing list
>> >> >> FreeSWITCH-users at lists.freeswitch.org
>> >> >> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>> >> >>
>> >> >>
>> >> >> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>> >> >> http://www.freeswitch.org
>> >> >>
>> >> >
>> >> >
>> >> >
>> >> > --
>> >> > Best regards,
>> >> >
>> >> > Dmitry Sytchev,
>> >> > IT Engineer
>> >> >
>> >> > _______________________________________________
>> >> > FreeSWITCH-users mailing list
>> >> > FreeSWITCH-users at lists.freeswitch.org
>> >> > http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>> >> >
>> >> > UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>> >> > http://www.freeswitch.org
>> >> >
>> >> >
>> >>
>> >>
>> >>
>> >> --
>> >> Anthony Minessale II
>> >>
>> >> FreeSWITCH http://www.freeswitch.org/
>> >> ClueCon http://www.cluecon.com/
>> >> Twitter: http://twitter.com/FreeSWITCH_wire
>> >>
>> >> AIM: anthm
>> >> MSN:anthony_minessale at hotmail.com
>> >> GTALK/JABBER/PAYPAL:anthony.minessale at gmail.com
>> >> IRC: irc.freenode.net #freeswitch
>> >>
>> >> FreeSWITCH Developer Conference
>> >> sip:888 at conference.freeswitch.org
>> >> googletalk:conf+888 at conference.freeswitch.org
>> >> pstn:+19193869900
>> >>
>> >> _______________________________________________
>> >> FreeSWITCH-users mailing list
>> >> FreeSWITCH-users at lists.freeswitch.org
>> >> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>> >>
>> >> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>> >> http://www.freeswitch.org
>> >
>> >
>> >
>> > --
>> > Best regards,
>> >
>> > Dmitry Sytchev,
>> > IT Engineer
>> >
>> > _______________________________________________
>> > FreeSWITCH-users mailing list
>> > FreeSWITCH-users at lists.freeswitch.org
>> > http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>> > UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>> > http://www.freeswitch.org
>> >
>> >
>>
>>
>>
>> --
>> Anthony Minessale II
>>
>> FreeSWITCH http://www.freeswitch.org/
>> ClueCon http://www.cluecon.com/
>> Twitter: http://twitter.com/FreeSWITCH_wire
>>
>> AIM: anthm
>> MSN:anthony_minessale at hotmail.com
>> GTALK/JABBER/PAYPAL:anthony.minessale at gmail.com
>> IRC: irc.freenode.net #freeswitch
>>
>> FreeSWITCH Developer Conference
>> sip:888 at conference.freeswitch.org
>> googletalk:conf+888 at conference.freeswitch.org
>> pstn:+19193869900
>>
>> _______________________________________________
>> FreeSWITCH-users mailing list
>> FreeSWITCH-users at lists.freeswitch.org
>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>> http://www.freeswitch.org
>
>
>
> --
> Best regards,
>
> Dmitry Sytchev,
> IT Engineer
>
> _______________________________________________
> FreeSWITCH-users mailing list
> FreeSWITCH-users at lists.freeswitch.org
> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
> http://www.freeswitch.org
>
>

-- 
Anthony Minessale II

FreeSWITCH http://www.freeswitch.org/
ClueCon http://www.cluecon.com/
Twitter: http://twitter.com/FreeSWITCH_wire

AIM: anthm
MSN:anthony_minessale at hotmail.com
GTALK/JABBER/PAYPAL:anthony.minessale at gmail.com
IRC: irc.freenode.net #freeswitch

FreeSWITCH Developer Conference
sip:888 at conference.freeswitch.org
googletalk:conf+888 at conference.freeswitch.org
pstn:+19193869900