[Freeswitch-users] FreeSWITCH Crashes

Anthony Minessale anthony.minessale at gmail.com
Mon Oct 26 21:30:54 MSK 2015


Probably the stack trace from the threads leading into ssl calls and
explanation of how FS is multithreaded so the ssl code may be invoked from
multiple threads at once.

It can also be related to system libs as FS also uses openssl and does the
correct things to protect it in a multi-theeaded env.  Maybe you would have
more luck with a curl module?

On Sunday, October 25, 2015, Leonardo Ribeiro <llribeiro90 at gmail.com> wrote:

> Yeah, that's what I was thinking...
>
> I use LuaSec(SSL) just for posts to HTTPS endpoints...
>
> Do you know the exact line of the problem looking at this log? Maybe I
> should open an issue in their github...
> What part of the log and details should I send them?
>
> Thank you all!
> Em 24/10/2015 20:45, "Anthony Minessale" <anthony.minessale at gmail.com>
> escreveu:
>
> its a crash in openssl.  What ssl thing are you doing?  There is probably
> a concurrency issue in lua ssl code.  It not something we can fix.
>
>
> On Sat, Oct 24, 2015 at 5:21 PM, Sergey Safarov <s.safarov at gmail.com>
> wrote:
>
> Please fill a ticket  like https://freeswitch.org/jira/browse/FS-7397
>
> On Sat, Oct 24, 2015 at 7:21 PM, Leonardo Lima Ribeiro <
> llribeiro90 at gmail.com> wrote:
>
> Hello all,
>
> I’m having hard time about a possible bug, because FreeSWITCH crashes with
> no messages and the log file (freeswitch.log) has no error messages.
> Then I follow the steps in the wiki to generate a backtrace. (see at the
> end of this mail)
>
> For your information, my application workflow is like that:
> 1) We have a java application that calls, via ESL, the command luarun
> myscript.lua.
> 2) myscript.lua is a script in freeswitch that connects to the database
> using luasql.
> 3) Process that db results and originate an outbound call (in this step
> we don’t need any extension to bridge the call, so it’s a call of only one
> leg… is this a problem?)
> 4) Our IVR says messages, record audios and then do some HTTPS requests to
> an external API - (for the https requests we use the luasec module
> - require “ssl.https")
> 5) We then end the call and save some data into the same database.
>
> I don’t understand too much about the backtrace, could you help me please?
> And the problem occurs mostly when we have more than 3 calls at the same
> time, I mean, we call luarun myscript.lua more than 3 times in a short
> period of time, then we have parallels executions of myscript.lua.
>
> Thank you,
> Leonardo Ribeiro
>
> **** Trying to do a backtrace:*
> **** First command: gdb freeswitch core.20727 *
> **** Output:*
> [ivr at IVRLIVE bin]$ gdb freeswitch core.20727
> GNU gdb (GDB) Red Hat Enterprise Linux (7.2-83.el6)
> Copyright (C) 2010 Free Software Foundation, Inc.
> License GPLv3+: GNU GPL version 3 or later <
> http://gnu.org/licenses/gpl.html>
> This is free software: you are free to change and redistribute it.
> There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
> and "show warranty" for details.
> This GDB was configured as "x86_64-redhat-linux-gnu".
> For bug reporting instructions, please see:
> <http://www.gnu.org/software/gdb/bugs/>...
> Reading symbols from /usr/local/freeswitch/bin/freeswitch...done.
> [New Thread 20798]
> [New Thread 20727]
> [New Thread 20728]
> [New Thread 20748]
> [New Thread 20802]
> [New Thread 20795]
> [New Thread 20800]
> [New Thread 20738]
> [New Thread 20750]
> [New Thread 20737]
> [New Thread 20751]
> [New Thread 20741]
> [New Thread 20744]
> [New Thread 20743]
> [New Thread 20742]
> [New Thread 20753]
> [New Thread 20745]
> [New Thread 20758]
> [New Thread 20769]
> [New Thread 20768]
> [New Thread 20746]
> [New Thread 20771]
> [New Thread 20729]
> [New Thread 20730]
> [New Thread 20767]
> [New Thread 20733]
> [New Thread 20736]
> [New Thread 20747]
> [New Thread 20759]
> [New Thread 20760]
> [New Thread 20761]
> [New Thread 20766]
> [New Thread 20752]
> [New Thread 20749]
> [New Thread 20777]
> Missing separate debuginfo for /usr/local/freeswitch/lib/libfreeswitch.so.1
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/41/fbb21f952d3a7e803298f919d020fbc4946edf
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_console.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/fc/713a0635cf2da0225a47af340db4fed429307b
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_logfile.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/57/3b135b6db55216f74a69c37b5a98b27caa3dea
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_enum.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/fe/33e36dec15bcfd4a11c7a9c2c2c72675e5b05e
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_cdr_csv.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/dd/89326cfcf61a80f918cacdf311e7990a913cdb
> Missing separate debuginfo for
> /usr/local/freeswitch/mod/mod_event_socket.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/44/06fbca53e57f7ddd754d7dafa04dba981892fe
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_sofia.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/d0/a4135605cb7910bcc5f49f3437cf84abd67f8f
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_loopback.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/12/0bd2f50c15c4b4b8847d32fe571bd3b01ffcfd
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_commands.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/dc/9d21d1363f34caaaaa82cbc8bdda91b24da59b
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_conference.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/35/2386a5eac82851f31ffa7e9e76dc3ef81db006
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_db.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/b3/e299afec8a086466cf9111719e61f991becfbf
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_dptools.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/bb/1fd391c53a7f1408b8cfbbf9b7a06308ceb95c
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_expr.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/26/8ff949b71e111a74c68c206a1e4369f298bc68
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_fifo.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/07/fda382001bca1d0cc9d01b2d682adeea3d6ed8
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_hash.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/c2/3f8ed07b63804f36bebeefb3160137da4e627a
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_voicemail.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/58/2bbea6d62efcb28d794c1c2b4da1f2780718ff
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_esf.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/17/edb809bd9b8ef634439daefbba022597d857c3
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_fsv.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/5e/c26bd0b4eb93dc37c55553784c7f9acaa3913f
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_cluechoo.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/c9/9c62db6f583cb219bb7eea536dc7b8b89bad4c
> Missing separate debuginfo for
> /usr/local/freeswitch/mod/mod_valet_parking.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/1b/88bb5a48db1ecde5ecf17a7a5828caf2d16488
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_httapi.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/0c/45dbae0720a53622f1fe9e11b66cfd79475b93
> Missing separate debuginfo for
> /usr/local/freeswitch/mod/mod_dialplan_xml.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/68/dc88ecf8f4ee82a418b15deef930493a3712dc
> Missing separate debuginfo for
> /usr/local/freeswitch/mod/mod_dialplan_asterisk.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/98/80725dcf50571f5fcb7d03429074b12e88bdb6
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_spandsp.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/ad/dc63326bfc44a197a353146208eb018dbd0217
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_g723_1.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/96/0a4b1bae2368a12721d31d5a66b9a89ed1d622
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_g729.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/3c/be2934e2b0a7d3ab9f6c977a853a7f66bf7a04
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_amr.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/c0/9d492e662118285d057c420b4ca219a5cea97a
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_speex.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/64/22b88f8f2aa4959690c75400c2c88e19a0e63e
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_h26x.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/60/3ae8d7a511b9fe103a34706aad65441c402a28
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_vp8.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/b5/b733b744050185469a4ab84d4dddcd38ed6bb2
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_b64.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/40/fc36b21b922b24d45dbd0c6c320edb86837214
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_sndfile.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/3f/039315c8449eded09af055ea8088a6d8a62882
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_native_file.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/8d/032942219e296590daf4e4158fae4086451bfa
> Missing separate debuginfo for
> /usr/local/freeswitch/mod/mod_local_stream.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/24/ba6ad40b61a95ebacb9b1f5fbf340d7f4cdf06
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_tone_stream.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/7c/f86bd5b07df42996707c3cb59777d158a3e0f0
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_lua.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/50/d21bdb2a3d084c09cee7b02084334ad75a4003
> Missing separate debuginfo for /usr/local/freeswitch/mod/mod_say_en.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/df/64681d7ae0a211ea3bfa44e40c34d190830523
> Missing separate debuginfo for /usr/local/lib/lua/5.1/luasql/odbc.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/9c/33abb770c824c2174b5ce3564370fcdb3b8038
> Missing separate debuginfo for /usr/local/lib/lua/5.1/cjson.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/32/53156d91932fa56ba269996a70756ef00268df
> Missing separate debuginfo for /usr/local/lib/lua/5.1/socket/core.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/2a/ce929bd90d77d4ad2fef47711b10466df43ec2
> Missing separate debuginfo for /usr/local/lib/lua/5.1/ssl.so
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/92/4771a49e43c954ed9074577c77034a2e84dd29
> Missing separate debuginfo for
> Try: yum --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/77/385010026236dada9bfeadc4717b7518e8bb29
> Reading symbols from /usr/lib64/libodbc.so.2...(no debugging symbols
> found)...done.
> Loaded symbols for /usr/lib64/libodbc.so.2
> Reading symbols from /lib64/libm.so.6...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libm.so.6
> Reading symbols from /usr/local/freeswitch/lib/libfreeswitch.so.1...done.
> Loaded symbols for /usr/local/freeswitch/lib/libfreeswitch.so.1
> Reading symbols from /usr/lib64/libcurl.so.4...(no debugging symbols
> found)...done.
> Loaded symbols for /usr/lib64/libcurl.so.4
> Reading symbols from /lib64/libz.so.1...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libz.so.1
> Reading symbols from /lib64/librt.so.1...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/librt.so.1
> Reading symbols from /lib64/libdl.so.2...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libdl.so.2
> Reading symbols from /lib64/libcrypt.so.1...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libcrypt.so.1
> Reading symbols from /lib64/libpthread.so.0...(no debugging symbols
> found)...done.
> [Thread debugging using libthread_db enabled]
> Loaded symbols for /lib64/libpthread.so.0
> Reading symbols from /lib64/libtinfo.so.5...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libtinfo.so.5
> Reading symbols from /usr/lib64/libssl.so.10...(no debugging symbols
> found)...done.
> Loaded symbols for /usr/lib64/libssl.so.10
> Reading symbols from /usr/lib64/libcrypto.so.10...(no debugging symbols
> found)...done.
> Loaded symbols for /usr/lib64/libcrypto.so.10
> Reading symbols from /usr/lib64/libjpeg.so.62...(no debugging symbols
> found)...done.
> Loaded symbols for /usr/lib64/libjpeg.so.62
> Reading symbols from /lib64/libc.so.6...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libc.so.6
> Reading symbols from /usr/lib64/libltdl.so.7...(no debugging symbols
> found)...done.
> Loaded symbols for /usr/lib64/libltdl.so.7
> Reading symbols from /usr/lib64/libstdc++.so.6...(no debugging symbols
> found)...done.
> Loaded symbols for /usr/lib64/libstdc++.so.6
> Reading symbols from /lib64/libgcc_s.so.1...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libgcc_s.so.1
> Reading symbols from /lib64/libidn.so.11...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libidn.so.11
> Reading symbols from /lib64/libldap-2.4.so.2...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libldap-2.4.so.2
> Reading symbols from /lib64/libgssapi_krb5.so.2...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libgssapi_krb5.so.2
> Reading symbols from /lib64/libkrb5.so.3...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libkrb5.so.3
> Reading symbols from /lib64/libk5crypto.so.3...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libk5crypto.so.3
> Reading symbols from /lib64/libcom_err.so.2...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libcom_err.so.2
> Reading symbols from /usr/lib64/libssl3.so...(no debugging symbols
> found)...done.
> Loaded symbols for /usr/lib64/libssl3.so
> Reading symbols from /usr/lib64/libsmime3.so...(no debugging symbols
> found)...done.
> Loaded symbols for /usr/lib64/libsmime3.so
> Reading symbols from /usr/lib64/libnss3.so...(no debugging symbols
> found)...done.
> Loaded symbols for /usr/lib64/libnss3.so
> Reading symbols from /usr/lib64/libnssutil3.so...(no debugging symbols
> found)...done.
> Loaded symbols for /usr/lib64/libnssutil3.so
> Reading symbols from /lib64/libplds4.so...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libplds4.so
> Reading symbols from /lib64/libplc4.so...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libplc4.so
> Reading symbols from /lib64/libnspr4.so...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libnspr4.so
> Reading symbols from /usr/lib64/libssh2.so.1...(no debugging symbols
> found)...done.
> Loaded symbols for /usr/lib64/libssh2.so.1
> Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/ld-linux-x86-64.so.2
> Reading symbols from /lib64/libfreebl3.so...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libfreebl3.so
> Reading symbols from /lib64/liblber-2.4.so.2...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/liblber-2.4.so.2
> Reading symbols from /lib64/libresolv.so.2...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libresolv.so.2
> Reading symbols from /usr/lib64/libsasl2.so.2...(no debugging symbols
> found)...done.
> Loaded symbols for /usr/lib64/libsasl2.so.2
> Reading symbols from /lib64/libkrb5support.so.0...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libkrb5support.so.0
> Reading symbols from /lib64/libkeyutils.so.1...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libkeyutils.so.1
> Reading symbols from /lib64/libselinux.so.1...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libselinux.so.1
> Reading symbols from /usr/local/freeswitch/mod/mod_console.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_console.so
> Reading symbols from /usr/local/freeswitch/mod/mod_logfile.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_logfile.so
> Reading symbols from /usr/local/freeswitch/mod/mod_enum.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_enum.so
> Reading symbols from /usr/local/freeswitch/mod/mod_cdr_csv.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_cdr_csv.so
> Reading symbols from /usr/local/freeswitch/mod/mod_event_socket.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_event_socket.so
> Reading symbols from /usr/local/freeswitch/mod/mod_sofia.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_sofia.so
> Reading symbols from /usr/local/freeswitch/mod/mod_loopback.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_loopback.so
> Reading symbols from /usr/local/freeswitch/mod/mod_commands.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_commands.so
> Reading symbols from /usr/local/freeswitch/mod/mod_conference.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_conference.so
> Reading symbols from /usr/local/freeswitch/mod/mod_db.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_db.so
> Reading symbols from /usr/local/freeswitch/mod/mod_dptools.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_dptools.so
> Reading symbols from /usr/local/freeswitch/mod/mod_expr.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_expr.so
> Reading symbols from /usr/local/freeswitch/mod/mod_fifo.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_fifo.so
> Reading symbols from /usr/local/freeswitch/mod/mod_hash.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_hash.so
> Reading symbols from /usr/local/freeswitch/mod/mod_voicemail.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_voicemail.so
> Reading symbols from /usr/local/freeswitch/mod/mod_esf.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_esf.so
> Reading symbols from /usr/local/freeswitch/mod/mod_fsv.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_fsv.so
> Reading symbols from /usr/local/freeswitch/mod/mod_cluechoo.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_cluechoo.so
> Reading symbols from /lib64/libncurses.so.5...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libncurses.so.5
> Reading symbols from /usr/local/freeswitch/mod/mod_valet_parking.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_valet_parking.so
> Reading symbols from /usr/local/freeswitch/mod/mod_httapi.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_httapi.so
> Reading symbols from /usr/local/freeswitch/mod/mod_dialplan_xml.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_dialplan_xml.so
> Reading symbols from
> /usr/local/freeswitch/mod/mod_dialplan_asterisk.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_dialplan_asterisk.so
> Reading symbols from /usr/local/freeswitch/mod/mod_spandsp.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_spandsp.so
> Reading symbols from /lib64/libutil.so.1...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libutil.so.1
> Reading symbols from /usr/local/freeswitch/mod/mod_g723_1.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_g723_1.so
> Reading symbols from /usr/local/freeswitch/mod/mod_g729.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_g729.so
> Reading symbols from /usr/local/freeswitch/mod/mod_amr.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_amr.so
> Reading symbols from /usr/local/freeswitch/mod/mod_speex.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_speex.so
> Reading symbols from /usr/local/freeswitch/mod/mod_h26x.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_h26x.so
> Reading symbols from /usr/local/freeswitch/mod/mod_vp8.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_vp8.so
> Reading symbols from /usr/local/freeswitch/mod/mod_b64.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_b64.so
> Reading symbols from /usr/local/freeswitch/mod/mod_sndfile.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_sndfile.so
> Reading symbols from /usr/local/freeswitch/mod/mod_native_file.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_native_file.so
> Reading symbols from /usr/local/freeswitch/mod/mod_local_stream.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_local_stream.so
> Reading symbols from /usr/local/freeswitch/mod/mod_tone_stream.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_tone_stream.so
> Reading symbols from /usr/local/freeswitch/mod/mod_lua.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_lua.so
> Reading symbols from /usr/local/freeswitch/mod/mod_say_en.so...done.
> Loaded symbols for /usr/local/freeswitch/mod/mod_say_en.so
> Reading symbols from /usr/local/lib/lua/5.1/luasql/odbc.so...(no debugging
> symbols found)...done.
> Loaded symbols for /usr/local/lib/lua/5.1/luasql/odbc.so
> Reading symbols from /usr/local/lib/lua/5.1/cjson.so...(no debugging
> symbols found)...done.
> Loaded symbols for /usr/local/lib/lua/5.1/cjson.so
> Reading symbols from /usr/local/lib/lua/5.1/socket/core.so...(no debugging
> symbols found)...done.
> Loaded symbols for /usr/local/lib/lua/5.1/socket/core.so
> Reading symbols from /usr/local/lib/lua/5.1/ssl.so...(no debugging symbols
> found)...done.
> Loaded symbols for /usr/local/lib/lua/5.1/ssl.so
> Core was generated by `./freeswitch -nc'.
> Program terminated with signal 6, Aborted.
> #0  0x000000352dc32625 in raise () from /lib64/libc.so.6
> Missing separate debuginfos, use: debuginfo-install
> cyrus-sasl-lib-2.1.23-15.el6_6.2.x86_64 glibc-2.12-1.166.el6_7.1.x86_64
> keyutils-libs-1.4-5.el6.x86_64 krb5-libs-1.10.3-42.el6.x86_64
> libcom_err-1.41.12-22.el6.x86_64 libcurl-7.19.7-46.el6.x86_64
> libgcc-4.4.7-16.el6.x86_64 libidn-1.18-2.el6.x86_64
> libjpeg-turbo-1.2.1-3.el6_5.x86_64 libselinux-2.0.94-5.8.el6.x86_64
> libssh2-1.4.2-1.el6_6.1.x86_64 libstdc++-4.4.7-16.el6.x86_64
> libtool-ltdl-2.2.6-15.5.el6.x86_64 ncurses-libs-5.7-4.20090207.el6.x86_64
> nspr-4.10.8-1.el6_6.x86_64 nss-3.19.1-3.el6_6.x86_64
> nss-softokn-freebl-3.14.3-22.el6_6.x86_64 nss-util-3.19.1-1.el6_6.x86_64
> openldap-2.4.40-5.el6.x86_64 openssl-1.0.1e-42.el6.x86_64
> unixODBC-2.2.14-14.el6.x86_64 zlib-1.2.3-29.el6.x86_64
>
> **** Second command: set pagination off*
> **** Output:*
> (gdb) set pagination off
>
>
> **** Third command: info threads*
> **** Output:*
> (gdb) info threads
>   35 Thread 0x7fad0eb34700 (LWP 20777)  0x000000352e00e7dd in read () from
> /lib64/libpthread.so.0
>   34 Thread 0x7fad60076700 (LWP 20749)  0x000000352e00b63c in
> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>   33 Thread 0x7fad4b2be700 (LWP 20752)  0x000000352e00b63c in
> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>   32 Thread 0x7fad0f51b700 (LWP 20766)  0x000000352e00e7dd in read () from
> /lib64/libpthread.so.0
>   31 Thread 0x7fad48ab6700 (LWP 20761)  0x000000352e00b63c in
> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>   30 Thread 0x7fad4a1ec700 (LWP 20760)  0x000000352dce1423 in select ()
> from /lib64/libc.so.6
>   29 Thread 0x7fad4a228700 (LWP 20759)  0x000000352e00b63c in
> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>   28 Thread 0x7fad4bdfc700 (LWP 20747)  0x000000352dce8fa3 in epoll_wait
> () from /lib64/libc.so.6
>   27 Thread 0x7fad61fd1700 (LWP 20736)  0x000000352e00b63c in
> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>   26 Thread 0x7fad637e8700 (LWP 20733)  0x000000352e00b63c in
> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>   25 Thread 0x7fad0f593700 (LWP 20767)  0x000000352e00eadd in accept ()
> from /lib64/libpthread.so.0
>   24 Thread 0x7fad63899700 (LWP 20730)  0x000000352e00b63c in
> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>   23 Thread 0x7fad63938700 (LWP 20729)  0x000000352e00ba0e in
> pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>   22 Thread 0x7fad0ecfa700 (LWP 20771)  0x000000352dcdf183 in poll () from
> /lib64/libc.so.6
>   21 Thread 0x7fad60fb5700 (LWP 20746)  0x000000352dce8fa3 in epoll_wait
> () from /lib64/libc.so.6
>   20 Thread 0x7fad0f557700 (LWP 20768)  0x000000352e00b63c in
> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>   19 Thread 0x7fad48058700 (LWP 20769)  0x000000352e00b63c in
> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>   18 Thread 0x7fad61d6f700 (LWP 20758)  0x000000352e00b63c in
> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>   17 Thread 0x7fad636e7700 (LWP 20745)  0x000000352dce8fa3 in epoll_wait
> () from /lib64/libc.so.6
>   16 Thread 0x7fad4b282700 (LWP 20753)  0x000000352dce1423 in select ()
> from /lib64/libc.so.6
>   15 Thread 0x7fad61069700 (LWP 20742)  0x000000352dce8fa3 in epoll_wait
> () from /lib64/libc.so.6
>   14 Thread 0x7fad6102d700 (LWP 20743)  0x000000352dce8fa3 in epoll_wait
> () from /lib64/libc.so.6
>   13 Thread 0x7fad60ff1700 (LWP 20744)  0x000000352dce8fa3 in epoll_wait
> () from /lib64/libc.so.6
>   12 Thread 0x7fad610a5700 (LWP 20741)  0x000000352e00b63c in
> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>   11 Thread 0x7fad4b2fa700 (LWP 20751)  0x000000352dce1423 in select ()
> from /lib64/libc.so.6
>   10 Thread 0x7fad61f95700 (LWP 20737)  0x000000352dce1423 in select ()
> from /lib64/libc.so.6
>   9 Thread 0x7fad4b336700 (LWP 20750)  0x000000352dce1423 in select ()
> from /lib64/libc.so.6
>   8 Thread 0x7fad62ce6700 (LWP 20738)  0x000000352e00ba0e in
> pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>   7 Thread 0x7fad0e840700 (LWP 20800)  0x000000352e00e2e4 in
> __lll_lock_wait () from /lib64/libpthread.so.0
>   6 Thread 0x7fad0eabc700 (LWP 20795)  0x000000353a46a340 in CRYPTO_lock
> () from /usr/lib64/libcrypto.so.10
>   5 Thread 0x7fad0e1e0700 (LWP 20802)  0x00007fad0f0ba13c in luaS_newlstr
> (L=0x7facd80008c0, str=0x7facd8013630 "result_tabletabletright (C)
> 2009-2014 PUC-Rio\"", l=12) at lstring.c:81
>   4 Thread 0x7fad600b2700 (LWP 20748)  0x000000352e00b63c in
> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
>   3 Thread 0x7fad63a39700 (LWP 20728)  0x000000352dce1423 in select ()
> from /lib64/libc.so.6
>   2 Thread 0x7fad63b017e0 (LWP 20727)  0x000000352dce1423 in select ()
> from /lib64/libc.so.6
> * 1 Thread 0x7fad0ea80700 (LWP 20798)  0x000000352dc32625 in raise () from
> /lib64/libc.so.6
>
>
> **** Fourth command: bt*
> **** Output:*
> (gdb) bt
> #0  0x000000352dc32625 in raise () from /lib64/libc.so.6
> #1  0x000000352dc33e05 in abort () from /lib64/libc.so.6
> #2  0x000000352dc70537 in __libc_message () from /lib64/libc.so.6
> #3  0x000000352dc75e66 in malloc_printerr () from /lib64/libc.so.6
> #4  0x000000352dc7897a in _int_free () from /lib64/libc.so.6
> #5  0x000000353a46ad5d in CRYPTO_free () from /usr/lib64/libcrypto.so.10
> #6  0x000000353a46ddc2 in OBJ_NAME_add () from /usr/lib64/libcrypto.so.10
> #7  0x000000353a4f0257 in EVP_add_cipher () from /usr/lib64/libcrypto.so.10
> #8  0x000000353a4f48e4 in OpenSSL_add_all_ciphers () from
> /usr/lib64/libcrypto.so.10
> #9  0x000000353a4f440e in OPENSSL_add_all_algorithms_noconf () from
> /usr/lib64/libcrypto.so.10
> #10 0x00007fad0e1e8c59 in luaopen_ssl_core () from
> /usr/local/lib/lua/5.1/ssl.so
> #11 0x00007fad0f0b4011 in luaD_precall (L=0x7face00008c0,
> func=0x7face0027a70, nresults=1) at ldo.c:319
> #12 0x00007fad0f0b4494 in luaD_call (L=0x7face00008c0,
> func=0x7face0027a70, nResults=<value optimized out>) at ldo.c:376
> #13 0x00007fad0f0b1496 in lua_call (L=0x7face00008c0, nargs=<value
> optimized out>, nresults=1) at lapi.c:782
> #14 0x00007fad0f0ca16c in ll_require (L=0x7face00008c0) at loadlib.c:484
> #15 0x00007fad0f0b4011 in luaD_precall (L=0x7face00008c0,
> func=0x7face0027a10, nresults=1) at ldo.c:319
> #16 0x00007fad0f0bd759 in luaV_execute (L=<value optimized out>,
> nexeccalls=1) at lvm.c:587
> #17 0x00007fad0f0b44dd in luaD_call (L=0x7face00008c0,
> func=0x7face00279f0, nResults=<value optimized out>) at ldo.c:377
> #18 0x00007fad0f0b1496 in lua_call (L=0x7face00008c0, nargs=<value
> optimized out>, nresults=1) at lapi.c:782
> #19 0x00007fad0f0ca16c in ll_require (L=0x7face00008c0) at loadlib.c:484
> #20 0x00007fad0f0b4011 in luaD_precall (L=0x7face00008c0,
> func=0x7face0027990, nresults=1) at ldo.c:319
> #21 0x00007fad0f0bd759 in luaV_execute (L=<value optimized out>,
> nexeccalls=1) at lvm.c:587
> #22 0x00007fad0f0b44dd in luaD_call (L=0x7face00008c0,
> func=0x7face0000d10, nResults=<value optimized out>) at ldo.c:377
> #23 0x00007fad0f0b1496 in lua_call (L=0x7face00008c0, nargs=<value
> optimized out>, nresults=1) at lapi.c:782
> #24 0x00007fad0f0ca16c in ll_require (L=0x7face00008c0) at loadlib.c:484
> #25 0x00007fad0f0b4011 in luaD_precall (L=0x7face00008c0,
> func=0x7face0000cb0, nresults=1) at ldo.c:319
> #26 0x00007fad0f0bd759 in luaV_execute (L=<value optimized out>,
> nexeccalls=1) at lvm.c:587
> #27 0x00007fad0f0b44dd in luaD_call (L=0x7face00008c0,
> func=0x7face0000ca0, nResults=<value optimized out>) at ldo.c:377
> #28 0x00007fad0f0b3b77 in luaD_rawrunprotected (L=0x7face00008c0,
> f=0x7fad0f0b1460 <f_call>, ud=0x7fad0ea7f870) at ldo.c:116
> #29 0x00007fad0f0b3bf2 in luaD_pcall (L=0x7face00008c0, func=<value
> optimized out>, u=<value optimized out>, old_top=32, ef=<value optimized
> out>) at ldo.c:463
> #30 0x00007fad0f0b12a1 in lua_pcall (L=0x7face00008c0, nargs=0,
> nresults=0, errfunc=<value optimized out>) at lapi.c:821
> #31 0x00007fad0f097997 in docall (L=0x7face00008c0, narg=0, nresults=0,
> perror=0, fatal=1) at mod_lua.cpp:92
> #32 0x00007fad0f098044 in lua_parse_and_execute (L=0x7face00008c0,
> input_code=0x7face8005ac0 "cv2agent.lua") at mod_lua.cpp:195
> #33 0x00007fad0f098d6d in lua_thread_run (thread=<value optimized out>,
> obj=<value optimized out>) at mod_lua.cpp:222
> #34 0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #35 0x000000352dce89ad in clone () from /lib64/libc.so.6
>
>
> **** Fifth command: bt full*
> **** Output:*
> (gdb) bt full
> #0  0x000000352dc32625 in raise () from /lib64/libc.so.6
> No symbol table info available.
> #1  0x000000352dc33e05 in abort () from /lib64/libc.so.6
> No symbol table info available.
> #2  0x000000352dc70537 in __libc_message () from /lib64/libc.so.6
> No symbol table info available.
> #3  0x000000352dc75e66 in malloc_printerr () from /lib64/libc.so.6
> No symbol table info available.
> #4  0x000000352dc7897a in _int_free () from /lib64/libc.so.6
> No symbol table info available.
> #5  0x000000353a46ad5d in CRYPTO_free () from /usr/lib64/libcrypto.so.10
> No symbol table info available.
> #6  0x000000353a46ddc2 in OBJ_NAME_add () from /usr/lib64/libcrypto.so.10
> No symbol table info available.
> #7  0x000000353a4f0257 in EVP_add_cipher () from /usr/lib64/libcrypto.so.10
> No symbol table info available.
> #8  0x000000353a4f48e4 in OpenSSL_add_all_ciphers () from
> /usr/lib64/libcrypto.so.10
> No symbol table info available.
> #9  0x000000353a4f440e in OPENSSL_add_all_algorithms_noconf () from
> /usr/lib64/libcrypto.so.10
> No symbol table info available.
> #10 0x00007fad0e1e8c59 in luaopen_ssl_core () from
> /usr/local/lib/lua/5.1/ssl.so
> No symbol table info available.
> #11 0x00007fad0f0b4011 in luaD_precall (L=0x7face00008c0,
> func=0x7face0027a70, nresults=1) at ldo.c:319
>         ci = <value optimized out>
>         n = <value optimized out>
>         cl = <value optimized out>
>         funcr = <value optimized out>
> #12 0x00007fad0f0b4494 in luaD_call (L=0x7face00008c0,
> func=0x7face0027a70, nResults=<value optimized out>) at ldo.c:376
> No locals.
> #13 0x00007fad0f0b1496 in lua_call (L=0x7face00008c0, nargs=<value
> optimized out>, nresults=1) at lapi.c:782
>         func = <value optimized out>
> #14 0x00007fad0f0ca16c in ll_require (L=0x7face00008c0) at loadlib.c:484
>         name = 0x7face0038bf8 "ssl.core"
>         i = 4
> #15 0x00007fad0f0b4011 in luaD_precall (L=0x7face00008c0,
> func=0x7face0027a10, nresults=1) at ldo.c:319
>         ci = <value optimized out>
>         n = <value optimized out>
>         cl = <value optimized out>
>         funcr = <value optimized out>
> #16 0x00007fad0f0bd759 in luaV_execute (L=<value optimized out>,
> nexeccalls=1) at lvm.c:587
>         b = <value optimized out>
>         nresults = 1
>         i = <value optimized out>
>         ra = 0x7face0027a10
>         cl = 0x7face0021ae0
>         base = <value optimized out>
>         k = 0x7face0038f40
>         pc = 0x7face003babc
> #17 0x00007fad0f0b44dd in luaD_call (L=0x7face00008c0,
> func=0x7face00279f0, nResults=<value optimized out>) at ldo.c:377
> No locals.
> #18 0x00007fad0f0b1496 in lua_call (L=0x7face00008c0, nargs=<value
> optimized out>, nresults=1) at lapi.c:782
>         func = <value optimized out>
> #19 0x00007fad0f0ca16c in ll_require (L=0x7face00008c0) at loadlib.c:484
>         name = 0x7face001d528 "ssl"
>         i = 2
> #20 0x00007fad0f0b4011 in luaD_precall (L=0x7face00008c0,
> func=0x7face0027990, nresults=1) at ldo.c:319
>         ci = <value optimized out>
>         n = <value optimized out>
>         cl = <value optimized out>
>         funcr = <value optimized out>
> #21 0x00007fad0f0bd759 in luaV_execute (L=<value optimized out>,
> nexeccalls=1) at lvm.c:587
>         b = <value optimized out>
>         nresults = 1
>         i = <value optimized out>
>         ra = 0x7face0027990
>         cl = 0x7face001d7c0
>         base = <value optimized out>
>         k = 0x7face002a600
>         pc = 0x7face002a878
> #22 0x00007fad0f0b44dd in luaD_call (L=0x7face00008c0,
> func=0x7face0000d10, nResults=<value optimized out>) at ldo.c:377
> No locals.
> #23 0x00007fad0f0b1496 in lua_call (L=0x7face00008c0, nargs=<value
> optimized out>, nresults=1) at lapi.c:782
>         func = <value optimized out>
> #24 0x00007fad0f0ca16c in ll_require (L=0x7face00008c0) at loadlib.c:484
>         name = 0x7face0014368 "ssl.https"
>         i = 2
> #25 0x00007fad0f0b4011 in luaD_precall (L=0x7face00008c0,
> func=0x7face0000cb0, nresults=1) at ldo.c:319
>         ci = <value optimized out>
>         n = <value optimized out>
>         cl = <value optimized out>
>         funcr = <value optimized out>
> #26 0x00007fad0f0bd759 in luaV_execute (L=<value optimized out>,
> nexeccalls=1) at lvm.c:587
>         b = <value optimized out>
>         nresults = 1
>         i = <value optimized out>
>         ra = 0x7face0000cb0
>         cl = 0x7face002cf80
>         base = <value optimized out>
>         k = 0x7face0016190
>         pc = 0x7face002c65c
> #27 0x00007fad0f0b44dd in luaD_call (L=0x7face00008c0,
> func=0x7face0000ca0, nResults=<value optimized out>) at ldo.c:377
> No locals.
> #28 0x00007fad0f0b3b77 in luaD_rawrunprotected (L=0x7face00008c0,
> f=0x7fad0f0b1460 <f_call>, ud=0x7fad0ea7f870) at ldo.c:116
>         lj = {previous = 0x0, b = {{__jmpbuf = {140380469201088,
> 232850695908416477, 1, 0, 32, 140380469201712, -260824814595154979,
> -260823472281166883}, __mask_was_saved = 0, __saved_mask = {__val = {0, 0,
> 0, 206158430211, 532575944795, 472446402679, 2314885530818453536,
> 140380469201272, 40, 140380469198880, 140380469201088, 1, 0, 228401325905,
> 140380469201272, 40}}}}, status = 0}
> #29 0x00007fad0f0b3bf2 in luaD_pcall (L=0x7face00008c0, func=<value
> optimized out>, u=<value optimized out>, old_top=32, ef=<value optimized
> out>) at ldo.c:463
>         status = <value optimized out>
>         oldnCcalls = 0
>         old_ci = 0
>         old_allowhooks = 1 '\001'
>         old_errfunc = 0
> #30 0x00007fad0f0b12a1 in lua_pcall (L=0x7face00008c0, nargs=0,
> nresults=0, errfunc=<value optimized out>) at lapi.c:821
>         c = {func = 0x7face0000ca0, nresults = 0}
>         status = <value optimized out>
>         func = <value optimized out>
> #31 0x00007fad0f097997 in docall (L=0x7face00008c0, narg=0, nresults=0,
> perror=0, fatal=1) at mod_lua.cpp:92
>         status = <value optimized out>
>         base = 1
>         __func__ = "docall"
> #32 0x00007fad0f098044 in lua_parse_and_execute (L=0x7face00008c0,
> input_code=0x7face8005ac0 "cv2agent.lua") at mod_lua.cpp:195
>         file = <value optimized out>
>         fdup = 0x7face0013250 "/usr/local/freeswitch/scripts/cv2agent.lua"
>         args = <value optimized out>
>         error = <value optimized out>
>         __func__ = "lua_parse_and_execute"
>         __PRETTY_FUNCTION__ = "int lua_parse_and_execute(lua_State*,
> char*)"
> #33 0x00007fad0f098d6d in lua_thread_run (thread=<value optimized out>,
> obj=<value optimized out>) at mod_lua.cpp:222
>         lth = 0x7face8005ab0
>         pool = 0x7face80059d8
>         L = 0x7face00008c0
>         __func__ = "lua_thread_run"
> #34 0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> No symbol table info available.
> #35 0x000000352dce89ad in clone () from /lib64/libc.so.6
> No symbol table info available.
>
>
> **** Sixth Command: thread apply all bt*
> **** Output:*
> (gdb) thread apply all bt
>
> Thread 35 (Thread 0x7fad0eb34700 (LWP 20777)):
> #0  0x000000352e00e7dd in read () from /lib64/libpthread.so.0
> #1  0x00007fad63c27127 in apr_socket_recv (sock=0x7facfc006e70,
> buf=0x7face40008c0 "b", len=0x7fad0eb336d0) at network_io/unix/sendrecv.c:81
> #2  0x00007fad63b5f189 in switch_socket_recv (sock=<value optimized out>,
> buf=<value optimized out>, len=<value optimized out>) at
> src/switch_apr.c:765
> #3  0x00007fad614e3d18 in read_packet (listener=0x7facfc007060,
> event=0x7fad0eb33d88, timeout=0) at
> /usr/local/src/freeswitch/src/mod/event_handlers/mod_event_socket/mod_event_socket.c:1144
> #4  0x00007fad614e9bcc in listener_run (thread=<value optimized out>,
> obj=0x7facfc007060) at
> /usr/local/src/freeswitch/src/mod/event_handlers/mod_event_socket/mod_event_socket.c:2599
> #5  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #6  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 34 (Thread 0x7fad60076700 (LWP 20749)):
> #0  0x000000352e00b63c in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1  0x00007fad63b87379 in switch_user_sql_thread (thread=<value optimized
> out>, obj=0x7fad3c016990) at src/switch_core_sqldb.c:1894
> #2  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #3  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 33 (Thread 0x7fad4b2be700 (LWP 20752)):
> #0  0x000000352e00b63c in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1  0x00007fad63b87379 in switch_user_sql_thread (thread=<value optimized
> out>, obj=0x7fad40016990) at src/switch_core_sqldb.c:1894
> #2  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #3  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 32 (Thread 0x7fad0f51b700 (LWP 20766)):
> #0  0x000000352e00e7dd in read () from /lib64/libpthread.so.0
> #1  0x00007fad63bfb872 in softtimer_runtime () at src/switch_time.c:940
> #2  0x00007fad63ba5663 in switch_loadable_module_exec (thread=0x8eeb78,
> obj=0x8ee658) at src/switch_loadable_module.c:98
> #3  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #4  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 31 (Thread 0x7fad48ab6700 (LWP 20761)):
> #0  0x000000352e00b63c in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1  0x00007fad48ae2eec in timer_thread_run (thread=<value optimized out>,
> obj=<value optimized out>) at mod_spandsp_fax.c:211
> #2  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #3  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 30 (Thread 0x7fad4a1ec700 (LWP 20760)):
> #0  0x000000352dce1423 in select () from /lib64/libc.so.6
> #1  0x00007fad63c2a855 in apr_sleep (t=<value optimized out>) at
> time/unix/time.c:246
> #2  0x00007fad63bfa09e in do_sleep (t=<value optimized out>) at
> src/switch_time.c:171
> #3  0x00007fad4a3bd151 in node_thread_run (thread=<value optimized out>,
> obj=<value optimized out>) at
> /usr/local/src/freeswitch/src/mod/applications/mod_fifo/mod_fifo.c:2047
> #4  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #5  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 29 (Thread 0x7fad4a228700 (LWP 20759)):
> #0  0x000000352e00b63c in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1  0x00007fad63b87379 in switch_user_sql_thread (thread=<value optimized
> out>, obj=0x963bd0) at src/switch_core_sqldb.c:1894
> #2  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #3  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 28 (Thread 0x7fad4bdfc700 (LWP 20747)):
> #0  0x000000352dce8fa3 in epoll_wait () from /lib64/libc.so.6
> #1  0x00007fad61242af5 in su_epoll_port_wait_events (self=0x7fad280008c0,
> tout=<value optimized out>) at su_epoll_port.c:495
> #2  0x00007fad61245ea8 in su_base_port_run (self=0x7fad280008c0) at
> su_base_port.c:349
> #3  0x00007fad61243d75 in su_pthread_port_clone_main (varg=0x7fad60ff0690)
> at su_pthread_port.c:343
> #4  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #5  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 27 (Thread 0x7fad61fd1700 (LWP 20736)):
> #0  0x000000352e00b63c in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1  0x00007fad63b87379 in switch_user_sql_thread (thread=<value optimized
> out>, obj=0x8e1830) at src/switch_core_sqldb.c:1894
> #2  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #3  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 26 (Thread 0x7fad637e8700 (LWP 20733)):
> #0  0x000000352e00b63c in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1  0x00007fad63c19af1 in apr_queue_pop (queue=0x7fad638fbe70,
> data=0x7fad637e7db8) at misc/apr_queue.c:276
> #2  0x00007fad63bef9a1 in log_thread (t=<value optimized out>, obj=<value
> optimized out>) at src/switch_log.c:294
> #3  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #4  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 25 (Thread 0x7fad0f593700 (LWP 20767)):
> #0  0x000000352e00eadd in accept () from /lib64/libpthread.so.0
> #1  0x00007fad63c27fe4 in apr_socket_accept (new=0x7fad0f592d40,
> sock=0x7facfc000c10, connection_context=0x7facfc00af88) at
> network_io/unix/sockets.c:191
> #2  0x00007fad614e91a9 in mod_event_socket_runtime () at
> /usr/local/src/freeswitch/src/mod/event_handlers/mod_event_socket/mod_event_socket.c:2835
> #3  0x00007fad63ba5663 in switch_loadable_module_exec (thread=0x8ef030,
> obj=0x8eec10) at src/switch_loadable_module.c:98
> #4  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #5  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 24 (Thread 0x7fad63899700 (LWP 20730)):
> #0  0x000000352e00b63c in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1  0x00007fad63c19af1 in apr_queue_pop (queue=0x782cb0,
> data=0x7fad63898d98) at misc/apr_queue.c:276
> #2  0x00007fad63bb0de7 in switch_event_dispatch_thread (thread=<value
> optimized out>, obj=0x782cb0) at src/switch_event.c:305
> #3  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #4  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 23 (Thread 0x7fad63938700 (LWP 20729)):
> #0  0x000000352e00ba0e in pthread_cond_timedwait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1  0x00007fad63c230bd in apr_thread_cond_timedwait (cond=0x7fad63a9be98,
> mutex=0x7fad63a9bef0, timeout=10000) at locks/unix/thread_cond.c:89
> #2  0x00007fad63b5f8a9 in switch_thread_cond_timedwait (cond=<value
> optimized out>, mutex=<value optimized out>, timeout=<value optimized out>)
> at src/switch_apr.c:380
> #3  0x00007fad63b883b6 in switch_core_session_thread_pool_manager
> (thread=<value optimized out>, obj=<value optimized out>) at
> src/switch_core_session.c:1788
> #4  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #5  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 22 (Thread 0x7fad0ecfa700 (LWP 20771)):
> #0  0x000000352dcdf183 in poll () from /lib64/libc.so.6
> #1  0x00007fad63c29058 in apr_poll (aprset=0x7fad0edbe6e8, num=1,
> nsds=0x7fad0ecf96dc, timeout=<value optimized out>) at poll/unix/poll.c:117
> #2  0x00007fad63b5ed33 in switch_poll (aprset=<value optimized out>,
> numsock=<value optimized out>, nsds=<value optimized out>, timeout=<value
> optimized out>) at src/switch_apr.c:957
> #3  0x00007fad614e41be in read_packet (listener=0x7facfc003040,
> event=0x7fad0ecf9d88, timeout=0) at
> /usr/local/src/freeswitch/src/mod/event_handlers/mod_event_socket/mod_event_socket.c:1381
> #4  0x00007fad614e9bcc in listener_run (thread=<value optimized out>,
> obj=0x7facfc003040) at
> /usr/local/src/freeswitch/src/mod/event_handlers/mod_event_socket/mod_event_socket.c:2599
> #5  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #6  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 21 (Thread 0x7fad60fb5700 (LWP 20746)):
> #0  0x000000352dce8fa3 in epoll_wait () from /lib64/libc.so.6
> #1  0x00007fad61242af5 in su_epoll_port_wait_events (self=0x7fad340008c0,
> tout=<value optimized out>) at su_epoll_port.c:495
> #2  0x00007fad61245ea8 in su_base_port_run (self=0x7fad340008c0) at
> su_base_port.c:349
> #3  0x00007fad61243d75 in su_pthread_port_clone_main (varg=0x7fad6102c690)
> at su_pthread_port.c:343
> #4  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #5  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 20 (Thread 0x7fad0f557700 (LWP 20768)):
> #0  0x000000352e00b63c in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1  0x00007fad63c19af1 in apr_queue_pop (queue=0x8ef0b0,
> data=0x7fad0f556db8) at misc/apr_queue.c:276
> #2  0x00007fad63ba71e7 in chat_thread_run (thread=<value optimized out>,
> obj=0x8ef0b0) at src/switch_loadable_module.c:680
> #3  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #4  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 19 (Thread 0x7fad48058700 (LWP 20769)):
> #0  0x000000352e00b63c in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1  0x00007fad63c19af1 in apr_queue_pop (queue=0xa0ef60,
> data=0x7fad48057db8) at misc/apr_queue.c:276
> #2  0x00007fad63ba71e7 in chat_thread_run (thread=<value optimized out>,
> obj=0xa0ef60) at src/switch_loadable_module.c:680
> #3  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #4  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 18 (Thread 0x7fad61d6f700 (LWP 20758)):
> #0  0x000000352e00b63c in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1  0x00007fad63c19af1 in apr_queue_pop (queue=0x90e7e8,
> data=0x7fad61d6ed98) at misc/apr_queue.c:276
> #2  0x00007fad61198dc9 in sofia_presence_event_thread_run (thread=<value
> optimized out>, obj=<value optimized out>) at sofia_presence.c:1615
> #3  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #4  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 17 (Thread 0x7fad636e7700 (LWP 20745)):
> #0  0x000000352dce8fa3 in epoll_wait () from /lib64/libc.so.6
> #1  0x00007fad61242af5 in su_epoll_port_wait_events (self=0x7fad300008c0,
> tout=<value optimized out>) at su_epoll_port.c:495
> #2  0x00007fad61245ea8 in su_base_port_run (self=0x7fad300008c0) at
> su_base_port.c:349
> #3  0x00007fad61243d75 in su_pthread_port_clone_main (varg=0x7fad61068690)
> at su_pthread_port.c:343
> #4  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #5  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 16 (Thread 0x7fad4b282700 (LWP 20753)):
> #0  0x000000352dce1423 in select () from /lib64/libc.so.6
> #1  0x00007fad63c2a855 in apr_sleep (t=<value optimized out>) at
> time/unix/time.c:246
> #2  0x00007fad63bfa09e in do_sleep (t=<value optimized out>) at
> src/switch_time.c:171
> #3  0x00007fad6115ae02 in sofia_profile_worker_thread_run (thread=<value
> optimized out>, obj=0x91d610) at sofia.c:2308
> #4  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #5  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 15 (Thread 0x7fad61069700 (LWP 20742)):
> #0  0x000000352dce8fa3 in epoll_wait () from /lib64/libc.so.6
> #1  0x00007fad61242af5 in su_epoll_port_wait_events (self=0x7fad400008c0,
> tout=<value optimized out>) at su_epoll_port.c:495
> #2  0x00007fad61245cc2 in su_base_port_step (self=0x7fad400008c0,
> tout=1000) at su_base_port.c:467
> #3  0x00007fad61173d7a in sofia_profile_thread_run (thread=<value
> optimized out>, obj=0x91d610) at sofia.c:2666
> #4  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #5  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 14 (Thread 0x7fad6102d700 (LWP 20743)):
> #0  0x000000352dce8fa3 in epoll_wait () from /lib64/libc.so.6
> #1  0x00007fad61242af5 in su_epoll_port_wait_events (self=0x7fad380008c0,
> tout=<value optimized out>) at su_epoll_port.c:495
> #2  0x00007fad61245cc2 in su_base_port_step (self=0x7fad380008c0,
> tout=1000) at su_base_port.c:467
> #3  0x00007fad61173d7a in sofia_profile_thread_run (thread=<value
> optimized out>, obj=0x9217e0) at sofia.c:2666
> #4  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #5  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 13 (Thread 0x7fad60ff1700 (LWP 20744)):
> #0  0x000000352dce8fa3 in epoll_wait () from /lib64/libc.so.6
> #1  0x00007fad61242af5 in su_epoll_port_wait_events (self=0x7fad3c0008c0,
> tout=<value optimized out>) at su_epoll_port.c:495
> #2  0x00007fad61245cc2 in su_base_port_step (self=0x7fad3c0008c0,
> tout=1000) at su_base_port.c:467
> #3  0x00007fad61173d7a in sofia_profile_thread_run (thread=<value
> optimized out>, obj=0x925b00) at sofia.c:2666
> #4  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #5  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 12 (Thread 0x7fad610a5700 (LWP 20741)):
> #0  0x000000352e00b63c in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1  0x00007fad63c19af1 in apr_queue_pop (queue=0x7fad61107ad8,
> data=0x7fad610a4da8) at misc/apr_queue.c:276
> #2  0x00007fad6116c271 in sofia_msg_thread_run (thread=<value optimized
> out>, obj=0x7fad61107ad8) at sofia.c:1669
> #3  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #4  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 11 (Thread 0x7fad4b2fa700 (LWP 20751)):
> #0  0x000000352dce1423 in select () from /lib64/libc.so.6
> #1  0x00007fad63c2a855 in apr_sleep (t=<value optimized out>) at
> time/unix/time.c:246
> #2  0x00007fad63bfa09e in do_sleep (t=<value optimized out>) at
> src/switch_time.c:171
> #3  0x00007fad6115ae02 in sofia_profile_worker_thread_run (thread=<value
> optimized out>, obj=0x925b00) at sofia.c:2308
> #4  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #5  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 10 (Thread 0x7fad61f95700 (LWP 20737)):
> #0  0x000000352dce1423 in select () from /lib64/libc.so.6
> #1  0x00007fad63c2a855 in apr_sleep (t=<value optimized out>) at
> time/unix/time.c:246
> #2  0x00007fad63bfa09e in do_sleep (t=<value optimized out>) at
> src/switch_time.c:171
> #3  0x00007fad63b82ead in switch_core_sql_db_thread (thread=<value
> optimized out>, obj=<value optimized out>) at src/switch_core_sqldb.c:1238
> #4  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #5  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 9 (Thread 0x7fad4b336700 (LWP 20750)):
> #0  0x000000352dce1423 in select () from /lib64/libc.so.6
> #1  0x00007fad63c2a855 in apr_sleep (t=<value optimized out>) at
> time/unix/time.c:246
> #2  0x00007fad63bfa09e in do_sleep (t=<value optimized out>) at
> src/switch_time.c:171
> #3  0x00007fad6115ae02 in sofia_profile_worker_thread_run (thread=<value
> optimized out>, obj=0x9217e0) at sofia.c:2308
> #4  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #5  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 8 (Thread 0x7fad62ce6700 (LWP 20738)):
> #0  0x000000352e00ba0e in pthread_cond_timedwait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1  0x00007fad63c230bd in apr_thread_cond_timedwait (cond=0x8e79a8,
> mutex=0x8e7958, timeout=500000) at locks/unix/thread_cond.c:89
> #2  0x00007fad63c199d4 in apr_queue_pop_timeout (queue=0x8e7918,
> data=0x7fad62ce5db8, timeout=500000) at misc/apr_queue.c:339
> #3  0x00007fad63b9e2b8 in switch_scheduler_task_thread (thread=<value
> optimized out>, obj=<value optimized out>) at src/switch_scheduler.c:188
> #4  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #5  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 7 (Thread 0x7fad0e840700 (LWP 20800)):
> #0  0x000000352e00e2e4 in __lll_lock_wait () from /lib64/libpthread.so.0
> #1  0x000000352e0095a3 in _L_lock_892 () from /lib64/libpthread.so.0
> #2  0x000000352e009487 in pthread_mutex_lock () from /lib64/libpthread.so.0
> #3  0x000000353a4e7f8b in ?? () from /usr/lib64/libcrypto.so.10
> #4  0x000000353a4e7cdb in ?? () from /usr/lib64/libcrypto.so.10
> #5  0x000000353a4e768c in ?? () from /usr/lib64/libcrypto.so.10
> #6  0x000000353a4e8e48 in ERR_load_strings () from
> /usr/lib64/libcrypto.so.10
> #7  0x000000353a536b7e in ERR_load_CONF_strings () from
> /usr/lib64/libcrypto.so.10
> #8  0x000000353a4e8ea5 in ERR_load_crypto_strings () from
> /usr/lib64/libcrypto.so.10
> #9  0x000000353e445ae9 in SSL_load_error_strings () from
> /usr/lib64/libssl.so.10
> #10 0x00007fad0e1e8c5e in luaopen_ssl_core () from
> /usr/local/lib/lua/5.1/ssl.so
> #11 0x00007fad0f0b4011 in luaD_precall (L=0x7facd40008c0,
> func=0x7facd4027a70, nresults=1) at ldo.c:319
> #12 0x00007fad0f0b4494 in luaD_call (L=0x7facd40008c0,
> func=0x7facd4027a70, nResults=<value optimized out>) at ldo.c:376
> #13 0x00007fad0f0b1496 in lua_call (L=0x7facd40008c0, nargs=<value
> optimized out>, nresults=1) at lapi.c:782
> #14 0x00007fad0f0ca16c in ll_require (L=0x7facd40008c0) at loadlib.c:484
> #15 0x00007fad0f0b4011 in luaD_precall (L=0x7facd40008c0,
> func=0x7facd4027a10, nresults=1) at ldo.c:319
> #16 0x00007fad0f0bd759 in luaV_execute (L=<value optimized out>,
> nexeccalls=1) at lvm.c:587
> #17 0x00007fad0f0b44dd in luaD_call (L=0x7facd40008c0,
> func=0x7facd40279f0, nResults=<value optimized out>) at ldo.c:377
> #18 0x00007fad0f0b1496 in lua_call (L=0x7facd40008c0, nargs=<value
> optimized out>, nresults=1) at lapi.c:782
> #19 0x00007fad0f0ca16c in ll_require (L=0x7facd40008c0) at loadlib.c:484
> #20 0x00007fad0f0b4011 in luaD_precall (L=0x7facd40008c0,
> func=0x7facd4027990, nresults=1) at ldo.c:319
> #21 0x00007fad0f0bd759 in luaV_execute (L=<value optimized out>,
> nexeccalls=1) at lvm.c:587
> #22 0x00007fad0f0b44dd in luaD_call (L=0x7facd40008c0,
> func=0x7facd4000d10, nResults=<value optimized out>) at ldo.c:377
> #23 0x00007fad0f0b1496 in lua_call (L=0x7facd40008c0, nargs=<value
> optimized out>, nresults=1) at lapi.c:782
> #24 0x00007fad0f0ca16c in ll_require (L=0x7facd40008c0) at loadlib.c:484
> #25 0x00007fad0f0b4011 in luaD_precall (L=0x7facd40008c0,
> func=0x7facd4000cb0, nresults=1) at ldo.c:319
> #26 0x00007fad0f0bd759 in luaV_execute (L=<value optimized out>,
> nexeccalls=1) at lvm.c:587
> #27 0x00007fad0f0b44dd in luaD_call (L=0x7facd40008c0,
> func=0x7facd4000ca0, nResults=<value optimized out>) at ldo.c:377
> #28 0x00007fad0f0b3b77 in luaD_rawrunprotected (L=0x7facd40008c0,
> f=0x7fad0f0b1460 <f_call>, ud=0x7fad0e83f870) at ldo.c:116
> #29 0x00007fad0f0b3bf2 in luaD_pcall (L=0x7facd40008c0, func=<value
> optimized out>, u=<value optimized out>, old_top=32, ef=<value optimized
> out>) at ldo.c:463
> #30 0x00007fad0f0b12a1 in lua_pcall (L=0x7facd40008c0, nargs=0,
> nresults=0, errfunc=<value optimized out>) at lapi.c:821
> #31 0x00007fad0f097997 in docall (L=0x7facd40008c0, narg=0, nresults=0,
> perror=0, fatal=1) at mod_lua.cpp:92
> #32 0x00007fad0f098044 in lua_parse_and_execute (L=0x7facd40008c0,
> input_code=0x7face8009d00 "cv2agent.lua") at mod_lua.cpp:195
> #33 0x00007fad0f098d6d in lua_thread_run (thread=<value optimized out>,
> obj=<value optimized out>) at mod_lua.cpp:222
> #34 0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #35 0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 6 (Thread 0x7fad0eabc700 (LWP 20795)):
> #0  0x000000353a46a340 in CRYPTO_lock () from /usr/lib64/libcrypto.so.10
> #1  0x000000353a4e7d27 in ?? () from /usr/lib64/libcrypto.so.10
> #2  0x000000353a4e768c in ?? () from /usr/lib64/libcrypto.so.10
> #3  0x000000353a4e8e48 in ERR_load_strings () from
> /usr/lib64/libcrypto.so.10
> #4  0x000000353a536b7e in ERR_load_CONF_strings () from
> /usr/lib64/libcrypto.so.10
> #5  0x000000353a4e8ea5 in ERR_load_crypto_strings () from
> /usr/lib64/libcrypto.so.10
> #6  0x000000353e445ae9 in SSL_load_error_strings () from
> /usr/lib64/libssl.so.10
> #7  0x00007fad0e1e8c5e in luaopen_ssl_core () from
> /usr/local/lib/lua/5.1/ssl.so
> #8  0x00007fad0f0b4011 in luaD_precall (L=0x7facdc0008c0,
> func=0x7facdc028990, nresults=1) at ldo.c:319
> #9  0x00007fad0f0b4494 in luaD_call (L=0x7facdc0008c0,
> func=0x7facdc028990, nResults=<value optimized out>) at ldo.c:376
> #10 0x00007fad0f0b1496 in lua_call (L=0x7facdc0008c0, nargs=<value
> optimized out>, nresults=1) at lapi.c:782
> #11 0x00007fad0f0ca16c in ll_require (L=0x7facdc0008c0) at loadlib.c:484
> #12 0x00007fad0f0b4011 in luaD_precall (L=0x7facdc0008c0,
> func=0x7facdc028930, nresults=1) at ldo.c:319
> #13 0x00007fad0f0bd759 in luaV_execute (L=<value optimized out>,
> nexeccalls=1) at lvm.c:587
> #14 0x00007fad0f0b44dd in luaD_call (L=0x7facdc0008c0,
> func=0x7facdc028910, nResults=<value optimized out>) at ldo.c:377
> #15 0x00007fad0f0b1496 in lua_call (L=0x7facdc0008c0, nargs=<value
> optimized out>, nresults=1) at lapi.c:782
> #16 0x00007fad0f0ca16c in ll_require (L=0x7facdc0008c0) at loadlib.c:484
> #17 0x00007fad0f0b4011 in luaD_precall (L=0x7facdc0008c0,
> func=0x7facdc0288b0, nresults=1) at ldo.c:319
> #18 0x00007fad0f0bd759 in luaV_execute (L=<value optimized out>,
> nexeccalls=1) at lvm.c:587
> #19 0x00007fad0f0b44dd in luaD_call (L=0x7facdc0008c0,
> func=0x7facdc000d10, nResults=<value optimized out>) at ldo.c:377
> #20 0x00007fad0f0b1496 in lua_call (L=0x7facdc0008c0, nargs=<value
> optimized out>, nresults=1) at lapi.c:782
> #21 0x00007fad0f0ca16c in ll_require (L=0x7facdc0008c0) at loadlib.c:484
> #22 0x00007fad0f0b4011 in luaD_precall (L=0x7facdc0008c0,
> func=0x7facdc000cb0, nresults=1) at ldo.c:319
> #23 0x00007fad0f0bd759 in luaV_execute (L=<value optimized out>,
> nexeccalls=1) at lvm.c:587
> #24 0x00007fad0f0b44dd in luaD_call (L=0x7facdc0008c0,
> func=0x7facdc000ca0, nResults=<value optimized out>) at ldo.c:377
> #25 0x00007fad0f0b3b77 in luaD_rawrunprotected (L=0x7facdc0008c0,
> f=0x7fad0f0b1460 <f_call>, ud=0x7fad0eabb870) at ldo.c:116
> #26 0x00007fad0f0b3bf2 in luaD_pcall (L=0x7facdc0008c0, func=<value
> optimized out>, u=<value optimized out>, old_top=32, ef=<value optimized
> out>) at ldo.c:463
> #27 0x00007fad0f0b12a1 in lua_pcall (L=0x7facdc0008c0, nargs=0,
> nresults=0, errfunc=<value optimized out>) at lapi.c:821
> #28 0x00007fad0f097997 in docall (L=0x7facdc0008c0, narg=0, nresults=0,
> perror=0, fatal=1) at mod_lua.cpp:92
> #29 0x00007fad0f098044 in lua_parse_and_execute (L=0x7facdc0008c0,
> input_code=0x7face8001880 "cv2agent.lua") at mod_lua.cpp:195
> #30 0x00007fad0f098d6d in lua_thread_run (thread=<value optimized out>,
> obj=<value optimized out>) at mod_lua.cpp:222
> #31 0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #32 0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 5 (Thread 0x7fad0e1e0700 (LWP 20802)):
> #0  0x00007fad0f0ba13c in luaS_newlstr (L=0x7facd80008c0,
> str=0x7facd8013630 "result_tabletabletright (C) 2009-2014 PUC-Rio\"", l=12)
> at lstring.c:81
> #1  0x00007fad0f0c14f2 in luaX_newstring (ls=0x7fad0e1dd1c0, str=<value
> optimized out>, l=<value optimized out>) at llex.c:119
> #2  0x00007fad0f0c25f0 in llex (ls=0x7fad0e1dd1c0, seminfo=0x7fad0e1dd1d8)
> at llex.c:426
> #3  0x00007fad0f0c27d9 in luaX_next (ls=0x7fad0e1dd1c0) at llex.c:453
> #4  0x00007fad0f0b7a99 in testnext (ls=0x7fad0e1dd1c0, e=0x7fad0e1dce50,
> needself=<value optimized out>, line=47) at lparser.c:82
> #5  parlist (ls=0x7fad0e1dd1c0, e=0x7fad0e1dce50, needself=<value
> optimized out>, line=47) at lparser.c:568
> #6  body (ls=0x7fad0e1dd1c0, e=0x7fad0e1dce50, needself=<value optimized
> out>, line=47) at lparser.c:586
> #7  0x00007fad0f0b948c in localfunc (ls=0x7fad0e1dd1c0) at lparser.c:1172
> #8  statement (ls=0x7fad0e1dd1c0) at lparser.c:1303
> #9  chunk (ls=0x7fad0e1dd1c0) at lparser.c:1330
> #10 0x00007fad0f0b98b9 in luaY_parser (L=0x7facd80008c0, z=0x7fad0e1dd430,
> buff=<value optimized out>, name=<value optimized out>) at lparser.c:391
> #11 0x00007fad0f0b3763 in f_parser (L=0x7facd80008c0, ud=0x7fad0e1dd3e0)
> at ldo.c:497
> #12 0x00007fad0f0b3b77 in luaD_rawrunprotected (L=0x7facd80008c0,
> f=0x7fad0f0b3710 <f_parser>, ud=0x7fad0e1dd3e0) at ldo.c:116
> #13 0x00007fad0f0b3bf2 in luaD_pcall (L=0x7facd80008c0, func=<value
> optimized out>, u=<value optimized out>, old_top=256, ef=<value optimized
> out>) at ldo.c:463
> #14 0x00007fad0f0b3cc2 in luaD_protectedparser (L=0x7facd80008c0, z=<value
> optimized out>, name=<value optimized out>) at ldo.c:513
> #15 0x00007fad0f0b1203 in lua_load (L=0x7facd80008c0, reader=<value
> optimized out>, data=<value optimized out>, chunkname=0x7facd801c448
> "@/usr/local/share/lua/5.1/ssl/https.lua") at lapi.c:869
> #16 0x00007fad0f0be500 in luaL_loadfile (L=0x7facd80008c0,
> filename=0x7facd801c3f8 "/usr/local/share/lua/5.1/ssl/https.lua") at
> lauxlib.c:581
> #17 0x00007fad0f0caa4a in loader_Lua (L=0x7facd80008c0) at loadlib.c:385
> #18 0x00007fad0f0b4011 in luaD_precall (L=0x7facd80008c0,
> func=0x7facd8000d10, nresults=1) at ldo.c:319
> #19 0x00007fad0f0b4494 in luaD_call (L=0x7facd80008c0,
> func=0x7facd8000d10, nResults=<value optimized out>) at ldo.c:376
> #20 0x00007fad0f0b1496 in lua_call (L=0x7facd80008c0, nargs=<value
> optimized out>, nresults=1) at lapi.c:782
> #21 0x00007fad0f0ca0cd in ll_require (L=0x7facd80008c0) at loadlib.c:473
> #22 0x00007fad0f0b4011 in luaD_precall (L=0x7facd80008c0,
> func=0x7facd8000cb0, nresults=1) at ldo.c:319
> #23 0x00007fad0f0bd759 in luaV_execute (L=<value optimized out>,
> nexeccalls=1) at lvm.c:587
> #24 0x00007fad0f0b44dd in luaD_call (L=0x7facd80008c0,
> func=0x7facd8000ca0, nResults=<value optimized out>) at ldo.c:377
> #25 0x00007fad0f0b3b77 in luaD_rawrunprotected (L=0x7facd80008c0,
> f=0x7fad0f0b1460 <f_call>, ud=0x7fad0e1df870) at ldo.c:116
> #26 0x00007fad0f0b3bf2 in luaD_pcall (L=0x7facd80008c0, func=<value
> optimized out>, u=<value optimized out>, old_top=32, ef=<value optimized
> out>) at ldo.c:463
> #27 0x00007fad0f0b12a1 in lua_pcall (L=0x7facd80008c0, nargs=0,
> nresults=0, errfunc=<value optimized out>) at lapi.c:821
> #28 0x00007fad0f097997 in docall (L=0x7facd80008c0, narg=0, nresults=0,
> perror=0, fatal=1) at mod_lua.cpp:92
> #29 0x00007fad0f098044 in lua_parse_and_execute (L=0x7facd80008c0,
> input_code=0x7face800df40 "cv2agent.lua") at mod_lua.cpp:195
> #30 0x00007fad0f098d6d in lua_thread_run (thread=<value optimized out>,
> obj=<value optimized out>) at mod_lua.cpp:222
> #31 0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #32 0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 4 (Thread 0x7fad600b2700 (LWP 20748)):
> #0  0x000000352e00b63c in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> #1  0x00007fad63b87379 in switch_user_sql_thread (thread=<value optimized
> out>, obj=0x7fad380169a0) at src/switch_core_sqldb.c:1894
> #2  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #3  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 3 (Thread 0x7fad63a39700 (LWP 20728)):
> #0  0x000000352dce1423 in select () from /lib64/libc.so.6
> #1  0x00007fad63c2a855 in apr_sleep (t=<value optimized out>) at
> time/unix/time.c:246
> #2  0x00007fad63bfa09e in do_sleep (t=<value optimized out>) at
> src/switch_time.c:171
> #3  0x00007fad63b79eaa in pool_thread (thread=<value optimized out>,
> obj=<value optimized out>) at src/switch_core_memory.c:565
> #4  0x000000352e007a51 in start_thread () from /lib64/libpthread.so.0
> #5  0x000000352dce89ad in clone () from /lib64/libc.so.6
>
> Thread 2 (Thread 0x7fad63b017e0 (LWP 20727)):
> #0  0x000000352dce1423 in select () from /lib64/libc.so.6
> #1  0x00007fad63c2a855 in apr_sleep (t=<value optimized out>) at
> time/unix/time.c:246
> #2  0x00007fad63bfa09e in do_sleep (t=<value optimized out>) at
> src/switch_time.c:171
> #3  0x00007fad63b9976a in switch_core_runtime_loop (bg=0) at
> src/switch_core.c:994
> #4  0x0000000000402e88 in main (argc=2, argv=<value optimized out>) at
> src/switch.c:1184
>
> Thread 1 (Thread 0x7fad0ea80700 (LWP 20798)):
> #0  0x000000352dc32625 in raise () from /lib64/libc.so.6
> #1  0x000000352dc33e05 in abort () from /lib64/libc.so.6
> #2  0x000000352dc70537 in __libc_message () from /lib64/libc.so.6
> #3  0x000000352dc75e66 in malloc_printerr () from /lib64/libc.so.6
> #4  0x000000352dc7897a in _int_free () from /lib64/libc.so.6
> #5  0x000000353a46ad5d in CRYPTO_free () from /usr/lib64/libcrypto.so.10
> #6  0x000000353a46ddc2 in OBJ_NAME_add () from /usr/lib64/libcrypto.so.10
> #7  0x000000353a4f0257 in EVP_add_cipher () from /usr/lib64/libcrypto.so.10
> #8  0x000000353a4f48e4 in OpenSSL_add_all_ciphers () from
> /usr/lib64/libcrypto.so.10
> #9  0x000000353a4f440e in OPENSSL_add_all_algorithms_noconf () from
> /usr/lib64/libcrypto.so.10
> #10 0x00007fad0e1e8c59 in luaopen_ssl_core () from
> /usr/local/lib/lua/5.1/ssl.so
> #11 0x00007fad0f0b4011 in luaD_precall (L=0x7face00008c0,
> func=0x7face0027a70, nresults=1) at ldo.c:319
> #12 0x00007fad0f0b4494 in luaD_call (L=0x7face00008c0,
> func=0x7face0027a70, nResults=<value optimized out>) at ldo.c:376
> #13 0x00007fad0f0b1496 in lua_call (L=0x7face00008c0, nargs=<value
> optimized out>, nresults=1) at lapi.c:782
> #14 0x00007fad0f0ca16c in ll_require (L=0x7face00008c0) at loadlib.c:484
> #15 0x00007fad0f0b4011 in luaD_precall (L=0x7face00008c0,
> func=0x7face0027a10, nresults=1) at ldo.c:319
> #16 0x00007fad0f0bd759 in luaV_execute (L=<value optimized out>,
> nexeccalls=1) at lvm.c:587
> #17 0x00007fad0f0b44dd in luaD_call (L=0x7face00008c0,
> func=0x7face00279f0, nResults=<value optimized out>) at ldo.c:377
> #18 0x00007fad0f0b1496 in lua_call (L=0x7face00008c0, nargs=<value
> optimized out>, nresults=1) at lapi.c:782
> #19 0x00007fad0f0ca16c in ll_require (L=0x7face00008c0) at loadlib.c:484
> #20 0x00007fad0f0b4011 in luaD_precall (L=0x7face00008c0,
> func=0x7face0027990, nresults=1) at ldo.c:319
> #21 0x00007fad0f0bd759 in luaV_execute (L=<value optimized out>,
> nexeccalls=1) at lvm.c:587
> #22 0x00007fad0f0b44dd in luaD_call (L=0x7face00008c0,
> func=0x7face0000d10, nResults=<value optimized out>) at ldo.c:377
> #23 0x00007fad0f0b1496 in lua_call (L=0x7face00008c0, nargs=<value
> optimized out>, nresults=1) at lapi.c:782
> #24 0x00007fad0f0ca16c in ll_require (L=0x7face00008c0) at loadlib.c:484
> #25 0x00007fad0f0b4011 in luaD_precall (L=0x7face00008c0,
> func=0x7face0000cb0, nresults=1) at
>
>

-- 
Anthony Minessale II       ♬ @anthmfs  ♬ @FreeSWITCH  ♬

☞ http://freeswitch.org/http://cluecon.com/http://twitter.com/FreeSWITCH
☞ irc.freenode.net #freeswitch ☞ *http://freeswitch.org/g+
<http://freeswitch.org/g+>*

ClueCon Weekly Development Call
☎ sip:888 at conference.freeswitch.org  ☎ +19193869900

https://www.youtube.com/watch?v=9XXgW34t40s
https://www.youtube.com/watch?v=NLaDpGQuZDA
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.freeswitch.org/pipermail/freeswitch-users/attachments/20151026/a6f931f8/attachment-0001.html 


Join us at ClueCon 2016 Aug 8-12, 2016
More information about the FreeSWITCH-users mailing list