segfault in libfreeswitch.so.1.0.0
Hello. Randomly I get this in kern.log: kernel: freeswitch[3136]: segfault at 8d00000081 ip 00007fbe75c90130 sp 00007fbe705c66d0 error 4 in libfreeswitch.so.1.0.0[7fbe75b68000+277000] Its so random that I can't find why. Usually this happen once a day at random time. There are days when this does not happen. echo 1 > /proc/sys/fs/suid_dumpable ulimit -c unlimited As per wiki, core files can not be located. Ulimit is enabled before starting freeswitch. But as FS is started under user from basedir directory, and that user does not have write permission to this directory, therefore no core files are created. The FS version is: FreeSWITCH Version 1.3.8b+git~20121130T003427Z~b35ac6b3bd (git b35ac6b 2012-11-30 00:34:27Z) Maybe something was changed from that version. In jira changelog I didn't see any related to this. How to track this? Is there a variable to set for core files directory dump? Thank you. -- Mimiko desu.
New one: kernel: freeswitch[3559]: segfault at 30 ip 00007fbb945862a4 sp 00007fbb8ef59bc0 error 4 in libfreeswitch.so.1.0.0[7fbb944fb000+277000] This happened when channels where destroyed after a bridge and a hangup. -- Mimiko desu.
First of all update to the latest version of v1.2.stable or master - it may be something that's already fixed if you're on an old version. Second, configure FreeSWITCH to save a coredump on a segfault (start it from the init.d script with the -core param). Once you have a coredump you can open a Jira ticket with a backtrace: http://wiki.freeswitch.org/wiki/Reporting_Bugs#Creating_A_Backtrace_With_gdb... The backtrace will show exactly where and why the segfault occurred, very helpful for debugging. Any additional info eg FS debug logs would also be helpful. -Steve On 18 January 2013 09:23, Mimiko <vbvbrj@gmail.com> wrote:
New one: kernel: freeswitch[3559]: segfault at 30 ip 00007fbb945862a4 sp 00007fbb8ef59bc0 error 4 in libfreeswitch.so.1.0.0[7fbb944fb000+277000]
This happened when channels where destroyed after a bridge and a hangup.
-- Mimiko desu.
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
On 18.01.2013 18:19, Steven Ayre wrote:
First of all update to the latest version of v1.2.stable or master - it may be something that's already fixed if you're on an old version.
Second, configure FreeSWITCH to save a coredump on a segfault (start it from the init.d script with the -core param).
Once you have a coredump you can open a Jira ticket with a backtrace: http://wiki.freeswitch.org/wiki/Reporting_Bugs#Creating_A_Backtrace_With_gdb... The backtrace will show exactly where and why the segfault occurred, very helpful for debugging.
Yes, I updated to latest master. Will have to wait as it does not happen regularly or with some pattern. "-core" option I enabled long ago, but as I said, core files are not writted anywhere. A good option or parameter for FS is to specify where to save core dump files. -- Mimiko desu.
They should go to the cwd, get the FS process and find it by 'ls -ld /proc/PID/cwd' Also check the ulimit settings, -c limits the size of coredumps. Steve on iPhone On 18 Jan 2013, at 19:21, Mimiko <vbvbrj@gmail.com> wrote:
On 18.01.2013 18:19, Steven Ayre wrote:
First of all update to the latest version of v1.2.stable or master - it may be something that's already fixed if you're on an old version.
Second, configure FreeSWITCH to save a coredump on a segfault (start it from the init.d script with the -core param).
Once you have a coredump you can open a Jira ticket with a backtrace: http://wiki.freeswitch.org/wiki/Reporting_Bugs#Creating_A_Backtrace_With_gdb... The backtrace will show exactly where and why the segfault occurred, very helpful for debugging.
Yes, I updated to latest master. Will have to wait as it does not happen regularly or with some pattern. "-core" option I enabled long ago, but as I said, core files are not writted anywhere. A good option or parameter for FS is to specify where to save core dump files.
-- Mimiko desu.
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
On 19.01.2013 00:10, Steven Ayre wrote:
They should go to the cwd, get the FS process and find it by 'ls -ld /proc/PID/cwd'
Also check the ulimit settings, -c limits the size of coredumps.
Steve on iPhone
Yep, I know the directory where FS is running. But FS user does not have write permission to that directory. "ulimit" is also set as per wiki. -- Mimiko desu.
So correct permissions so it can write the core file? On Jan 19, 2013, at 2:38 AM, Mimiko <vbvbrj@gmail.com> wrote:
On 19.01.2013 00:10, Steven Ayre wrote:
They should go to the cwd, get the FS process and find it by 'ls -ld /proc/PID/cwd'
Also check the ulimit settings, -c limits the size of coredumps.
Steve on iPhone
Yep, I know the directory where FS is running. But FS user does not have write permission to that directory. "ulimit" is also set as per wiki.
-- Mimiko desu.
On 18.01.2013 18:19, Steven Ayre wrote:
First of all update to the latest version of v1.2.stable or master - it may be something that's already fixed if you're on an old version.
Updated to FreeSWITCH Version 1.3.13b+git~20130118T050605Z~cad607d72e (git cad607d 2013-01-18 05:06:05Z) After a many days test it doesn't generate this segfault anymore. But again in case of coredumps, how to specify where to save this files? As they does not have permission to fs binary folder. -- Mimiko desu.
Coredumps are generated by the operating system, not FreeSWITCH. See 'man 5 core'. It is configurable, to an extent. The default is a file named 'core' in the current working directory of the process. You can adjust that behaviour through procfs using /proc/sys/kernel/core_pattern. It can include / characters to set a directory. Note it's a global setting. For example: $ echo '/tmp/core.%e.%p' > /proc/sys/kernel/core_pattern That would result in coredump files being created such as /tmp/core.freeswitch.23523 (example). You'll want to pick a suitable directory with enough space and suitable permissions. -Steve On 29 January 2013 13:22, Mimiko <vbvbrj@gmail.com> wrote:
On 18.01.2013 18:19, Steven Ayre wrote:
First of all update to the latest version of v1.2.stable or master - it may be something that's already fixed if you're on an old version.
Updated to FreeSWITCH Version 1.3.13b+git~20130118T050605Z~cad607d72e (git cad607d 2013-01-18 05:06:05Z)
After a many days test it doesn't generate this segfault anymore.
But again in case of coredumps, how to specify where to save this files? As they does not have permission to fs binary folder.
-- Mimiko desu.
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
participants (3)
-
Michael Jerris
-
Mimiko
-
Steven Ayre