Memory leak with mod_local_stream
Hey guys, Having a problem with mod_local_stream. I recently did a "make current" from 15334 to the latest trunk (15630). After restarting, there now appears to be a memory leak. On a test system (CentOS 5.4, 64-bit) with no calls or registrations, Freeswitch gradually consumes all of the host memory (rate of about 200K/second), then swaps out, eventually rendering the system useless. I isolated it to mod_local_stream. If I unload mod_local_stream, the memory use stops climbing. If I re-load mod_local_stream, it starts again. I would submit the logs except they aren't any besides it starting. The system is just sitting there idle. Even valgrind didn't show much (http://pastebin.freeswitch.org/11238). Maybe I'm using it wrong? I ran it: valgrind --tool=memcheck --log-file-exactly=vg.log --leak- check=full --leak-resolution=high --show-reachable=yes .libs/ freeswitch -vg Questions: * has anyone else seen this? * what is the best way I can assist troubleshooting this? I saw a patch to mod_local_stream (rev 15431) a few weeks back. Could that have anything to do with it? Rob
if you suspect 15431 to have caused this, then revert to 15430 and see if the problem exists. if you can narrow do the bug to a specific svn revision, then you greatly assist in the resolution of the issue. apart from that im not much help sorry. maybe someone else can lab it up and see if they get the same result. ( Im on a train now, so not so easy :P ) J On 24/11/2009, at 7:53 AM, Rob Forman wrote:
Hey guys,
Having a problem with mod_local_stream.
I recently did a "make current" from 15334 to the latest trunk (15630). After restarting, there now appears to be a memory leak. On a test system (CentOS 5.4, 64-bit) with no calls or registrations, Freeswitch gradually consumes all of the host memory (rate of about 200K/second), then swaps out, eventually rendering the system useless.
I isolated it to mod_local_stream. If I unload mod_local_stream, the memory use stops climbing. If I re-load mod_local_stream, it starts again.
I would submit the logs except they aren't any besides it starting. The system is just sitting there idle. Even valgrind didn't show much (http://pastebin.freeswitch.org/11238). Maybe I'm using it wrong? I ran it: valgrind --tool=memcheck --log-file-exactly=vg.log --leak- check=full --leak-resolution=high --show-reachable=yes .libs/ freeswitch -vg
Questions: * has anyone else seen this? * what is the best way I can assist troubleshooting this?
I saw a patch to mod_local_stream (rev 15431) a few weeks back. Could that have anything to do with it?
Rob
_______________________________________________ FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
That rev should have fixed that memory leak, could you test mod_local_stream.c from rev 15430 (http://fisheye.freeswitch.org/browse/~raw,r=15430/FreeSWITCH/src/mod/formats...) with your current fs version to confirm this is the cause please? Mike On Nov 23, 2009, at 4:53 PM, Rob Forman wrote:
Hey guys,
Having a problem with mod_local_stream.
I recently did a "make current" from 15334 to the latest trunk (15630). After restarting, there now appears to be a memory leak. On a test system (CentOS 5.4, 64-bit) with no calls or registrations, Freeswitch gradually consumes all of the host memory (rate of about 200K/second), then swaps out, eventually rendering the system useless.
I isolated it to mod_local_stream. If I unload mod_local_stream, the memory use stops climbing. If I re-load mod_local_stream, it starts again.
I would submit the logs except they aren't any besides it starting. The system is just sitting there idle. Even valgrind didn't show much (http://pastebin.freeswitch.org/11238). Maybe I'm using it wrong? I ran it: valgrind --tool=memcheck --log-file-exactly=vg.log --leak- check=full --leak-resolution=high --show-reachable=yes .libs/ freeswitch -vg
Questions: * has anyone else seen this? * what is the best way I can assist troubleshooting this?
I saw a patch to mod_local_stream (rev 15431) a few weeks back. Could that have anything to do with it?
Rob
_______________________________________________ FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
I tried mod_local_stream.c from rev 15430, did a make clean && make all && make install-- but it didn't fix it so it wasn't that patch. I'll make current and try valgrind again unless someone has other ideas. Rob On Nov 23, 2009, at 4:15 PM, Michael Jerris wrote:
That rev should have fixed that memory leak, could you test mod_local_stream.c from rev 15430 (http://fisheye.freeswitch.org/browse/ ~raw,r=15430/FreeSWITCH/src/mod/formats/mod_local_stream/ mod_local_stream.c) with your current fs version to confirm this is the cause please?
Mike
On Nov 23, 2009, at 4:53 PM, Rob Forman wrote:
Hey guys,
Having a problem with mod_local_stream.
I recently did a "make current" from 15334 to the latest trunk (15630). After restarting, there now appears to be a memory leak. On a test system (CentOS 5.4, 64-bit) with no calls or registrations, Freeswitch gradually consumes all of the host memory (rate of about 200K/second), then swaps out, eventually rendering the system useless.
I isolated it to mod_local_stream. If I unload mod_local_stream, the memory use stops climbing. If I re-load mod_local_stream, it starts again.
I would submit the logs except they aren't any besides it starting. The system is just sitting there idle. Even valgrind didn't show much (http://pastebin.freeswitch.org/11238). Maybe I'm using it wrong? I ran it: valgrind --tool=memcheck --log-file-exactly=vg.log --leak- check=full --leak-resolution=high --show-reachable=yes .libs/ freeswitch -vg
Questions: * has anyone else seen this? * what is the best way I can assist troubleshooting this?
I saw a patch to mod_local_stream (rev 15431) a few weeks back. Could that have anything to do with it?
Rob
_______________________________________________ FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Ignore this. I'm an idiot. Rob :) On Nov 23, 2009, at 4:15 PM, Michael Jerris wrote:
That rev should have fixed that memory leak, could you test mod_local_stream.c from rev 15430 (http://fisheye.freeswitch.org/browse/ ~raw,r=15430/FreeSWITCH/src/mod/formats/mod_local_stream/ mod_local_stream.c) with your current fs version to confirm this is the cause please?
Mike
On Nov 23, 2009, at 4:53 PM, Rob Forman wrote:
Hey guys,
Having a problem with mod_local_stream.
I recently did a "make current" from 15334 to the latest trunk (15630). After restarting, there now appears to be a memory leak. On a test system (CentOS 5.4, 64-bit) with no calls or registrations, Freeswitch gradually consumes all of the host memory (rate of about 200K/second), then swaps out, eventually rendering the system useless.
I isolated it to mod_local_stream. If I unload mod_local_stream, the memory use stops climbing. If I re-load mod_local_stream, it starts again.
I would submit the logs except they aren't any besides it starting. The system is just sitting there idle. Even valgrind didn't show much (http://pastebin.freeswitch.org/11238). Maybe I'm using it wrong? I ran it: valgrind --tool=memcheck --log-file-exactly=vg.log --leak- check=full --leak-resolution=high --show-reachable=yes .libs/ freeswitch -vg
Questions: * has anyone else seen this? * what is the best way I can assist troubleshooting this?
I saw a patch to mod_local_stream (rev 15431) a few weeks back. Could that have anything to do with it?
Rob
_______________________________________________ FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
participants (3)
-
Jay Binks
-
Michael Jerris
-
Rob Forman