hello, i upgraded to the latest GIT compiled configured FS without any issues... everything looks great... but when i put this into some traffic i noticed FS uses more and more memory... until it finished into swap. I didn't have issues like that previously but unfortunately i cannot recall what was the version with no issues. The server is 64bit CentOS 5.4 and the FS version is the latest (well 4 days old tops). Im using just the standard modules (the list provided below) and FS keeps leaking memory <load module="mod_console"/> <load module="mod_logfile"/> <load module="mod_enum"/> <load module="mod_cdr_csv"/> <load module="mod_event_socket"/> <load module="mod_sofia"/> <load module="mod_loopback"/> <load module="mod_commands"/> <load module="mod_conference"/> <load module="mod_db"/> <load module="mod_dptools"/> <load module="mod_expr"/> <load module="mod_fifo"/> <load module="mod_hash"/> <load module="mod_voicemail"/> <load module="mod_esf"/> <load module="mod_fsv"/> <load module="mod_cluechoo"/> <load module="mod_valet_parking"/> <load module="mod_dialplan_xml"/> <load module="mod_dialplan_asterisk"/> <load module="mod_spandsp"/> <load module="mod_g723_1"/> <load module="mod_g729"/> <load module="mod_amr"/> <load module="mod_ilbc"/> <load module="mod_speex"/> <load module="mod_h26x"/> <load module="mod_siren"/> <load module="mod_sndfile"/> <load module="mod_native_file"/> <load module="mod_local_stream"/> <load module="mod_tone_stream"/> <load module="mod_spidermonkey"/> <load module="mod_lua"/> <load module="mod_say_en"/> This is the dialplan im triggering... <extension name="doRedirect"> <condition field="destination_number" expression="^300030.*$"> <action application="info"/> <action application="redirect" data="<sip:0999901234567889@10.1.1.11:5060;user=phone>;q=0.99"/> <action application="hangup"/> <!-- well ... not really needed but only Got knows for sure--> </condition> </extension> I have i have tried a pure "hello world" dialplan as: <extension name="testDP"> <condition field="destination_number" expression="^300030.*$"> <action application="info"/> <action application="hangup"/> </condition> </extension> But the situation is exactly the same. This is the behavior i'm having .... memory just keep growing and growing until it hits the swap where the server is doomed. tail -f smaps_log.log (this is from cat /proc/$PID/smaps | grep heap) TIM,SIZE,RSS,SHARED_CLEAN,SHARED_DIRTY,PRIVATE_CLEAN,PRIVATE_DIRTY,SWAP 2011-07-13 13:50:34,19268,18916,0,0,0,18916,0 2011-07-13 13:51:34,19268,18972,0,0,0,18972,0 2011-07-13 13:52:34,20324,20088,0,0,0,20088,0 2011-07-13 13:53:34,21264,20920,0,0,0,20920,0 2011-07-13 13:54:34,21048,20856,0,0,0,20856,0 2011-07-13 13:55:35,22396,22076,0,0,0,22076,0 2011-07-13 13:56:35,22396,22164,0,0,0,22256,0 2011-07-13 13:57:35,23220,22936,0,0,0,22936,0 2011-07-13 13:58:35,23480,23288,0,0,0,23288,0 $ tail -f mem.log (this is from ps) TIMESTAMP PID RSS %MEM 2011-07-13 13:48:55 2405 65144 12.8 2011-07-13 13:49:55 2405 66932 13.2 2011-07-13 13:50:55 2405 69576 13.7 2011-07-13 13:51:55 2405 71552 14.1 2011-07-13 13:52:55 2405 73576 14.5 2011-07-13 13:53:55 2405 75804 14.9 2011-07-13 13:54:55 2405 78388 15.4 2011-07-13 13:55:55 2405 80544 15.9 2011-07-13 13:56:55 2405 81784 16.1 2011-07-13 13:57:55 2405 83720 16.5 2011-07-13 13:58:55 2405 86524 17.0 FS runs under root account and it is started as: /usr/local/freeswitch/bin/freeswitch -nc -nonat -db /dev/shm -conf /usr/local/freeswitch/conf/ -log /usr/local/freeswitch/log/ -run /usr/local/freeswitch/run/ Also ulimit is like this; ulimit -c unlimited ulimit -d unlimited ulimit -f unlimited ulimit -i unlimited ulimit -n 999999 ulimit -q unlimited ulimit -u unlimited ulimit -v unlimited ulimit -x unlimited ulimit -s 240 ulimit -l unlimited so, does anyone have a clue on why the memory goes up ? ... what I'm doing wrong ? Regards, Tihomir.
4 days is a long time. At the moment you decide to post here you should try latest again to be safe. Are you saying you are using sipp or something to call this extension? On Wed, Jul 13, 2011 at 10:27 AM, Tihomir Culjaga <tculjaga@gmail.com> wrote:
hello,
i upgraded to the latest GIT compiled configured FS without any issues... everything looks great... but when i put this into some traffic i noticed FS uses more and more memory... until it finished into swap. I didn't have issues like that previously but unfortunately i cannot recall what was the version with no issues.
The server is 64bit CentOS 5.4 and the FS version is the latest (well 4 days old tops). Im using just the standard modules (the list provided below) and FS keeps leaking memory
<load module="mod_console"/> <load module="mod_logfile"/> <load module="mod_enum"/> <load module="mod_cdr_csv"/> <load module="mod_event_socket"/> <load module="mod_sofia"/> <load module="mod_loopback"/> <load module="mod_commands"/> <load module="mod_conference"/> <load module="mod_db"/> <load module="mod_dptools"/> <load module="mod_expr"/> <load module="mod_fifo"/> <load module="mod_hash"/> <load module="mod_voicemail"/> <load module="mod_esf"/> <load module="mod_fsv"/> <load module="mod_cluechoo"/> <load module="mod_valet_parking"/> <load module="mod_dialplan_xml"/> <load module="mod_dialplan_asterisk"/> <load module="mod_spandsp"/> <load module="mod_g723_1"/> <load module="mod_g729"/> <load module="mod_amr"/> <load module="mod_ilbc"/> <load module="mod_speex"/> <load module="mod_h26x"/> <load module="mod_siren"/> <load module="mod_sndfile"/> <load module="mod_native_file"/> <load module="mod_local_stream"/> <load module="mod_tone_stream"/> <load module="mod_spidermonkey"/> <load module="mod_lua"/> <load module="mod_say_en"/>
This is the dialplan im triggering...
<extension name="doRedirect"> <condition field="destination_number" expression="^300030.*$"> <action application="info"/> <action application="redirect" data="<sip:0999901234567889@10.1.1.11:5060;user=phone>;q=0.99"/> <action application="hangup"/> <!-- well ... not really needed but only Got knows for sure--> </condition> </extension>
I have i have tried a pure "hello world" dialplan as:
<extension name="testDP"> <condition field="destination_number" expression="^300030.*$"> <action application="info"/> <action application="hangup"/> </condition> </extension>
But the situation is exactly the same.
This is the behavior i'm having .... memory just keep growing and growing until it hits the swap where the server is doomed.
tail -f smaps_log.log (this is from cat /proc/$PID/smaps | grep heap) TIM,SIZE,RSS,SHARED_CLEAN,SHARED_DIRTY,PRIVATE_CLEAN,PRIVATE_DIRTY,SWAP 2011-07-13 13:50:34,19268,18916,0,0,0,18916,0 2011-07-13 13:51:34,19268,18972,0,0,0,18972,0 2011-07-13 13:52:34,20324,20088,0,0,0,20088,0 2011-07-13 13:53:34,21264,20920,0,0,0,20920,0 2011-07-13 13:54:34,21048,20856,0,0,0,20856,0 2011-07-13 13:55:35,22396,22076,0,0,0,22076,0 2011-07-13 13:56:35,22396,22164,0,0,0,22256,0 2011-07-13 13:57:35,23220,22936,0,0,0,22936,0 2011-07-13 13:58:35,23480,23288,0,0,0,23288,0
$ tail -f mem.log (this is from ps) TIMESTAMP PID RSS %MEM 2011-07-13 13:48:55 2405 65144 12.8 2011-07-13 13:49:55 2405 66932 13.2 2011-07-13 13:50:55 2405 69576 13.7 2011-07-13 13:51:55 2405 71552 14.1 2011-07-13 13:52:55 2405 73576 14.5 2011-07-13 13:53:55 2405 75804 14.9 2011-07-13 13:54:55 2405 78388 15.4 2011-07-13 13:55:55 2405 80544 15.9 2011-07-13 13:56:55 2405 81784 16.1 2011-07-13 13:57:55 2405 83720 16.5 2011-07-13 13:58:55 2405 86524 17.0
FS runs under root account and it is started as:
/usr/local/freeswitch/bin/freeswitch -nc -nonat -db /dev/shm -conf /usr/local/freeswitch/conf/ -log /usr/local/freeswitch/log/ -run /usr/local/freeswitch/run/
Also ulimit is like this;
ulimit -c unlimited ulimit -d unlimited ulimit -f unlimited ulimit -i unlimited ulimit -n 999999 ulimit -q unlimited ulimit -u unlimited ulimit -v unlimited ulimit -x unlimited ulimit -s 240 ulimit -l unlimited
so, does anyone have a clue on why the memory goes up ? ... what I'm doing wrong ?
Regards, Tihomir.
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Anthony Minessale II FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/ Twitter: http://twitter.com/FreeSWITCH_wire AIM: anthm MSN:anthony_minessale@hotmail.com GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com IRC: irc.freenode.net #freeswitch FreeSWITCH Developer Conference sip:888@conference.freeswitch.org googletalk:conf+888@conference.freeswitch.org pstn:+19193869900
oh and btw you should be filing a jira not posting it to here On Wed, Jul 13, 2011 at 10:48 AM, Anthony Minessale <anthony.minessale@gmail.com> wrote:
4 days is a long time. At the moment you decide to post here you should try latest again to be safe.
Are you saying you are using sipp or something to call this extension?
On Wed, Jul 13, 2011 at 10:27 AM, Tihomir Culjaga <tculjaga@gmail.com> wrote:
hello,
i upgraded to the latest GIT compiled configured FS without any issues... everything looks great... but when i put this into some traffic i noticed FS uses more and more memory... until it finished into swap. I didn't have issues like that previously but unfortunately i cannot recall what was the version with no issues.
The server is 64bit CentOS 5.4 and the FS version is the latest (well 4 days old tops). Im using just the standard modules (the list provided below) and FS keeps leaking memory
<load module="mod_console"/> <load module="mod_logfile"/> <load module="mod_enum"/> <load module="mod_cdr_csv"/> <load module="mod_event_socket"/> <load module="mod_sofia"/> <load module="mod_loopback"/> <load module="mod_commands"/> <load module="mod_conference"/> <load module="mod_db"/> <load module="mod_dptools"/> <load module="mod_expr"/> <load module="mod_fifo"/> <load module="mod_hash"/> <load module="mod_voicemail"/> <load module="mod_esf"/> <load module="mod_fsv"/> <load module="mod_cluechoo"/> <load module="mod_valet_parking"/> <load module="mod_dialplan_xml"/> <load module="mod_dialplan_asterisk"/> <load module="mod_spandsp"/> <load module="mod_g723_1"/> <load module="mod_g729"/> <load module="mod_amr"/> <load module="mod_ilbc"/> <load module="mod_speex"/> <load module="mod_h26x"/> <load module="mod_siren"/> <load module="mod_sndfile"/> <load module="mod_native_file"/> <load module="mod_local_stream"/> <load module="mod_tone_stream"/> <load module="mod_spidermonkey"/> <load module="mod_lua"/> <load module="mod_say_en"/>
This is the dialplan im triggering...
<extension name="doRedirect"> <condition field="destination_number" expression="^300030.*$"> <action application="info"/> <action application="redirect" data="<sip:0999901234567889@10.1.1.11:5060;user=phone>;q=0.99"/> <action application="hangup"/> <!-- well ... not really needed but only Got knows for sure--> </condition> </extension>
I have i have tried a pure "hello world" dialplan as:
<extension name="testDP"> <condition field="destination_number" expression="^300030.*$"> <action application="info"/> <action application="hangup"/> </condition> </extension>
But the situation is exactly the same.
This is the behavior i'm having .... memory just keep growing and growing until it hits the swap where the server is doomed.
tail -f smaps_log.log (this is from cat /proc/$PID/smaps | grep heap) TIM,SIZE,RSS,SHARED_CLEAN,SHARED_DIRTY,PRIVATE_CLEAN,PRIVATE_DIRTY,SWAP 2011-07-13 13:50:34,19268,18916,0,0,0,18916,0 2011-07-13 13:51:34,19268,18972,0,0,0,18972,0 2011-07-13 13:52:34,20324,20088,0,0,0,20088,0 2011-07-13 13:53:34,21264,20920,0,0,0,20920,0 2011-07-13 13:54:34,21048,20856,0,0,0,20856,0 2011-07-13 13:55:35,22396,22076,0,0,0,22076,0 2011-07-13 13:56:35,22396,22164,0,0,0,22256,0 2011-07-13 13:57:35,23220,22936,0,0,0,22936,0 2011-07-13 13:58:35,23480,23288,0,0,0,23288,0
$ tail -f mem.log (this is from ps) TIMESTAMP PID RSS %MEM 2011-07-13 13:48:55 2405 65144 12.8 2011-07-13 13:49:55 2405 66932 13.2 2011-07-13 13:50:55 2405 69576 13.7 2011-07-13 13:51:55 2405 71552 14.1 2011-07-13 13:52:55 2405 73576 14.5 2011-07-13 13:53:55 2405 75804 14.9 2011-07-13 13:54:55 2405 78388 15.4 2011-07-13 13:55:55 2405 80544 15.9 2011-07-13 13:56:55 2405 81784 16.1 2011-07-13 13:57:55 2405 83720 16.5 2011-07-13 13:58:55 2405 86524 17.0
FS runs under root account and it is started as:
/usr/local/freeswitch/bin/freeswitch -nc -nonat -db /dev/shm -conf /usr/local/freeswitch/conf/ -log /usr/local/freeswitch/log/ -run /usr/local/freeswitch/run/
Also ulimit is like this;
ulimit -c unlimited ulimit -d unlimited ulimit -f unlimited ulimit -i unlimited ulimit -n 999999 ulimit -q unlimited ulimit -u unlimited ulimit -v unlimited ulimit -x unlimited ulimit -s 240 ulimit -l unlimited
so, does anyone have a clue on why the memory goes up ? ... what I'm doing wrong ?
Regards, Tihomir.
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Anthony Minessale II
FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/ Twitter: http://twitter.com/FreeSWITCH_wire
AIM: anthm MSN:anthony_minessale@hotmail.com GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com IRC: irc.freenode.net #freeswitch
FreeSWITCH Developer Conference sip:888@conference.freeswitch.org googletalk:conf+888@conference.freeswitch.org pstn:+19193869900
-- Anthony Minessale II FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/ Twitter: http://twitter.com/FreeSWITCH_wire AIM: anthm MSN:anthony_minessale@hotmail.com GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com IRC: irc.freenode.net #freeswitch FreeSWITCH Developer Conference sip:888@conference.freeswitch.org googletalk:conf+888@conference.freeswitch.org pstn:+19193869900
On Wed, Jul 13, 2011 at 5:48 PM, Anthony Minessale < anthony.minessale@gmail.com> wrote:
4 days is a long time. At the moment you decide to post here you should try latest again to be safe.
I'm sorry for the late response... been on holidays and all i get is a very limited access to the internet... Thank you for the prompt response!
Are you saying you are using sipp or something to call this extension?
yes, I'm using sipp to generate traffic ... on a rate of 10 CPS and seeing that kind of issue... very simple scenario that I always use before going live in production. Currently, I'm updating to the latest git while I'm writing this e-mail. commit 2932c1fa17c589f3e47178553f78195fe08cf22d Author: Anthony Minessale <anthm@freeswitch.org> Date: Thu Jul 14 00:17:05 2011 -0500 FS-3386 Try this revision please I will upgrade and will perform the same test again ... T.
Does "fsctl reclaim_mem" help at all? -Steve On 13 July 2011 16:27, Tihomir Culjaga <tculjaga@gmail.com> wrote:
hello,
i upgraded to the latest GIT compiled configured FS without any issues... everything looks great... but when i put this into some traffic i noticed FS uses more and more memory... until it finished into swap. I didn't have issues like that previously but unfortunately i cannot recall what was the version with no issues.
The server is 64bit CentOS 5.4 and the FS version is the latest (well 4 days old tops). Im using just the standard modules (the list provided below) and FS keeps leaking memory
<load module="mod_console"/> <load module="mod_logfile"/> <load module="mod_enum"/> <load module="mod_cdr_csv"/> <load module="mod_event_socket"/> <load module="mod_sofia"/> <load module="mod_loopback"/> <load module="mod_commands"/> <load module="mod_conference"/> <load module="mod_db"/> <load module="mod_dptools"/> <load module="mod_expr"/> <load module="mod_fifo"/> <load module="mod_hash"/> <load module="mod_voicemail"/> <load module="mod_esf"/> <load module="mod_fsv"/> <load module="mod_cluechoo"/> <load module="mod_valet_parking"/> <load module="mod_dialplan_xml"/> <load module="mod_dialplan_asterisk"/> <load module="mod_spandsp"/> <load module="mod_g723_1"/> <load module="mod_g729"/> <load module="mod_amr"/> <load module="mod_ilbc"/> <load module="mod_speex"/> <load module="mod_h26x"/> <load module="mod_siren"/> <load module="mod_sndfile"/> <load module="mod_native_file"/> <load module="mod_local_stream"/> <load module="mod_tone_stream"/> <load module="mod_spidermonkey"/> <load module="mod_lua"/> <load module="mod_say_en"/>
This is the dialplan im triggering...
<extension name="doRedirect"> <condition field="destination_number" expression="^300030.*$"> <action application="info"/> <action application="redirect" data="<sip:0999901234567889@10.1.1.11:5060;user=phone>;q=0.99"/> <action application="hangup"/> <!-- well ... not really needed but only Got knows for sure--> </condition> </extension>
I have i have tried a pure "hello world" dialplan as:
<extension name="testDP"> <condition field="destination_number" expression="^300030.*$"> <action application="info"/> <action application="hangup"/> </condition> </extension>
But the situation is exactly the same.
This is the behavior i'm having .... memory just keep growing and growing until it hits the swap where the server is doomed.
tail -f smaps_log.log (this is from cat /proc/$PID/smaps | grep heap) TIM,SIZE,RSS,SHARED_CLEAN,SHARED_DIRTY,PRIVATE_CLEAN,PRIVATE_DIRTY,SWAP 2011-07-13 13:50:34,19268,18916,0,0,0,18916,0 2011-07-13 13:51:34,19268,18972,0,0,0,18972,0 2011-07-13 13:52:34,20324,20088,0,0,0,20088,0 2011-07-13 13:53:34,21264,20920,0,0,0,20920,0 2011-07-13 13:54:34,21048,20856,0,0,0,20856,0 2011-07-13 13:55:35,22396,22076,0,0,0,22076,0 2011-07-13 13:56:35,22396,22164,0,0,0,22256,0 2011-07-13 13:57:35,23220,22936,0,0,0,22936,0 2011-07-13 13:58:35,23480,23288,0,0,0,23288,0
$ tail -f mem.log (this is from ps) TIMESTAMP PID RSS %MEM 2011-07-13 13:48:55 2405 65144 12.8 2011-07-13 13:49:55 2405 66932 13.2 2011-07-13 13:50:55 2405 69576 13.7 2011-07-13 13:51:55 2405 71552 14.1 2011-07-13 13:52:55 2405 73576 14.5 2011-07-13 13:53:55 2405 75804 14.9 2011-07-13 13:54:55 2405 78388 15.4 2011-07-13 13:55:55 2405 80544 15.9 2011-07-13 13:56:55 2405 81784 16.1 2011-07-13 13:57:55 2405 83720 16.5 2011-07-13 13:58:55 2405 86524 17.0
FS runs under root account and it is started as:
/usr/local/freeswitch/bin/freeswitch -nc -nonat -db /dev/shm -conf /usr/local/freeswitch/conf/ -log /usr/local/freeswitch/log/ -run /usr/local/freeswitch/run/
Also ulimit is like this;
ulimit -c unlimited ulimit -d unlimited ulimit -f unlimited ulimit -i unlimited ulimit -n 999999 ulimit -q unlimited ulimit -u unlimited ulimit -v unlimited ulimit -x unlimited ulimit -s 240 ulimit -l unlimited
so, does anyone have a clue on why the memory goes up ? ... what I'm doing wrong ?
Regards, Tihomir.
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
On Wed, Jul 13, 2011 at 6:17 PM, Steven Ayre <steveayre@gmail.com> wrote:
Does "fsctl reclaim_mem" help at all?
-Steve
Hi Steven, I just did on one of the affected servers ... what should i get as a result ? memory returned, freed ?
anyhow, after 5 minutes observation the memory keeps growing up... but looks like i still have time :) $ sudo cat /proc/`ps aux | grep freeswitch | grep -v grep | awk '{print $2}'`/smaps | egrep "(heap)" -A 7 110ee000-2086d000 rw-p 110ee000 00:00 0 [heap] Size: 253436 kB Rss: 253240 kB Shared_Clean: 0 kB Shared_Dirty: 0 kB Private_Clean: 0 kB Private_Dirty: 253240 kB Swap: 0 kB
It -might- return some unused memory to the system when you run it, but it wouldn't stop it growing again. -Steve On 14 July 2011 14:23, Tihomir Culjaga <tculjaga@gmail.com> wrote:
On Wed, Jul 13, 2011 at 6:17 PM, Steven Ayre <steveayre@gmail.com> wrote:
Does "fsctl reclaim_mem" help at all?
-Steve
Hi Steven, I just did on one of the affected servers ... what should i get as a result ? memory returned, freed ?
anyhow, after 5 minutes observation the memory keeps growing up... but looks like i still have time :)
$ sudo cat /proc/`ps aux | grep freeswitch | grep -v grep | awk '{print $2}'`/smaps | egrep "(heap)" -A 7 110ee000-2086d000 rw-p 110ee000 00:00 0 [heap] Size: 253436 kB Rss: 253240 kB Shared_Clean: 0 kB Shared_Dirty: 0 kB Private_Clean: 0 kB Private_Dirty: 253240 kB Swap: 0 kB
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
On Thu, Jul 14, 2011 at 3:35 PM, Steven Ayre <steveayre@gmail.com> wrote:
It -might- return some unused memory to the system when you run it, but it wouldn't stop it growing again.
-Steve
im performing the test now ... will be able to tell.
btw: how to be sure im running the correct fs ?.... i mean ... the version from command line returns just "FreeSWITCH Version 1.0.head (git-)" ... any chance it can return the commit-id or something ?
By the way, if it makes any difference it still doesn't fix the leak, that'll still need tracking down. The truncated git version means you're on an old version of git. Update to 1.7. It shouldn't cause any problems other than breaking the version number. In the git checkout (if you still have it) "git log | head" should show you the latest revision you had checked out. -Steve On 14 July 2011 15:06, Tihomir Culjaga <tculjaga@gmail.com> wrote:
On Thu, Jul 14, 2011 at 3:35 PM, Steven Ayre <steveayre@gmail.com> wrote:
It -might- return some unused memory to the system when you run it, but it wouldn't stop it growing again.
-Steve
im performing the test now ... will be able to tell.
btw: how to be sure im running the correct fs ?.... i mean ... the version from command line returns just "FreeSWITCH Version 1.0.head (git-)" ... any chance it can return the commit-id or something ?
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
you can use gigs before you stop growing in some cases esp on sipp test. you need a lot more than 5 min to judge it. more like dozen or more hours. On Thu, Jul 14, 2011 at 9:27 AM, Steven Ayre <steveayre@gmail.com> wrote:
By the way, if it makes any difference it still doesn't fix the leak, that'll still need tracking down.
The truncated git version means you're on an old version of git. Update to 1.7. It shouldn't cause any problems other than breaking the version number.
In the git checkout (if you still have it) "git log | head" should show you the latest revision you had checked out.
-Steve
On 14 July 2011 15:06, Tihomir Culjaga <tculjaga@gmail.com> wrote:
On Thu, Jul 14, 2011 at 3:35 PM, Steven Ayre <steveayre@gmail.com> wrote:
It -might- return some unused memory to the system when you run it, but it wouldn't stop it growing again.
-Steve
im performing the test now ... will be able to tell.
btw: how to be sure im running the correct fs ?.... i mean ... the version from command line returns just "FreeSWITCH Version 1.0.head (git-)" ... any chance it can return the commit-id or something ?
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Anthony Minessale II FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/ Twitter: http://twitter.com/FreeSWITCH_wire AIM: anthm MSN:anthony_minessale@hotmail.com GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com IRC: irc.freenode.net #freeswitch FreeSWITCH Developer Conference sip:888@conference.freeswitch.org googletalk:conf+888@conference.freeswitch.org pstn:+19193869900
On Thu, Jul 14, 2011 at 5:11 PM, Anthony Minessale < anthony.minessale@gmail.com> wrote:
you can use gigs before you stop growing in some cases esp on sipp test. you need a lot more than 5 min to judge it. more like dozen or more hours.
yap, im running it for a very long time ... the example was just a snip ... and i hit the swap right now :=) .... after 2 hours of sipp at 30 CPS....
start: 2011-07-14 12:45:43 stop: 2011-07-14 14:31:13 if i use less load it will grow slowly but it will end into swap... its just a matter of time. So, how can we troubleshoot this ? im going to open a jira to move this out of Users Help mailing list...
I'm using commit: commit 130e1c87746b0596460358d77d6aabbfe41a0072 Author: Jeff Lenk <jeff@jefflenk.com> Date: Sat Jul 16 19:13:27 2011 -0500 and after 2 days and more then 3600000 sessions, the memory seems to be stable so the problem is probably fixed. I'll update this info in the next days. Stephen On Thu, Jul 14, 2011 at 5:48 PM, Tihomir Culjaga <tculjaga@gmail.com> wrote:
On Thu, Jul 14, 2011 at 5:11 PM, Anthony Minessale < anthony.minessale@gmail.com> wrote:
you can use gigs before you stop growing in some cases esp on sipp test. you need a lot more than 5 min to judge it. more like dozen or more hours.
yap, im running it for a very long time ... the example was just a snip ... and i hit the swap right now :=) .... after 2 hours of sipp at 30 CPS....
start: 2011-07-14 12:45:43 stop: 2011-07-14 14:31:13
if i use less load it will grow slowly but it will end into swap... its just a matter of time.
So, how can we troubleshoot this ?
im going to open a jira to move this out of Users Help mailing list...
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
I just took: commit 3c74f391f4f4dc03b687f0d6f45dfd19c17555d3 Author: Mathieu Parent <math.parent@gmail.com> Date: Fri Jul 22 23:05:56 2011 +0200 and running for 2 days as well.... hitting FS with SIPP at quite a high CPS its been 14178302 sessions since startup and the memory keeps stable. DATE PID RSS %MEM 2011-07-24 12:30:02 13268 239852 5.9 $DAT_TIM,$SIZE,$RSS,$SHARED_CLEAN,$SHARED_DIRTY,$PRIVATE_CLEAN,$PRIVATE_DIRTY,$SWAP 2011-07-24 12:31:11,46752,46644,0,0,0,46644,0 I don't see the problem anymore! Thanks for you effort. On Tue, Jul 19, 2011 at 5:50 PM, Stephen Wilde <wstephen80@gmail.com> wrote:
I'm using commit:
commit 130e1c87746b0596460358d77d6aabbfe41a0072 Author: Jeff Lenk <jeff@jefflenk.com> Date: Sat Jul 16 19:13:27 2011 -0500
and after 2 days and more then 3600000 sessions, the memory seems to be stable so the problem is probably fixed. I'll update this info in the next days.
Stephen
On Thu, Jul 14, 2011 at 5:48 PM, Tihomir Culjaga <tculjaga@gmail.com>wrote:
On Thu, Jul 14, 2011 at 5:11 PM, Anthony Minessale < anthony.minessale@gmail.com> wrote:
you can use gigs before you stop growing in some cases esp on sipp test. you need a lot more than 5 min to judge it. more like dozen or more hours.
yap, im running it for a very long time ... the example was just a snip ... and i hit the swap right now :=) .... after 2 hours of sipp at 30 CPS....
start: 2011-07-14 12:45:43 stop: 2011-07-14 14:31:13
if i use less load it will grow slowly but it will end into swap... its just a matter of time.
So, how can we troubleshoot this ?
im going to open a jira to move this out of Users Help mailing list...
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
What CPS did you get? Henry On Sun, Jul 24, 2011 at 4:36 PM, Tihomir Culjaga <tculjaga@gmail.com> wrote:
I just took:
commit 3c74f391f4f4dc03b687f0d6f45dfd19c17555d3 Author: Mathieu Parent <math.parent@gmail.com> Date: Fri Jul 22 23:05:56 2011 +0200
and running for 2 days as well.... hitting FS with SIPP at quite a high CPS
its been 14178302 sessions since startup and the memory keeps stable.
DATE PID RSS %MEM 2011-07-24 12:30:02 13268 239852 5.9
$DAT_TIM,$SIZE,$RSS,$SHARED_CLEAN,$SHARED_DIRTY,$PRIVATE_CLEAN,$PRIVATE_DIRTY,$SWAP 2011-07-24 12:31:11,46752,46644,0,0,0,46644,0
I don't see the problem anymore!
Thanks for you effort.
On Tue, Jul 19, 2011 at 5:50 PM, Stephen Wilde <wstephen80@gmail.com>wrote:
I'm using commit:
commit 130e1c87746b0596460358d77d6aabbfe41a0072 Author: Jeff Lenk <jeff@jefflenk.com> Date: Sat Jul 16 19:13:27 2011 -0500
and after 2 days and more then 3600000 sessions, the memory seems to be stable so the problem is probably fixed. I'll update this info in the next days.
Stephen
On Thu, Jul 14, 2011 at 5:48 PM, Tihomir Culjaga <tculjaga@gmail.com>wrote:
On Thu, Jul 14, 2011 at 5:11 PM, Anthony Minessale < anthony.minessale@gmail.com> wrote:
you can use gigs before you stop growing in some cases esp on sipp test. you need a lot more than 5 min to judge it. more like dozen or more hours.
yap, im running it for a very long time ... the example was just a snip ... and i hit the swap right now :=) .... after 2 hours of sipp at 30 CPS....
start: 2011-07-14 12:45:43 stop: 2011-07-14 14:31:13
if i use less load it will grow slowly but it will end into swap... its just a matter of time.
So, how can we troubleshoot this ?
im going to open a jira to move this out of Users Help mailing list...
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
i got peaks of 60 CPS as i was trying to simulate my real traffic pattern. Anyhow, a year ago o reached like 400 - 450 CPS on an average server Also, bear in mind it was just signaling (no RTP included) INVITE => <= 100 Trying <= 300 Multiple choices Also i can provide memory log (5 minute interval) to construct a chart if someone is interested. T. On Sun, Jul 24, 2011 at 12:36 PM, Henry Huang <b_ball_henry@hotmail.com>wrote:
What CPS did you get?
Henry
On Sun, Jul 24, 2011 at 4:36 PM, Tihomir Culjaga <tculjaga@gmail.com>wrote:
I just took:
commit 3c74f391f4f4dc03b687f0d6f45dfd19c17555d3 Author: Mathieu Parent <math.parent@gmail.com> Date: Fri Jul 22 23:05:56 2011 +0200
and running for 2 days as well.... hitting FS with SIPP at quite a high CPS
its been 14178302 sessions since startup and the memory keeps stable.
DATE PID RSS %MEM 2011-07-24 12:30:02 13268 239852 5.9
$DAT_TIM,$SIZE,$RSS,$SHARED_CLEAN,$SHARED_DIRTY,$PRIVATE_CLEAN,$PRIVATE_DIRTY,$SWAP 2011-07-24 12:31:11,46752,46644,0,0,0,46644,0
I don't see the problem anymore!
Thanks for you effort.
On Tue, Jul 19, 2011 at 5:50 PM, Stephen Wilde <wstephen80@gmail.com>wrote:
I'm using commit:
commit 130e1c87746b0596460358d77d6aabbfe41a0072 Author: Jeff Lenk <jeff@jefflenk.com> Date: Sat Jul 16 19:13:27 2011 -0500
and after 2 days and more then 3600000 sessions, the memory seems to be stable so the problem is probably fixed. I'll update this info in the next days.
Stephen
On Thu, Jul 14, 2011 at 5:48 PM, Tihomir Culjaga <tculjaga@gmail.com>wrote:
On Thu, Jul 14, 2011 at 5:11 PM, Anthony Minessale < anthony.minessale@gmail.com> wrote:
you can use gigs before you stop growing in some cases esp on sipp test. you need a lot more than 5 min to judge it. more like dozen or more hours.
yap, im running it for a very long time ... the example was just a snip ... and i hit the swap right now :=) .... after 2 hours of sipp at 30 CPS....
start: 2011-07-14 12:45:43 stop: 2011-07-14 14:31:13
if i use less load it will grow slowly but it will end into swap... its just a matter of time.
So, how can we troubleshoot this ?
im going to open a jira to move this out of Users Help mailing list...
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
On 24/07/11 14:26, Tihomir Culjaga wrote:
i got peaks of 60 CPS as i was trying to simulate my real traffic pattern.
Anyhow, a year ago o reached like 400 - 450 CPS on an average server
Apologies, are you implying that FS performance has dropped by a factor of 9 in a year? I hope this isn't the case! Alex -- This message is intended only for the addressee and may contain confidential information. Unless you are that person, you may not disclose its contents or use it in any way and are requested to delete the message along with any attachments and notify us immediately. "Transact" is operated by Integrated Financial Arrangements plc Domain House, 5-7 Singer Street, London EC2A 4BQ Tel: (020) 7608 4900 Fax: (020) 7608 5300 (Registered office: as above; Registered in England and Wales under number: 3727592) Authorised and regulated by the Financial Services Authority (entered on the FSA Register; number: 190856)
We're trying to be nice toward other similar projects, both closed and open source. At Cluecon we'll announce the reduction to 0.5 cpm (calls per minute), and optional random deadlocks. -giovanni On 7/24/11, Alex Crow <acrow@integrafin.co.uk> wrote:
On 24/07/11 14:26, Tihomir Culjaga wrote:
i got peaks of 60 CPS as i was trying to simulate my real traffic pattern.
Anyhow, a year ago o reached like 400 - 450 CPS on an average server
Apologies, are you implying that FS performance has dropped by a factor of 9 in a year?
I hope this isn't the case!
Alex
-- This message is intended only for the addressee and may contain confidential information. Unless you are that person, you may not disclose its contents or use it in any way and are requested to delete the message along with any attachments and notify us immediately.
"Transact" is operated by Integrated Financial Arrangements plc Domain House, 5-7 Singer Street, London EC2A 4BQ Tel: (020) 7608 4900 Fax: (020) 7608 5300 (Registered office: as above; Registered in England and Wales under number: 3727592) Authorised and regulated by the Financial Services Authority (entered on the FSA Register; number: 190856)
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Sent from my mobile device Sincerely, Giovanni Maruzzelli Cell : +39-347-2665618
Alex, he said he only tested 50-60 because that's what he has in actual real-use. The test he mentioned the year before presumably was full-capacity, rather than throttling back to test normal-usage. -Avi On Sun, Jul 24, 2011 at 11:48 PM, Giovanni Maruzzelli <gmaruzz@gmail.com>wrote:
We're trying to be nice toward other similar projects, both closed and open source.
At Cluecon we'll announce the reduction to 0.5 cpm (calls per minute), and optional random deadlocks.
-giovanni
On 7/24/11, Alex Crow <acrow@integrafin.co.uk> wrote:
On 24/07/11 14:26, Tihomir Culjaga wrote:
i got peaks of 60 CPS as i was trying to simulate my real traffic pattern.
Anyhow, a year ago o reached like 400 - 450 CPS on an average server
Apologies, are you implying that FS performance has dropped by a factor of 9 in a year?
I hope this isn't the case!
Alex
-- This message is intended only for the addressee and may contain confidential information. Unless you are that person, you may not disclose its contents or use it in any way and are requested to delete the message along with any attachments and notify us immediately.
"Transact" is operated by Integrated Financial Arrangements plc Domain House, 5-7 Singer Street, London EC2A 4BQ Tel: (020) 7608 4900 Fax: (020) 7608 5300 (Registered office: as above; Registered in England and Wales under number: 3727592) Authorised and regulated by the Financial Services Authority (entered on the FSA Register; number: 190856)
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Sent from my mobile device
Sincerely,
Giovanni Maruzzelli Cell : +39-347-2665618
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
On 07/24/2011 10:48 PM, Giovanni Maruzzelli wrote:
We're trying to be nice toward other similar projects, both closed and open source.
At Cluecon we'll announce the reduction to 0.5 cpm (calls per minute), and optional random deadlocks.
Lol, nice one Giovanni :) Regards, Patrick
I can confirm that after 7 days and 12,000,000 sessions with real traffic (production server with sip+isdn and rtp handling) the memory is stable so the problem is surely fixed. Stephen On Sun, Jul 24, 2011 at 10:36 AM, Tihomir Culjaga <tculjaga@gmail.com>wrote:
I just took:
commit 3c74f391f4f4dc03b687f0d6f45dfd19c17555d3 Author: Mathieu Parent <math.parent@gmail.com> Date: Fri Jul 22 23:05:56 2011 +0200
and running for 2 days as well.... hitting FS with SIPP at quite a high CPS
its been 14178302 sessions since startup and the memory keeps stable.
DATE PID RSS %MEM 2011-07-24 12:30:02 13268 239852 5.9
$DAT_TIM,$SIZE,$RSS,$SHARED_CLEAN,$SHARED_DIRTY,$PRIVATE_CLEAN,$PRIVATE_DIRTY,$SWAP 2011-07-24 12:31:11,46752,46644,0,0,0,46644,0
I don't see the problem anymore!
Thanks for you effort.
On Tue, Jul 19, 2011 at 5:50 PM, Stephen Wilde <wstephen80@gmail.com>wrote:
I'm using commit:
commit 130e1c87746b0596460358d77d6aabbfe41a0072 Author: Jeff Lenk <jeff@jefflenk.com> Date: Sat Jul 16 19:13:27 2011 -0500
and after 2 days and more then 3600000 sessions, the memory seems to be stable so the problem is probably fixed. I'll update this info in the next days.
Stephen
On Thu, Jul 14, 2011 at 5:48 PM, Tihomir Culjaga <tculjaga@gmail.com>wrote:
On Thu, Jul 14, 2011 at 5:11 PM, Anthony Minessale < anthony.minessale@gmail.com> wrote:
you can use gigs before you stop growing in some cases esp on sipp test. you need a lot more than 5 min to judge it. more like dozen or more hours.
yap, im running it for a very long time ... the example was just a snip ... and i hit the swap right now :=) .... after 2 hours of sipp at 30 CPS....
start: 2011-07-14 12:45:43 stop: 2011-07-14 14:31:13
if i use less load it will grow slowly but it will end into swap... its just a matter of time.
So, how can we troubleshoot this ?
im going to open a jira to move this out of Users Help mailing list...
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
I had a similar issue with commit 9cf44f3a5ee7cba9fc378447780499d41c4de671 of 6 July with a memory increase rate of 2Gb/day but now I have done a revert to an old commit (2246f3ca75eee93a7e7f4409aa816513b99e657a) for a reason not related to the memory leak. For this reason I have not yet open a jira. Due to a feature released recently, I'll do a git pull in next hours so I'll share the info I have. Stephen On Wed, Jul 13, 2011 at 5:27 PM, Tihomir Culjaga <tculjaga@gmail.com> wrote:
hello,
i upgraded to the latest GIT compiled configured FS without any issues... everything looks great... but when i put this into some traffic i noticed FS uses more and more memory... until it finished into swap. I didn't have issues like that previously but unfortunately i cannot recall what was the version with no issues.
The server is 64bit CentOS 5.4 and the FS version is the latest (well 4 days old tops). Im using just the standard modules (the list provided below) and FS keeps leaking memory
<load module="mod_console"/> <load module="mod_logfile"/> <load module="mod_enum"/> <load module="mod_cdr_csv"/> <load module="mod_event_socket"/> <load module="mod_sofia"/> <load module="mod_loopback"/> <load module="mod_commands"/> <load module="mod_conference"/> <load module="mod_db"/> <load module="mod_dptools"/> <load module="mod_expr"/> <load module="mod_fifo"/> <load module="mod_hash"/> <load module="mod_voicemail"/> <load module="mod_esf"/> <load module="mod_fsv"/> <load module="mod_cluechoo"/> <load module="mod_valet_parking"/> <load module="mod_dialplan_xml"/> <load module="mod_dialplan_asterisk"/> <load module="mod_spandsp"/> <load module="mod_g723_1"/> <load module="mod_g729"/> <load module="mod_amr"/> <load module="mod_ilbc"/> <load module="mod_speex"/> <load module="mod_h26x"/> <load module="mod_siren"/> <load module="mod_sndfile"/> <load module="mod_native_file"/> <load module="mod_local_stream"/> <load module="mod_tone_stream"/> <load module="mod_spidermonkey"/> <load module="mod_lua"/> <load module="mod_say_en"/>
This is the dialplan im triggering...
<extension name="doRedirect"> <condition field="destination_number" expression="^300030.*$"> <action application="info"/> <action application="redirect" data="<sip:0999901234567889@10.1.1.11:5060;user=phone>;q=0.99"/> <action application="hangup"/> <!-- well ... not really needed but only Got knows for sure--> </condition> </extension>
I have i have tried a pure "hello world" dialplan as:
<extension name="testDP"> <condition field="destination_number" expression="^300030.*$"> <action application="info"/> <action application="hangup"/> </condition> </extension>
But the situation is exactly the same.
This is the behavior i'm having .... memory just keep growing and growing until it hits the swap where the server is doomed.
tail -f smaps_log.log (this is from cat /proc/$PID/smaps | grep heap) TIM,SIZE,RSS,SHARED_CLEAN,SHARED_DIRTY,PRIVATE_CLEAN,PRIVATE_DIRTY,SWAP 2011-07-13 13:50:34,19268,18916,0,0,0,18916,0 2011-07-13 13:51:34,19268,18972,0,0,0,18972,0 2011-07-13 13:52:34,20324,20088,0,0,0,20088,0 2011-07-13 13:53:34,21264,20920,0,0,0,20920,0 2011-07-13 13:54:34,21048,20856,0,0,0,20856,0 2011-07-13 13:55:35,22396,22076,0,0,0,22076,0 2011-07-13 13:56:35,22396,22164,0,0,0,22256,0 2011-07-13 13:57:35,23220,22936,0,0,0,22936,0 2011-07-13 13:58:35,23480,23288,0,0,0,23288,0
$ tail -f mem.log (this is from ps) TIMESTAMP PID RSS %MEM 2011-07-13 13:48:55 2405 65144 12.8 2011-07-13 13:49:55 2405 66932 13.2 2011-07-13 13:50:55 2405 69576 13.7 2011-07-13 13:51:55 2405 71552 14.1 2011-07-13 13:52:55 2405 73576 14.5 2011-07-13 13:53:55 2405 75804 14.9 2011-07-13 13:54:55 2405 78388 15.4 2011-07-13 13:55:55 2405 80544 15.9 2011-07-13 13:56:55 2405 81784 16.1 2011-07-13 13:57:55 2405 83720 16.5 2011-07-13 13:58:55 2405 86524 17.0
FS runs under root account and it is started as:
/usr/local/freeswitch/bin/freeswitch -nc -nonat -db /dev/shm -conf /usr/local/freeswitch/conf/ -log /usr/local/freeswitch/log/ -run /usr/local/freeswitch/run/
Also ulimit is like this;
ulimit -c unlimited ulimit -d unlimited ulimit -f unlimited ulimit -i unlimited ulimit -n 999999 ulimit -q unlimited ulimit -u unlimited ulimit -v unlimited ulimit -x unlimited ulimit -s 240 ulimit -l unlimited
so, does anyone have a clue on why the memory goes up ? ... what I'm doing wrong ?
Regards, Tihomir.
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Try this commit (or newer) I think it fixes the problem commit e339b549e014f30c5de256cf2b3ba94a91bb06e3 Author: Anthony Minessale <anthm@freeswitch.org> Date: Wed Jul 13 10:37:32 2011 -0500 FS-3386 this is probably relevant, try this revision On Wed, Jul 13, 2011 at 11:59 AM, Stephen Wilde <wstephen80@gmail.com> wrote:
I had a similar issue with commit 9cf44f3a5ee7cba9fc378447780499d41c4de671 of 6 July with a memory increase rate of 2Gb/day but now I have done a revert to an old commit (2246f3ca75eee93a7e7f4409aa816513b99e657a) for a reason not related to the memory leak. For this reason I have not yet open a jira. Due to a feature released recently, I'll do a git pull in next hours so I'll share the info I have. Stephen
On Wed, Jul 13, 2011 at 5:27 PM, Tihomir Culjaga <tculjaga@gmail.com> wrote:
hello,
i upgraded to the latest GIT compiled configured FS without any issues... everything looks great... but when i put this into some traffic i noticed FS uses more and more memory... until it finished into swap. I didn't have issues like that previously but unfortunately i cannot recall what was the version with no issues.
The server is 64bit CentOS 5.4 and the FS version is the latest (well 4 days old tops). Im using just the standard modules (the list provided below) and FS keeps leaking memory
<load module="mod_console"/> <load module="mod_logfile"/> <load module="mod_enum"/> <load module="mod_cdr_csv"/> <load module="mod_event_socket"/> <load module="mod_sofia"/> <load module="mod_loopback"/> <load module="mod_commands"/> <load module="mod_conference"/> <load module="mod_db"/> <load module="mod_dptools"/> <load module="mod_expr"/> <load module="mod_fifo"/> <load module="mod_hash"/> <load module="mod_voicemail"/> <load module="mod_esf"/> <load module="mod_fsv"/> <load module="mod_cluechoo"/> <load module="mod_valet_parking"/> <load module="mod_dialplan_xml"/> <load module="mod_dialplan_asterisk"/> <load module="mod_spandsp"/> <load module="mod_g723_1"/> <load module="mod_g729"/> <load module="mod_amr"/> <load module="mod_ilbc"/> <load module="mod_speex"/> <load module="mod_h26x"/> <load module="mod_siren"/> <load module="mod_sndfile"/> <load module="mod_native_file"/> <load module="mod_local_stream"/> <load module="mod_tone_stream"/> <load module="mod_spidermonkey"/> <load module="mod_lua"/> <load module="mod_say_en"/>
This is the dialplan im triggering...
<extension name="doRedirect"> <condition field="destination_number" expression="^300030.*$"> <action application="info"/> <action application="redirect" data="<sip:0999901234567889@10.1.1.11:5060;user=phone>;q=0.99"/> <action application="hangup"/> <!-- well ... not really needed but only Got knows for sure--> </condition> </extension>
I have i have tried a pure "hello world" dialplan as:
<extension name="testDP"> <condition field="destination_number" expression="^300030.*$"> <action application="info"/> <action application="hangup"/> </condition> </extension>
But the situation is exactly the same.
This is the behavior i'm having .... memory just keep growing and growing until it hits the swap where the server is doomed.
tail -f smaps_log.log (this is from cat /proc/$PID/smaps | grep heap) TIM,SIZE,RSS,SHARED_CLEAN,SHARED_DIRTY,PRIVATE_CLEAN,PRIVATE_DIRTY,SWAP 2011-07-13 13:50:34,19268,18916,0,0,0,18916,0 2011-07-13 13:51:34,19268,18972,0,0,0,18972,0 2011-07-13 13:52:34,20324,20088,0,0,0,20088,0 2011-07-13 13:53:34,21264,20920,0,0,0,20920,0 2011-07-13 13:54:34,21048,20856,0,0,0,20856,0 2011-07-13 13:55:35,22396,22076,0,0,0,22076,0 2011-07-13 13:56:35,22396,22164,0,0,0,22256,0 2011-07-13 13:57:35,23220,22936,0,0,0,22936,0 2011-07-13 13:58:35,23480,23288,0,0,0,23288,0
$ tail -f mem.log (this is from ps) TIMESTAMP PID RSS %MEM 2011-07-13 13:48:55 2405 65144 12.8 2011-07-13 13:49:55 2405 66932 13.2 2011-07-13 13:50:55 2405 69576 13.7 2011-07-13 13:51:55 2405 71552 14.1 2011-07-13 13:52:55 2405 73576 14.5 2011-07-13 13:53:55 2405 75804 14.9 2011-07-13 13:54:55 2405 78388 15.4 2011-07-13 13:55:55 2405 80544 15.9 2011-07-13 13:56:55 2405 81784 16.1 2011-07-13 13:57:55 2405 83720 16.5 2011-07-13 13:58:55 2405 86524 17.0
FS runs under root account and it is started as:
/usr/local/freeswitch/bin/freeswitch -nc -nonat -db /dev/shm -conf /usr/local/freeswitch/conf/ -log /usr/local/freeswitch/log/ -run /usr/local/freeswitch/run/
Also ulimit is like this;
ulimit -c unlimited ulimit -d unlimited ulimit -f unlimited ulimit -i unlimited ulimit -n 999999 ulimit -q unlimited ulimit -u unlimited ulimit -v unlimited ulimit -x unlimited ulimit -s 240 ulimit -l unlimited
so, does anyone have a clue on why the memory goes up ? ... what I'm doing wrong ?
Regards, Tihomir.
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Join us at ClueCon 2011, Aug 9-11, Chicago http://www.cluecon.com 877-7-4ACLUE
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Anthony Minessale II FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/ Twitter: http://twitter.com/FreeSWITCH_wire AIM: anthm MSN:anthony_minessale@hotmail.com GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com IRC: irc.freenode.net #freeswitch FreeSWITCH Developer Conference sip:888@conference.freeswitch.org googletalk:conf+888@conference.freeswitch.org pstn:+19193869900
participants (9)
-
Alex Crow
-
Anthony Minessale
-
Avi Marcus
-
Giovanni Maruzzelli
-
Henry Huang
-
Patrick Lists
-
Stephen Wilde
-
Steven Ayre
-
Tihomir Culjaga