I also see same symptoms: - The CPU usage is less than %10 on peak hours and it is usually like that for days. - Suddenly CPU usage is around %98. Freeswitch is using the CPU. - While in this state, will stay in this state until a freeswitch restart. If I remove the SIP traffic, the CPU usage comes down, but as soon as I add the SIP Traffic, freeswitch goes back to using around %98 of traffic. - After freeswitch restart, everything goes back to normal. There is no other process using CPU or gradual CPU leakage and so on. It's a sudden, random and permanent jump. Thanks, Ali Pey On Wed, Feb 11, 2015 at 10:49 AM, 彭勇 <ppyy@pubyun.com> wrote:
i think it's bug of freeswitch:
-- the Freeswitch using more than 1000% CPU, and there is no other process eating CPU -- we move all SIP traffic from the server away, the cpu is low. and after sevral hours, if we move the SIP traffic back again, the FS eating all CPU again. the only way to recovery is to restart the FS. -- there is no DB such as mysql on the server, and we have add "nosql" option, no help
On Wed, Feb 11, 2015 at 10:03 PM, John Nash <john.nash778@gmail.com> wrote:
Dear Muhammad,
I think your issue is different than Ali Pey because CPU rises at a specific time (approx) while running fine most of the time. In my experience you should check following .. - Check using top commands if its indeed freeswitch taking up CPU. It may be logrotate or something. - If you are using DB on same server, also check DB connections, May be some long running query causing it (Like someone fires some billing report at approx same time)
On the other hand when you say "it runs fine all day". You may want to check that using top command at different time of day, may be CPU usage keep on increasing and in your peak time it increases so much that you see symptoms. (If this is true may be you and Ali pey have same issue perhaps some CPU leak).
P.S. All points I mentioned are from my VOIP experiences in general. I am NOT freeswitch expert. I have recently started experiments with freeswitch so people who are using freeswitch or experts will give more meaningful insight.
On Wed, Feb 11, 2015 at 7:16 PM, 彭勇 <ppyy@pubyun.com> wrote:
we have add this option to grub and reboot one months ago. no help.
we have media-pass-through option, and have more than 10 thousands sessions. it works fine all day and the CPU will rise suddenly about 9:00 am every day. i should restart the FS to recovery.
On Wed, Feb 11, 2015 at 9:25 PM, Muhammad Naseer Bhatti <nbhatti@gmail.com> wrote:
Try nohz=off reboot and see if that helps.
Sent from my iPad
On Feb 11, 2015, at 16:18, Aqs Younas <aqsyounas@gmail.com> wrote:
I am facing same issue. Freeswitch taking more than 100% cpu usage in htop even on 200 concurrent calls. For 1000 concurrent calls i have to install 3 freeswitch instances due to this much cpu usage taking by a single freeswitch node. My Dist is Debian 7.
On 11 February 2015 at 17:35, Muhammad Naseer Bhatti <
nbhatti@gmail.com>
wrote:
It looks like this is the same tickless kernel issue. I am using
Debian
7 and the CPU usage shows very high. Adding nohz=off to grub options does makes it lower. I am gathering more information in order to file a Jira. Debian 6 on the other hand works very quietly on the same workload. We are talking about 200+% CPU utilization on Debian 7 and around 50% on Debian 6 showing in htop. I know so many other factors also involved but I am still digging out more.
— Thanks, Muhammad Naseer Bhatti
From: 彭勇 <ppyy@pubyun.com> Reply: FreeSWITCH Users Help <freeswitch-users@lists.freeswitch.org
Date: February 11, 2015 at 3:20:46 PM To: FreeSWITCH Users Help <freeswitch-users@lists.freeswitch.org>> Subject: Re: [Freeswitch-users] Freeswitch 1.4.15 and a sudden jump in CPU usage
same issue.
I have several FS 1.4.15 running on CentOS 6.5 x86_64, the CPU will be very high about 9:00 am every morning. there is no crontab at this time.
i will downgrade to 1.4.14 to see if there is such issue.
On Wed, Feb 11, 2015 at 1:14 AM, Ali Pey <alipey@gmail.com> wrote:
Hi Anthony,
I do not know if I am hitting a bug and if this is a bug, I don't have much info. I'm using this mailing list to see if anyone else is experiencing this problem and if there is a configuration change on Linux or Freeswitch that can fix this problem. Jira would be to report bugs when you know there is a bug. My problem could be (very likely) an environment related issue.
Thanks.
On Tue, Feb 10, 2015 at 11:55 AM, Anthony Minessale <anthony.minessale@gmail.com> wrote: > > Also you will have better luck using JIRA. The mailing list is > expressly > NOT for reporting issues. > > > On Tue, Feb 10, 2015 at 10:51 AM, Michael Jerris <mike@jerris.com
> wrote: >> >> you might want to use gcore to look at the threads and see what is >> different when it in this state and not. >> >> > On Feb 10, 2015, at 11:28 AM, Ali Pey <alipey@gmail.com> wrote: >> > >> > Hello, >> > >> > Normally our CPU usage during peak hours are less than %10; >> > however, >> > time to time, freeswitch uses more than %95 of the CPU and it >> > stays >> > there >> > forever. The only way to get it back to normal is to restart >> > freeswitch >> > service. During the high CPU usage, freeswitch continues to >> > operate >> > but very >> > very slow. >> > >> > If I lower the traffic quite a bit, the CPU comes down, but >> > adding >> > back >> > the traffic, the CPU usage goes right back up. After freeswitch >> > restart, it >> > becomes normal again with the same traffic. >> > >> > >> > Any ideas or suggestions? >> > >> > Much appreciated. >> > >> > Thanks, >> > Ali Pey >> > >> >> >> >> >>
>> Professional FreeSWITCH Consulting Services: >> consulting@freeswitch.org >> http://www.freeswitchsolutions.com >> >> Official FreeSWITCH Sites >> http://www.freeswitch.org >> http://confluence.freeswitch.org >> http://www.cluecon.com >> >> FreeSWITCH-users mailing list >> FreeSWITCH-users@lists.freeswitch.org >> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users >> >> >> UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users >> http://www.freeswitch.org > > > > > -- > Anthony Minessale II ♬ @anthmfs ♬ @FreeSWITCH ♬ > > ☞ http://freeswitch.org/ ☞ http://cluecon.com/ ☞ > http://twitter.com/FreeSWITCH > ☞ irc.freenode.net #freeswitch ☞ http://freeswitch.org/g+ > > ClueCon Weekly Development Call > ☎ sip:888@conference.freeswitch.org ☎ +19193869900 > > > > >
> Professional FreeSWITCH Consulting Services: > consulting@freeswitch.org > http://www.freeswitchsolutions.com > > Official FreeSWITCH Sites > http://www.freeswitch.org > http://confluence.freeswitch.org > http://www.cluecon.com > > FreeSWITCH-users mailing list > FreeSWITCH-users@lists.freeswitch.org > http://lists.freeswitch.org/mailman/listinfo/freeswitch-users > > > UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users > http://www.freeswitch.org
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Peng Yong
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Peng Yong
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Peng Yong
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org