Performance testing: FS and own App?
hi, i am quite new to freeswitch and now i finally have fs up and running as i want with my php scripts to handle the calls. now that i want to start the service in the near future, i would like to test the performance of the whole system and the reliability. what are your experiences and ideas, how i could do it the best way? and what do i have to look for? i startet to test with sipp, which seems to be a useful tool, although i am not sure, how to read the results. in the switch.conf i set "max-sessions" to 11000 and "sessions-per-second" to 2000. in the console i entered: sipp -sn uac xx.xx.xx.xx -s 123456 -r 20 -l 1000 -d 4000 -rtp_echo the results are as follow: 20.0(4000 ms)/1.000s 5061 51.18 s 1023 xx.xx.xx.xx:5060(UDP) 20 new calls during 1.001 s period 9 ms scheduler resolution 807 calls (limit 1000) Peak was 807 calls, after 51 s 0 Running, 807 Paused, 0 Woken up 0 out-of-call msg (discarded) 1 open sockets 75989 Total echo RTP pckts 1st stream 481.979 last period RTP rate (kB/s) 0 Total echo RTP pckts 2nd stream 0.000 last period RTP rate (kB/s) Messages Retrans Timeout Unexpected-Msg INVITE ----------> 1023 0 0 100 <---------- 1023 0 0 180 <---------- 0 0 0 183 <---------- 249 0 0 200 <---------- E-RTD1 249 0 0 ACK ----------> 249 0 Pause [ 0ms] 249 0 BYE ----------> 216 0 0 200 <---------- 216 0 0 Counter Name | Periodic value | Cumulative value -------------------------+---------------------------+-------------------------- Elapsed Time | 00:00:00:072 | 00:08:30:106 Call Rate | 0.000 cps | 4.166 cps -------------------------+---------------------------+-------------------------- Incoming call created | 0 | 0 OutGoing call created | 0 | 2125 Total Call created | | 2125 Current Call | 0 | -------------------------+---------------------------+-------------------------- Successful call | 9 | 2125 Failed call | 0 | 0 -------------------------+---------------------------+-------------------------- Response Time 1 | 00:00:00:000 | 00:02:43:140 Call Length | 00:04:04:169 | 00:02:47:149 i do not get any errors. but i think that it is strange, that there are so little calls running at the same time. when i try to call the same number as sipp does, i have to wait a very long time, till the call is beeing answered. why are there so many paused calls waiting for fs to take care of? is this normal or are there some problems, which i have to take care of? i want to add, that i am using socket outbound with a number of php-scripts, which do a lot of call- and dialplan-handling. i am not using any xml. therefore i am sure, that the results are worse, that they would be with normal xml dialplans. thanks for your help and tipps. dannis
Freeswitch can handle a large volume of call... I suggest you review your configs to make sure you don't have any of the default or arbitrary other limits in there... We routinely run > 1500 concurrent calls on dual quad core hardware at call rates far above what you tested at Ken
From: Dennis <odermann@googlemail.com> Reply-To: <freeswitch-users@lists.freeswitch.org> Date: Tue, 23 Dec 2008 09:49:38 +0100 To: <Freeswitch-users@lists.freeswitch.org> Subject: [Freeswitch-users] Performance testing: FS and own App?
hi,
i am quite new to freeswitch and now i finally have fs up and running as i want with my php scripts to handle the calls.
now that i want to start the service in the near future, i would like to test the performance of the whole system and the reliability.
what are your experiences and ideas, how i could do it the best way? and what do i have to look for?
i startet to test with sipp, which seems to be a useful tool, although i am not sure, how to read the results.
in the switch.conf i set "max-sessions" to 11000 and "sessions-per-second" to 2000.
in the console i entered: sipp -sn uac xx.xx.xx.xx -s 123456 -r 20 -l 1000 -d 4000 -rtp_echo
the results are as follow:
20.0(4000 ms)/1.000s 5061 51.18 s 1023 xx.xx.xx.xx:5060(UDP)
20 new calls during 1.001 s period 9 ms scheduler resolution 807 calls (limit 1000) Peak was 807 calls, after 51 s 0 Running, 807 Paused, 0 Woken up 0 out-of-call msg (discarded) 1 open sockets 75989 Total echo RTP pckts 1st stream 481.979 last period RTP rate (kB/s) 0 Total echo RTP pckts 2nd stream 0.000 last period RTP rate (kB/s)
Messages Retrans Timeout Unexpected-Msg INVITE ----------> 1023 0 0 100 <---------- 1023 0 0 180 <---------- 0 0 0 183 <---------- 249 0 0 200 <---------- E-RTD1 249 0 0 ACK ----------> 249 0 Pause [ 0ms] 249 0 BYE ----------> 216 0 0 200 <---------- 216 0 0
Counter Name | Periodic value | Cumulative value -------------------------+---------------------------+------------------------ -- Elapsed Time | 00:00:00:072 | 00:08:30:106 Call Rate | 0.000 cps | 4.166 cps -------------------------+---------------------------+------------------------ -- Incoming call created | 0 | 0 OutGoing call created | 0 | 2125 Total Call created | | 2125 Current Call | 0 | -------------------------+---------------------------+------------------------ -- Successful call | 9 | 2125 Failed call | 0 | 0 -------------------------+---------------------------+------------------------ -- Response Time 1 | 00:00:00:000 | 00:02:43:140 Call Length | 00:04:04:169 | 00:02:47:149
i do not get any errors. but i think that it is strange, that there are so little calls running at the same time. when i try to call the same number as sipp does, i have to wait a very long time, till the call is beeing answered.
why are there so many paused calls waiting for fs to take care of?
is this normal or are there some problems, which i have to take care of?
i want to add, that i am using socket outbound with a number of php-scripts, which do a lot of call- and dialplan-handling. i am not using any xml. therefore i am sure, that the results are worse, that they would be with normal xml dialplans.
thanks for your help and tipps. dannis
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
if i do the same test with the 9998, it does not to seem much better: 20.0(4000 ms)/1.000s 5061 68.25 s 1174 xx.xx.xx.xx:5060(UDP) 0 new calls during 1.008 s period 9 ms scheduler resolution 710 calls (limit 1000) Peak was 782 calls, after 58 s 0 Running, 710 Paused, 0 Woken up 0 out-of-call msg (discarded) 1 open sockets 595580 Total echo RTP pckts 1st stream 2809.336 last period RTP rate (kB/s) 0 Total echo RTP pckts 2nd stream 0.000 last period RTP rate (kB/s) Messages Retrans Timeout Unexpected-Msg INVITE ----------> 1174 0 0 100 <---------- 1174 0 0 180 <---------- 0 0 0 183 <---------- 0 0 0 200 <---------- E-RTD1 480 0 0 ACK ----------> 480 0 Pause [ 0ms] 480 0 BYE ----------> 464 0 0 200 <---------- 464 0 0 what settings could i review to get more out of the server? our setup is a new xeon quad core, 4 gb ram and ubuntu 64-bit. we also entered the ulimit lines and set "manage-presence" to false. thanks dennis 2008/12/23 Ken Rice <krice@suspicious.org>:
Freeswitch can handle a large volume of call... I suggest you review your configs to make sure you don't have any of the default or arbitrary other limits in there... We routinely run > 1500 concurrent calls on dual quad core hardware at call rates far above what you tested at
Ken
There are a number of issues you can be running into... It really depends on how your app works, what your actual configuration of freeswitch is, disk IO subsystem, ulimits, etc etc....
From: Dennis <odermann@googlemail.com> Reply-To: <freeswitch-users@lists.freeswitch.org> Date: Tue, 23 Dec 2008 10:31:00 +0100 To: <freeswitch-users@lists.freeswitch.org> Subject: Re: [Freeswitch-users] Performance testing: FS and own App?
if i do the same test with the 9998, it does not to seem much better:
20.0(4000 ms)/1.000s 5061 68.25 s 1174 xx.xx.xx.xx:5060(UDP)
0 new calls during 1.008 s period 9 ms scheduler resolution 710 calls (limit 1000) Peak was 782 calls, after 58 s 0 Running, 710 Paused, 0 Woken up 0 out-of-call msg (discarded) 1 open sockets 595580 Total echo RTP pckts 1st stream 2809.336 last period RTP rate (kB/s) 0 Total echo RTP pckts 2nd stream 0.000 last period RTP rate (kB/s)
Messages Retrans Timeout Unexpected-Msg INVITE ----------> 1174 0 0 100 <---------- 1174 0 0 180 <---------- 0 0 0 183 <---------- 0 0 0 200 <---------- E-RTD1 480 0 0 ACK ----------> 480 0 Pause [ 0ms] 480 0 BYE ----------> 464 0 0 200 <---------- 464 0 0
what settings could i review to get more out of the server?
our setup is a new xeon quad core, 4 gb ram and ubuntu 64-bit. we also entered the ulimit lines and set "manage-presence" to false.
thanks dennis
2008/12/23 Ken Rice <krice@suspicious.org>:
Freeswitch can handle a large volume of call... I suggest you review your configs to make sure you don't have any of the default or arbitrary other limits in there... We routinely run > 1500 concurrent calls on dual quad core hardware at call rates far above what you tested at
Ken
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
because the latest result was with the 9998, it can't be out app (at the moment). so there are no other typical things or settings i could look for? 2008/12/23 Ken Rice <krice@suspicious.org>:
There are a number of issues you can be running into... It really depends on how your app works, what your actual configuration of freeswitch is, disk IO subsystem, ulimits, etc etc....
Whats this 9998 to which you refer?
From: Dennis <odermann@googlemail.com> Reply-To: <freeswitch-users@lists.freeswitch.org> Date: Tue, 23 Dec 2008 10:43:30 +0100 To: <freeswitch-users@lists.freeswitch.org> Subject: Re: [Freeswitch-users] Performance testing: FS and own App?
because the latest result was with the 9998, it can't be out app (at the moment).
so there are no other typical things or settings i could look for?
2008/12/23 Ken Rice <krice@suspicious.org>:
There are a number of issues you can be running into... It really depends on how your app works, what your actual configuration of freeswitch is, disk IO subsystem, ulimits, etc etc....
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
the 9998 is an extension in the default.xml to test with media flowing through the line. 2008/12/23 Ken Rice <krice@suspicious.org>:
Whats this 9998 to which you refer?
From: Dennis <odermann@googlemail.com> Reply-To: <freeswitch-users@lists.freeswitch.org> Date: Tue, 23 Dec 2008 10:43:30 +0100 To: <freeswitch-users@lists.freeswitch.org> Subject: Re: [Freeswitch-users] Performance testing: FS and own App?
because the latest result was with the 9998, it can't be out app (at the moment).
so there are no other typical things or settings i could look for?
2008/12/23 Ken Rice <krice@suspicious.org>:
There are a number of issues you can be running into... It really depends on how your app works, what your actual configuration of freeswitch is, disk IO subsystem, ulimits, etc etc....
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Oh! Well who knows how that will affect the performance... I have never tested it with that... Try the echo tester but be sure you are using the media refector with sipp or you arent doing anything useful
From: Dennis <odermann@googlemail.com> Reply-To: <freeswitch-users@lists.freeswitch.org> Date: Tue, 23 Dec 2008 10:52:09 +0100 To: <freeswitch-users@lists.freeswitch.org> Subject: Re: [Freeswitch-users] Performance testing: FS and own App?
the 9998 is an extension in the default.xml to test with media flowing through the line.
2008/12/23 Ken Rice <krice@suspicious.org>:
Whats this 9998 to which you refer?
From: Dennis <odermann@googlemail.com> Reply-To: <freeswitch-users@lists.freeswitch.org> Date: Tue, 23 Dec 2008 10:43:30 +0100 To: <freeswitch-users@lists.freeswitch.org> Subject: Re: [Freeswitch-users] Performance testing: FS and own App?
because the latest result was with the 9998, it can't be out app (at the moment).
so there are no other typical things or settings i could look for?
2008/12/23 Ken Rice <krice@suspicious.org>:
There are a number of issues you can be running into... It really depends on how your app works, what your actual configuration of freeswitch is, disk IO subsystem, ulimits, etc etc....
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
sorry, i do not really understand what you mean with: "Try the echo tester but be sure you are using the media refector with sipp or you arent doing anything useful". what is the "echo tester" and what is "media refector" and how could i use it? i would like to find out, how many people can talk to each other over the fs server at the same time. a test setup, which simulates real calls would be very helpful for me. and then i would like to be able to compare the results with others, to see, if everything is working as it should. 2008/12/23 Ken Rice <krice@suspicious.org>:
Oh! Well who knows how that will affect the performance... I have never tested it with that... Try the echo tester but be sure you are using the media refector with sipp or you arent doing anything useful
The echo tester was refering to the echo app in freeswitch The media reflector is part of sipp that just echos media back to the source... That's the proper way to test media handling capabilities otherwise you are only seeing 1/2 the media stream
From: Dennis <odermann@googlemail.com> Reply-To: <freeswitch-users@lists.freeswitch.org> Date: Tue, 23 Dec 2008 11:06:06 +0100 To: <freeswitch-users@lists.freeswitch.org> Subject: Re: [Freeswitch-users] Performance testing: FS and own App?
sorry, i do not really understand what you mean with: "Try the echo tester but be sure you are using the media refector with sipp or you arent doing anything useful".
what is the "echo tester" and what is "media refector" and how could i use it?
i would like to find out, how many people can talk to each other over the fs server at the same time. a test setup, which simulates real calls would be very helpful for me. and then i would like to be able to compare the results with others, to see, if everything is working as it should.
2008/12/23 Ken Rice <krice@suspicious.org>:
Oh! Well who knows how that will affect the performance... I have never tested it with that... Try the echo tester but be sure you are using the media refector with sipp or you arent doing anything useful
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
ah, that sounds interesting. so the echo app is the 9996, right? how can i start/use the media reflector? is it something, i have to call sipp with? sorry for this question, but i am very new in this business. right now i call sipp with: sipp -sn uac xx.xx.xx.xx -s 123456 -r 50 -l 400 -d 4000 -rtp_echo 2008/12/23 Ken Rice <krice@suspicious.org>:
The echo tester was refering to the echo app in freeswitch
The media reflector is part of sipp that just echos media back to the source... That's the proper way to test media handling capabilities otherwise you are only seeing 1/2 the media stream
From: Dennis <odermann@googlemail.com> Reply-To: <freeswitch-users@lists.freeswitch.org> Date: Tue, 23 Dec 2008 11:06:06 +0100 To: <freeswitch-users@lists.freeswitch.org> Subject: Re: [Freeswitch-users] Performance testing: FS and own App?
sorry, i do not really understand what you mean with: "Try the echo tester but be sure you are using the media refector with sipp or you arent doing anything useful".
what is the "echo tester" and what is "media refector" and how could i use it?
i would like to find out, how many people can talk to each other over the fs server at the same time. a test setup, which simulates real calls would be very helpful for me. and then i would like to be able to compare the results with others, to see, if everything is working as it should.
2008/12/23 Ken Rice <krice@suspicious.org>:
Oh! Well who knows how that will affect the performance... I have never tested it with that... Try the echo tester but be sure you are using the media refector with sipp or you arent doing anything useful
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
participants (2)
-
Dennis
-
Ken Rice