[Freeswitch-users] Strange "timer_test" result

Tue Mar 27 19:21:16 MSD 2012

compare the quality of the motherboards.

try enable-clock-nanosleep=false in switch.conf.xml

also try -heavy_timer (last resort)

you may want to explore a newer kernel that supports timerfd (centos 6
for instance)

On Tue, Mar 27, 2012 at 9:16 AM, Stephen Wilde <wstephen80 at gmail.com> wrote:
> Yes, it's the original kernel. I start linux without any additional
> parameter.
>
> I have this problem in 4 of my server and no issue with only 1 server:
>
> Problem with timer_test on:
>
> Server.1, dual Xeon X5660 (12 core in HT = 24), CentOS 5.7,
> kernel 2.6.18-274.3.1.el5, FS commit 2012-03-26, cpu load of 35%
> Server.2, dual Xeon X5520 (8 core in HT = 16), CentOS 5.5,
> kernel 2.6.18-194.17.4.el5, FS commit  2012-03-26, cpu load of 50%
> Server.3, dual Xeon E5606 (8 core), CentOS 5.7, kernel 2.6.18-274.17.1.el5,
> FS commit  2012-02-24, cpu load of 35%
> Server.4, dual Xeon  X5670 (12 core in HT = 24), CentOS 5.7, kernel
> 2.6.18-274.12.1.el5, FS commit  2012-02-24, cpu load of 25%
>
> No problem on this server:
>
> Server.5, dual Xeon  X5520 (8 core in HT = 16), CentOS 5.5, kernel
>  2.6.18-194.3.1.el5, FS commit  2011-10-24, cpu load of 50%
>
> Stephen
>
>
>
> On Tue, Mar 27, 2012 at 3:48 PM, Peter Olsson
> <peter.olsson at visionutveckling.se> wrote:
>>
>> Is this the original CentOS kernel? Also, did you set any strange kernel
>> parameters during startup? I think CentOS kernel out-of-the-box usually
>> handles this just fine.
>>
>>
>>
>> /Peter
>>
>>
>>
>> Från: freeswitch-users-bounces at lists.freeswitch.org
>> [mailto:freeswitch-users-bounces at lists.freeswitch.org] För Stephen Wilde
>> Skickat: den 27 mars 2012 15:41
>>
>>
>> Till: FreeSWITCH Users Help
>> Ämne: Re: [Freeswitch-users] Strange "timer_test" result
>>
>>
>>
>> With "1ms-timer" the behaviour is changed but the "timer_test" remain
>> strange:
>>
>>
>>
>> 2012-03-27 15:36:49.609946 [CONSOLE] mod_commands.c:559 Timer Test: 1
>> sleep 20 1
>>
>> 2012-03-27 15:36:49.630810 [CONSOLE] mod_commands.c:559 Timer Test: 2
>> sleep 20 21225
>>
>> 2012-03-27 15:36:49.671927 [CONSOLE] mod_commands.c:559 Timer Test: 3
>> sleep 20 40716
>>
>> 2012-03-27 15:36:49.671927 [CONSOLE] mod_commands.c:559 Timer Test: 4
>> sleep 20 29
>>
>> 2012-03-27 15:36:49.690968 [CONSOLE] mod_commands.c:559 Timer Test: 5
>> sleep 20 19451
>>
>> 2012-03-27 15:36:49.714993 [CONSOLE] mod_commands.c:559 Timer Test: 6
>> sleep 20 23380
>>
>> 2012-03-27 15:36:49.714993 [CONSOLE] mod_commands.c:559 Timer Test: 7
>> sleep 20 35
>>
>> 2012-03-27 15:36:49.752814 [CONSOLE] mod_commands.c:559 Timer Test: 8
>> sleep 20 38474
>>
>> 2012-03-27 15:36:49.752814 [CONSOLE] mod_commands.c:559 Timer Test: 9
>> sleep 20 41
>>
>> 2012-03-27 15:36:49.776956 [CONSOLE] mod_commands.c:559 Timer Test: 10
>> sleep 20 23408
>>
>> 2012-03-27 15:36:49.798632 [CONSOLE] mod_commands.c:559 Timer Test: 11
>> sleep 20 22079
>>
>> 2012-03-27 15:36:49.838054 [CONSOLE] mod_commands.c:559 Timer Test: 12
>> sleep 20 39021
>>
>> 2012-03-27 15:36:49.838054 [CONSOLE] mod_commands.c:559 Timer Test: 13
>> sleep 20 35
>>
>> 2012-03-27 15:36:49.857783 [CONSOLE] mod_commands.c:559 Timer Test: 14
>> sleep 20 19946
>>
>> 2012-03-27 15:36:49.887887 [CONSOLE] mod_commands.c:559 Timer Test: 15
>> sleep 20 29935
>>
>> 2012-03-27 15:36:49.906809 [CONSOLE] mod_commands.c:559 Timer Test: 16
>> sleep 20 18774
>>
>> 2012-03-27 15:36:49.946751 [CONSOLE] mod_commands.c:559 Timer Test: 17
>> sleep 20 40290
>>
>> 2012-03-27 15:36:49.946751 [CONSOLE] mod_commands.c:559 Timer Test: 18
>> sleep 20 32
>>
>> 2012-03-27 15:36:49.966757 [CONSOLE] mod_commands.c:559 Timer Test: 19
>> sleep 20 19813
>>
>> 2012-03-27 15:36:50.005781 [CONSOLE] mod_commands.c:559 Timer Test: 20
>> sleep 20 39099
>>
>> 2012-03-27 15:36:50.005781 [CONSOLE] mod_commands.c:559 Timer Test: 21
>> sleep 20 24
>>
>> 2012-03-27 15:36:50.023894 [CONSOLE] mod_commands.c:559 Timer Test: 22
>> sleep 20 18116
>>
>> 2012-03-27 15:36:50.046022 [CONSOLE] mod_commands.c:559 Timer Test: 23
>> sleep 20 22046
>>
>> 2012-03-27 15:36:50.074716 [CONSOLE] mod_commands.c:559 Timer Test: 24
>> sleep 20 29054
>>
>> 2012-03-27 15:36:50.074716 [CONSOLE] mod_commands.c:559 Timer Test: 25
>> sleep 20 25
>>
>> 2012-03-27 15:36:50.111794 [CONSOLE] mod_commands.c:559 Timer Test: 26
>> sleep 20 37413
>>
>> 2012-03-27 15:36:50.131778 [CONSOLE] mod_commands.c:559 Timer Test: 27
>> sleep 20 19684
>>
>> 2012-03-27 15:36:50.155846 [CONSOLE] mod_commands.c:559 Timer Test: 28
>> sleep 20 23480
>>
>> 2012-03-27 15:36:50.155846 [CONSOLE] mod_commands.c:559 Timer Test: 29
>> sleep 20 37
>>
>> 2012-03-27 15:36:50.179738 [CONSOLE] mod_commands.c:559 Timer Test: 30
>> sleep 20 23811
>>
>> 2012-03-27 15:36:50.196725 [CONSOLE] mod_commands.c:559 Timer Test: 31
>> sleep 20 18828
>>
>> 2012-03-27 15:36:50.220604 [CONSOLE] mod_commands.c:559 Timer Test: 32
>> sleep 20 22205
>>
>> 2012-03-27 15:36:50.250696 [CONSOLE] mod_commands.c:559 Timer Test: 33
>> sleep 20 30868
>>
>> 2012-03-27 15:36:50.275841 [CONSOLE] mod_commands.c:559 Timer Test: 34
>> sleep 20 24303
>>
>> 2012-03-27 15:36:50.275841 [CONSOLE] mod_commands.c:559 Timer Test: 35
>> sleep 20 57
>>
>> 2012-03-27 15:36:50.299676 [CONSOLE] mod_commands.c:559 Timer Test: 36
>> sleep 20 24607
>>
>> 2012-03-27 15:36:50.319195 [CONSOLE] mod_commands.c:559 Timer Test: 37
>> sleep 20 18660
>>
>> 2012-03-27 15:36:50.336701 [CONSOLE] mod_commands.c:559 Timer Test: 38
>> sleep 20 18321
>>
>> 2012-03-27 15:36:50.377677 [CONSOLE] mod_commands.c:559 Timer Test: 39
>> sleep 20 40551
>>
>> 2012-03-27 15:36:50.377677 [CONSOLE] mod_commands.c:559 Timer Test: 40
>> sleep 20 33
>>
>> 2012-03-27 15:36:50.398692 [CONSOLE] mod_commands.c:559 Timer Test: 41
>> sleep 20 20552
>>
>> 2012-03-27 15:36:50.421692 [CONSOLE] mod_commands.c:559 Timer Test: 42
>> sleep 20 23208
>>
>> 2012-03-27 15:36:50.459684 [CONSOLE] mod_commands.c:559 Timer Test: 43
>> sleep 20 38668
>>
>> 2012-03-27 15:36:50.459684 [CONSOLE] mod_commands.c:559 Timer Test: 44
>> sleep 20 34
>>
>> 2012-03-27 15:36:50.478817 [CONSOLE] mod_commands.c:559 Timer Test: 45
>> sleep 20 18432
>>
>> 2012-03-27 15:36:50.519691 [CONSOLE] mod_commands.c:559 Timer Test: 46
>> sleep 20 41447
>>
>> 2012-03-27 15:36:50.519691 [CONSOLE] mod_commands.c:559 Timer Test: 47
>> sleep 20 29
>>
>> 2012-03-27 15:36:50.542590 [CONSOLE] mod_commands.c:559 Timer Test: 48
>> sleep 20 22699
>>
>> 2012-03-27 15:36:50.552674 [CONSOLE] mod_commands.c:559 Timer Test: 49
>> sleep 20 10034
>>
>> 2012-03-27 15:36:50.590676 [CONSOLE] mod_commands.c:559 Timer Test: 50
>> sleep 20 38060
>>
>> 2012-03-27 15:36:50.608681 [CONSOLE] mod_commands.c:559 Timer Test: 51
>> sleep 20 17448
>>
>> 2012-03-27 15:36:50.625755 [CONSOLE] mod_commands.c:559 Timer Test: 52
>> sleep 20 17767
>>
>> 2012-03-27 15:36:50.643693 [CONSOLE] mod_commands.c:559 Timer Test: 53
>> sleep 20 17263
>>
>> 2012-03-27 15:36:50.663677 [CONSOLE] mod_commands.c:559 Timer Test: 54
>> sleep 20 21429
>>
>> 2012-03-27 15:36:50.682676 [CONSOLE] mod_commands.c:559 Timer Test: 55
>> sleep 20 18072
>>
>> 2012-03-27 15:36:50.723740 [CONSOLE] mod_commands.c:559 Timer Test: 56
>> sleep 20 40933
>>
>> 2012-03-27 15:36:50.723740 [CONSOLE] mod_commands.c:559 Timer Test: 57
>> sleep 20 29
>>
>> 2012-03-27 15:36:50.758800 [CONSOLE] mod_commands.c:559 Timer Test: 58
>> sleep 20 35950
>>
>> 2012-03-27 15:36:50.758800 [CONSOLE] mod_commands.c:559 Timer Test: 59
>> sleep 20 30
>>
>> 2012-03-27 15:36:50.779674 [CONSOLE] mod_commands.c:559 Timer Test: 60
>> sleep 20 19772
>>
>>
>>
>> The CPU load is low (20%) so what parameter can affect this? The CentOS
>> version? The kernel versione? The FS version? The number of cpu cores?
>>
>>
>>
>> Stephen
>>
>>
>>
>> On Mon, Mar 26, 2012 at 4:40 PM, Stephen Wilde <wstephen80 at gmail.com>
>> wrote:
>>
>> Ok, I'll try with this parameter, I think I have to do a Freeswitch
>> restart to make this change...
>>
>>
>>
>> Stephen
>>
>>
>>
>> On Mon, Mar 26, 2012 at 4:31 PM, Peter Olsson
>> <peter.olsson at visionutveckling.se> wrote:
>>
>> You could try to enable the ”old” 1 ms-timer. It will be a little less
>> efficient (a little more CPU load), and I’m not sure it helps, but it’s
>> worth a try.
>>
>>
>>
>> In switch.conf.xml (under autoload_configs), add this: <param
>> name="1ms-timer" value="true"/> - within the settings-tags.
>>
>>
>>
>> /Peter
>>
>>
>>
>> Från: freeswitch-users-bounces at lists.freeswitch.org
>> [mailto:freeswitch-users-bounces at lists.freeswitch.org] För Stephen Wilde
>> Skickat: den 26 mars 2012 16:20
>>
>>
>> Till: FreeSWITCH Users Help
>> Ämne: Re: [Freeswitch-users] Strange "timer_test" result
>>
>>
>>
>> Thank you Peter for your reply!
>>
>> I have already tried the upgrade to latest git, now I'm on FreeSWITCH
>> Version 1.1.beta1 (git-c31a799 2012-03-24 14-11-49 -0700) and the result is
>> the same.
>>
>> I have tried with few load (during night) and in this case the timer_test
>> is perfect.
>>
>> Any suggestion?
>>
>>
>>
>>
>>
>> On Mon, Mar 26, 2012 at 4:08 PM, Peter Olsson
>> <peter.olsson at visionutveckling.se> wrote:
>>
>> Yes, most likely.
>>
>>
>>
>> It’s very strange though, that a machine like this gives so poor timing
>> results.
>>
>>
>>
>> The first thing I would do is to upgrade to latest GIT HEAD. A patch was
>> commited about two weeks ago, that does the calculation for timer_test more
>> properly (so time for logging is not calculated).
>>
>>
>>
>> Have you tried to do the same test with no load at all?
>>
>>
>>
>> /Peter
>>
>>
>>
>> Från: freeswitch-users-bounces at lists.freeswitch.org
>> [mailto:freeswitch-users-bounces at lists.freeswitch.org] För Stephen Wilde
>> Skickat: den 26 mars 2012 15:52
>> Till: FreeSWITCH Users Help
>> Ämne: Re: [Freeswitch-users] Strange "timer_test" result
>>
>>
>>
>> Can this issue affect the voice quality?
>>
>>
>>
>> On Fri, Mar 23, 2012 at 7:46 PM, Stephen Wilde <wstephen80 at gmail.com>
>> wrote:
>>
>> Real hardware, a dedicate server with 2 Xeon X5670 (a total 24 core each
>> one with 12Mb cache at 2.93GHz) that is running at 20% - 25% of load. OS is
>> CentOS 5.7 64bit and FS is (git-0626c89 2012-02-29 14-45-39 -0600)
>>
>>
>>
>> On Fri, Mar 23, 2012 at 6:33 PM, Brian Foster <bdfoster at endigotech.com>
>> wrote:
>>
>> Is this on virtualized or real hardware?
>>
>>
>>
>> -BDF
>>
>> On Fri, Mar 23, 2012 at 1:31 PM, Stephen Wilde <wstephen80 at gmail.com>
>> wrote:
>>
>> I have run a "timer_test" in a dedicated FS server and I see strange
>> result: it's normal?
>>
>>
>>
>> Stephen
>>
>>
>>
>>
>>
>> freeswitch at internal> timer_test 20 40
>>
>> Avg: 19.866ms Total Time: 795.880ms
>>
>>
>>
>> 2012-03-23 18:25:54.157822 [CONSOLE] mod_commands.c:549 Timer Test:
>> samplecount after init: 1
>>
>> 2012-03-23 18:25:54.178818 [CONSOLE] mod_commands.c:554 Timer Test:
>> samplecount after first step: 2
>>
>> 2012-03-23 18:25:54.199833 [CONSOLE] mod_commands.c:563 Timer Test: 1
>> sleep 20 19568
>>
>> 2012-03-23 18:25:54.231890 [CONSOLE] mod_commands.c:563 Timer Test: 2
>> sleep 20 38231
>>
>> 2012-03-23 18:25:54.252816 [CONSOLE] mod_commands.c:563 Timer Test: 3
>> sleep 20 18847
>>
>> 2012-03-23 18:25:54.262818 [CONSOLE] mod_commands.c:563 Timer Test: 4
>> sleep 20 13982
>>
>> 2012-03-23 18:25:54.305813 [CONSOLE] mod_commands.c:563 Timer Test: 5
>> sleep 20 34793
>>
>> 2012-03-23 18:25:54.305813 [CONSOLE] mod_commands.c:563 Timer Test: 6
>> sleep 20 2
>>
>> 2012-03-23 18:25:54.326811 [CONSOLE] mod_commands.c:563 Timer Test: 7
>> sleep 20 23166
>>
>> 2012-03-23 18:25:54.347807 [CONSOLE] mod_commands.c:563 Timer Test: 8
>> sleep 20 16957
>>
>> 2012-03-23 18:25:54.357811 [CONSOLE] mod_commands.c:563 Timer Test: 9
>> sleep 20 17643
>>
>> 2012-03-23 18:25:54.378828 [CONSOLE] mod_commands.c:563 Timer Test: 10
>> sleep 20 18786
>>
>> 2012-03-23 18:25:54.399856 [CONSOLE] mod_commands.c:563 Timer Test: 11
>> sleep 20 25100
>>
>> 2012-03-23 18:25:54.420855 [CONSOLE] mod_commands.c:563 Timer Test: 12
>> sleep 20 18552
>>
>> 2012-03-23 18:25:54.441855 [CONSOLE] mod_commands.c:563 Timer Test: 13
>> sleep 20 18815
>>
>> 2012-03-23 18:25:54.462798 [CONSOLE] mod_commands.c:563 Timer Test: 14
>> sleep 20 19464
>>
>> 2012-03-23 18:25:54.484300 [CONSOLE] mod_commands.c:563 Timer Test: 15
>> sleep 20 22012
>>
>> 2012-03-23 18:25:54.494804 [CONSOLE] mod_commands.c:563 Timer Test: 16
>> sleep 20 13980
>>
>> 2012-03-23 18:25:54.515793 [CONSOLE] mod_commands.c:563 Timer Test: 17
>> sleep 20 19065
>>
>> 2012-03-23 18:25:54.556792 [CONSOLE] mod_commands.c:563 Timer Test: 18
>> sleep 20 39585
>>
>> 2012-03-23 18:25:54.556792 [CONSOLE] mod_commands.c:563 Timer Test: 19
>> sleep 20 2
>>
>> 2012-03-23 18:25:54.577790 [CONSOLE] mod_commands.c:563 Timer Test: 20
>> sleep 20 26255
>>
>> 2012-03-23 18:25:54.598790 [CONSOLE] mod_commands.c:563 Timer Test: 21
>> sleep 20 17872
>>
>> 2012-03-23 18:25:54.630794 [CONSOLE] mod_commands.c:563 Timer Test: 22
>> sleep 20 32191
>>
>> 2012-03-23 18:25:54.651790 [CONSOLE] mod_commands.c:563 Timer Test: 23
>> sleep 20 22634
>>
>> 2012-03-23 18:25:54.672788 [CONSOLE] mod_commands.c:563 Timer Test: 24
>> sleep 20 15483
>>
>> 2012-03-23 18:25:54.693783 [CONSOLE] mod_commands.c:563 Timer Test: 25
>> sleep 20 22813
>>
>> 2012-03-23 18:25:54.714783 [CONSOLE] mod_commands.c:563 Timer Test: 26
>> sleep 20 17099
>>
>> 2012-03-23 18:25:54.714783 [CONSOLE] mod_commands.c:563 Timer Test: 27
>> sleep 20 1
>>
>> 2012-03-23 18:25:54.734832 [CONSOLE] mod_commands.c:563 Timer Test: 28
>> sleep 20 29108
>>
>> 2012-03-23 18:25:54.755836 [CONSOLE] mod_commands.c:563 Timer Test: 29
>> sleep 20 11492
>>
>> 2012-03-23 18:25:54.776830 [CONSOLE] mod_commands.c:563 Timer Test: 30
>> sleep 20 20855
>>
>> 2012-03-23 18:25:54.808851 [CONSOLE] mod_commands.c:563 Timer Test: 31
>> sleep 20 32579
>>
>> 2012-03-23 18:25:54.818833 [CONSOLE] mod_commands.c:563 Timer Test: 32
>> sleep 20 18173
>>
>> 2012-03-23 18:25:54.850828 [CONSOLE] mod_commands.c:563 Timer Test: 33
>> sleep 20 22666
>>
>> 2012-03-23 18:25:54.871855 [CONSOLE] mod_commands.c:563 Timer Test: 34
>> sleep 20 23792
>>
>> 2012-03-23 18:25:54.892823 [CONSOLE] mod_commands.c:563 Timer Test: 35
>> sleep 20 26158
>>
>> 2012-03-23 18:25:54.913823 [CONSOLE] mod_commands.c:563 Timer Test: 36
>> sleep 20 13080
>>
>> 2012-03-23 18:25:54.934844 [CONSOLE] mod_commands.c:563 Timer Test: 37
>> sleep 20 24609
>>
>> 2012-03-23 18:25:54.934844 [CONSOLE] mod_commands.c:563 Timer Test: 38
>> sleep 20 1
>>
>> 2012-03-23 18:25:54.954766 [CONSOLE] mod_commands.c:563 Timer Test: 39
>> sleep 20 19413
>>
>> 2012-03-23 18:25:54.975764 [CONSOLE] mod_commands.c:563 Timer Test: 40
>> sleep 20 19820
>>
>> freeswitch at internal> status
>>
>> UP 0 years, 0 days, 16 hours, 10 minutes, 25 seconds, 539 milliseconds,
>> 696 microseconds
>>
>> FreeSWITCH is ready
>>
>> 955611 session(s) since startup
>>
>> 2192 session(s) 0/50
>>
>> 6000 session(s) max
>>
>> min idle cpu 0.00/74.00
>>
>>
>>
>> _________________________________________________________________________
>> Professional FreeSWITCH Consulting Services:
>> consulting at freeswitch.org
>> http://www.freeswitchsolutions.com
>>
>> 
>> 
>>
>> Official FreeSWITCH Sites
>> http://www.freeswitch.org
>> http://wiki.freeswitch.org
>> http://www.cluecon.com
>>
>> FreeSWITCH-users mailing list
>> FreeSWITCH-users at lists.freeswitch.org
>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>> http://www.freeswitch.org
>>
>>
>>
>>
>>
>> --
>> Brian D. Foster
>> Endigo Computer LLC
>> Email: bdfoster at endigotech.com
>> Phone: 317-800-7876
>> Indianapolis, Indiana, USA
>>
>> This message contains confidential information and is intended for those
>> listed in the "To:", "CC:", and/or "BCC:" fields of the message header. If
>> you are not the intended recipient you are notified that disclosing,
>> copying, distributing or taking any action in reliance on the contents of
>> this information is strictly prohibited. E-mail transmission cannot be
>> guaranteed to be secure or error-free as information could be intercepted,
>> corrupted, lost, destroyed, arrive late or incomplete, or contain viruses.
>> The sender therefore does not accept liability for any errors or omissions
>> in the contents of this message, which arise as a result of e-mail
>> transmission. If verification is required please request a hard-copy
>> version.
>>
>>
>> _________________________________________________________________________
>> Professional FreeSWITCH Consulting Services:
>> consulting at freeswitch.org
>> http://www.freeswitchsolutions.com
>>
>> 
>> 
>>
>> Official FreeSWITCH Sites
>> http://www.freeswitch.org
>> http://wiki.freeswitch.org
>> http://www.cluecon.com
>>
>> FreeSWITCH-users mailing list
>> FreeSWITCH-users at lists.freeswitch.org
>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>> http://www.freeswitch.org
>>
>>
>>
>>
>>
>>
>> _________________________________________________________________________
>> Professional FreeSWITCH Consulting Services:
>> consulting at freeswitch.org
>> http://www.freeswitchsolutions.com
>>
>> 
>> 
>>
>> Official FreeSWITCH Sites
>> http://www.freeswitch.org
>> http://wiki.freeswitch.org
>> http://www.cluecon.com
>>
>> FreeSWITCH-users mailing list
>> FreeSWITCH-users at lists.freeswitch.org
>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>> http://www.freeswitch.org
>>
>>
>>
>>
>> _________________________________________________________________________
>> Professional FreeSWITCH Consulting Services:
>> consulting at freeswitch.org
>> http://www.freeswitchsolutions.com
>>
>> 
>> 
>>
>> Official FreeSWITCH Sites
>> http://www.freeswitch.org
>> http://wiki.freeswitch.org
>> http://www.cluecon.com
>>
>> FreeSWITCH-users mailing list
>> FreeSWITCH-users at lists.freeswitch.org
>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>> http://www.freeswitch.org
>>
>>
>>
>>
>>
>> !DSPAM:4f71c23b32762536418862!
>>
>>
>> _________________________________________________________________________
>> Professional FreeSWITCH Consulting Services:
>> consulting at freeswitch.org
>> http://www.freeswitchsolutions.com
>>
>> 
>> 
>>
>> Official FreeSWITCH Sites
>> http://www.freeswitch.org
>> http://wiki.freeswitch.org
>> http://www.cluecon.com
>>
>> FreeSWITCH-users mailing list
>> FreeSWITCH-users at lists.freeswitch.org
>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>> http://www.freeswitch.org
>>
>
>
> _________________________________________________________________________
> Professional FreeSWITCH Consulting Services:
> consulting at freeswitch.org
> http://www.freeswitchsolutions.com
>
> 
> 
>
> Official FreeSWITCH Sites
> http://www.freeswitch.org
> http://wiki.freeswitch.org
> http://www.cluecon.com
>
> FreeSWITCH-users mailing list
> FreeSWITCH-users at lists.freeswitch.org
> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
> http://www.freeswitch.org
>

-- 
Anthony Minessale II

FreeSWITCH http://www.freeswitch.org/
ClueCon http://www.cluecon.com/
Twitter: http://twitter.com/FreeSWITCH_wire

AIM: anthm
MSN:anthony_minessale at hotmail.com
GTALK/JABBER/PAYPAL:anthony.minessale at gmail.com
IRC: irc.freenode.net #freeswitch

FreeSWITCH Developer Conference
sip:888 at conference.freeswitch.org
googletalk:conf+888 at conference.freeswitch.org
pstn:+19193869900