[Freeswitch-users] Strange "timer_test" result
Stephen Wilde
wstephen80 at gmail.com
Tue Mar 27 19:37:52 MSD 2012
Thank you for your reply.
The motherboard cannot be the issue because 2 of these servers (server.2
and server.5) are exactly the same hardware (HP DL380 G6).
I'll try with enable-clock-nanosleep=false and I'll try also
with -heavy_timer cmd line parameter.
More difficult to test timerfd (these server are in production and it's not
simple to do this upgrade).
In the working server is running a very old FS version (2011-10-24), I'll
try also to run this version in a not working server.
Stephen
On Tue, Mar 27, 2012 at 5:21 PM, Anthony Minessale <
anthony.minessale at gmail.com> wrote:
> compare the quality of the motherboards.
>
> try enable-clock-nanosleep=false in switch.conf.xml
>
> also try -heavy_timer (last resort)
>
> you may want to explore a newer kernel that supports timerfd (centos 6
> for instance)
>
>
> On Tue, Mar 27, 2012 at 9:16 AM, Stephen Wilde <wstephen80 at gmail.com>
> wrote:
> > Yes, it's the original kernel. I start linux without any additional
> > parameter.
> >
> > I have this problem in 4 of my server and no issue with only 1 server:
> >
> > Problem with timer_test on:
> >
> > Server.1, dual Xeon X5660 (12 core in HT = 24), CentOS 5.7,
> > kernel 2.6.18-274.3.1.el5, FS commit 2012-03-26, cpu load of 35%
> > Server.2, dual Xeon X5520 (8 core in HT = 16), CentOS 5.5,
> > kernel 2.6.18-194.17.4.el5, FS commit 2012-03-26, cpu load of 50%
> > Server.3, dual Xeon E5606 (8 core), CentOS 5.7, kernel
> 2.6.18-274.17.1.el5,
> > FS commit 2012-02-24, cpu load of 35%
> > Server.4, dual Xeon X5670 (12 core in HT = 24), CentOS 5.7, kernel
> > 2.6.18-274.12.1.el5, FS commit 2012-02-24, cpu load of 25%
> >
> > No problem on this server:
> >
> > Server.5, dual Xeon X5520 (8 core in HT = 16), CentOS 5.5, kernel
> > 2.6.18-194.3.1.el5, FS commit 2011-10-24, cpu load of 50%
> >
> > Stephen
> >
> >
> >
> > On Tue, Mar 27, 2012 at 3:48 PM, Peter Olsson
> > <peter.olsson at visionutveckling.se> wrote:
> >>
> >> Is this the original CentOS kernel? Also, did you set any strange kernel
> >> parameters during startup? I think CentOS kernel out-of-the-box usually
> >> handles this just fine.
> >>
> >>
> >>
> >> /Peter
> >>
> >>
> >>
> >> Från: freeswitch-users-bounces at lists.freeswitch.org
> >> [mailto:freeswitch-users-bounces at lists.freeswitch.org] För Stephen
> Wilde
> >> Skickat: den 27 mars 2012 15:41
> >>
> >>
> >> Till: FreeSWITCH Users Help
> >> Ämne: Re: [Freeswitch-users] Strange "timer_test" result
> >>
> >>
> >>
> >> With "1ms-timer" the behaviour is changed but the "timer_test" remain
> >> strange:
> >>
> >>
> >>
> >> 2012-03-27 15:36:49.609946 [CONSOLE] mod_commands.c:559 Timer Test: 1
> >> sleep 20 1
> >>
> >> 2012-03-27 15:36:49.630810 [CONSOLE] mod_commands.c:559 Timer Test: 2
> >> sleep 20 21225
> >>
> >> 2012-03-27 15:36:49.671927 [CONSOLE] mod_commands.c:559 Timer Test: 3
> >> sleep 20 40716
> >>
> >> 2012-03-27 15:36:49.671927 [CONSOLE] mod_commands.c:559 Timer Test: 4
> >> sleep 20 29
> >>
> >> 2012-03-27 15:36:49.690968 [CONSOLE] mod_commands.c:559 Timer Test: 5
> >> sleep 20 19451
> >>
> >> 2012-03-27 15:36:49.714993 [CONSOLE] mod_commands.c:559 Timer Test: 6
> >> sleep 20 23380
> >>
> >> 2012-03-27 15:36:49.714993 [CONSOLE] mod_commands.c:559 Timer Test: 7
> >> sleep 20 35
> >>
> >> 2012-03-27 15:36:49.752814 [CONSOLE] mod_commands.c:559 Timer Test: 8
> >> sleep 20 38474
> >>
> >> 2012-03-27 15:36:49.752814 [CONSOLE] mod_commands.c:559 Timer Test: 9
> >> sleep 20 41
> >>
> >> 2012-03-27 15:36:49.776956 [CONSOLE] mod_commands.c:559 Timer Test: 10
> >> sleep 20 23408
> >>
> >> 2012-03-27 15:36:49.798632 [CONSOLE] mod_commands.c:559 Timer Test: 11
> >> sleep 20 22079
> >>
> >> 2012-03-27 15:36:49.838054 [CONSOLE] mod_commands.c:559 Timer Test: 12
> >> sleep 20 39021
> >>
> >> 2012-03-27 15:36:49.838054 [CONSOLE] mod_commands.c:559 Timer Test: 13
> >> sleep 20 35
> >>
> >> 2012-03-27 15:36:49.857783 [CONSOLE] mod_commands.c:559 Timer Test: 14
> >> sleep 20 19946
> >>
> >> 2012-03-27 15:36:49.887887 [CONSOLE] mod_commands.c:559 Timer Test: 15
> >> sleep 20 29935
> >>
> >> 2012-03-27 15:36:49.906809 [CONSOLE] mod_commands.c:559 Timer Test: 16
> >> sleep 20 18774
> >>
> >> 2012-03-27 15:36:49.946751 [CONSOLE] mod_commands.c:559 Timer Test: 17
> >> sleep 20 40290
> >>
> >> 2012-03-27 15:36:49.946751 [CONSOLE] mod_commands.c:559 Timer Test: 18
> >> sleep 20 32
> >>
> >> 2012-03-27 15:36:49.966757 [CONSOLE] mod_commands.c:559 Timer Test: 19
> >> sleep 20 19813
> >>
> >> 2012-03-27 15:36:50.005781 [CONSOLE] mod_commands.c:559 Timer Test: 20
> >> sleep 20 39099
> >>
> >> 2012-03-27 15:36:50.005781 [CONSOLE] mod_commands.c:559 Timer Test: 21
> >> sleep 20 24
> >>
> >> 2012-03-27 15:36:50.023894 [CONSOLE] mod_commands.c:559 Timer Test: 22
> >> sleep 20 18116
> >>
> >> 2012-03-27 15:36:50.046022 [CONSOLE] mod_commands.c:559 Timer Test: 23
> >> sleep 20 22046
> >>
> >> 2012-03-27 15:36:50.074716 [CONSOLE] mod_commands.c:559 Timer Test: 24
> >> sleep 20 29054
> >>
> >> 2012-03-27 15:36:50.074716 [CONSOLE] mod_commands.c:559 Timer Test: 25
> >> sleep 20 25
> >>
> >> 2012-03-27 15:36:50.111794 [CONSOLE] mod_commands.c:559 Timer Test: 26
> >> sleep 20 37413
> >>
> >> 2012-03-27 15:36:50.131778 [CONSOLE] mod_commands.c:559 Timer Test: 27
> >> sleep 20 19684
> >>
> >> 2012-03-27 15:36:50.155846 [CONSOLE] mod_commands.c:559 Timer Test: 28
> >> sleep 20 23480
> >>
> >> 2012-03-27 15:36:50.155846 [CONSOLE] mod_commands.c:559 Timer Test: 29
> >> sleep 20 37
> >>
> >> 2012-03-27 15:36:50.179738 [CONSOLE] mod_commands.c:559 Timer Test: 30
> >> sleep 20 23811
> >>
> >> 2012-03-27 15:36:50.196725 [CONSOLE] mod_commands.c:559 Timer Test: 31
> >> sleep 20 18828
> >>
> >> 2012-03-27 15:36:50.220604 [CONSOLE] mod_commands.c:559 Timer Test: 32
> >> sleep 20 22205
> >>
> >> 2012-03-27 15:36:50.250696 [CONSOLE] mod_commands.c:559 Timer Test: 33
> >> sleep 20 30868
> >>
> >> 2012-03-27 15:36:50.275841 [CONSOLE] mod_commands.c:559 Timer Test: 34
> >> sleep 20 24303
> >>
> >> 2012-03-27 15:36:50.275841 [CONSOLE] mod_commands.c:559 Timer Test: 35
> >> sleep 20 57
> >>
> >> 2012-03-27 15:36:50.299676 [CONSOLE] mod_commands.c:559 Timer Test: 36
> >> sleep 20 24607
> >>
> >> 2012-03-27 15:36:50.319195 [CONSOLE] mod_commands.c:559 Timer Test: 37
> >> sleep 20 18660
> >>
> >> 2012-03-27 15:36:50.336701 [CONSOLE] mod_commands.c:559 Timer Test: 38
> >> sleep 20 18321
> >>
> >> 2012-03-27 15:36:50.377677 [CONSOLE] mod_commands.c:559 Timer Test: 39
> >> sleep 20 40551
> >>
> >> 2012-03-27 15:36:50.377677 [CONSOLE] mod_commands.c:559 Timer Test: 40
> >> sleep 20 33
> >>
> >> 2012-03-27 15:36:50.398692 [CONSOLE] mod_commands.c:559 Timer Test: 41
> >> sleep 20 20552
> >>
> >> 2012-03-27 15:36:50.421692 [CONSOLE] mod_commands.c:559 Timer Test: 42
> >> sleep 20 23208
> >>
> >> 2012-03-27 15:36:50.459684 [CONSOLE] mod_commands.c:559 Timer Test: 43
> >> sleep 20 38668
> >>
> >> 2012-03-27 15:36:50.459684 [CONSOLE] mod_commands.c:559 Timer Test: 44
> >> sleep 20 34
> >>
> >> 2012-03-27 15:36:50.478817 [CONSOLE] mod_commands.c:559 Timer Test: 45
> >> sleep 20 18432
> >>
> >> 2012-03-27 15:36:50.519691 [CONSOLE] mod_commands.c:559 Timer Test: 46
> >> sleep 20 41447
> >>
> >> 2012-03-27 15:36:50.519691 [CONSOLE] mod_commands.c:559 Timer Test: 47
> >> sleep 20 29
> >>
> >> 2012-03-27 15:36:50.542590 [CONSOLE] mod_commands.c:559 Timer Test: 48
> >> sleep 20 22699
> >>
> >> 2012-03-27 15:36:50.552674 [CONSOLE] mod_commands.c:559 Timer Test: 49
> >> sleep 20 10034
> >>
> >> 2012-03-27 15:36:50.590676 [CONSOLE] mod_commands.c:559 Timer Test: 50
> >> sleep 20 38060
> >>
> >> 2012-03-27 15:36:50.608681 [CONSOLE] mod_commands.c:559 Timer Test: 51
> >> sleep 20 17448
> >>
> >> 2012-03-27 15:36:50.625755 [CONSOLE] mod_commands.c:559 Timer Test: 52
> >> sleep 20 17767
> >>
> >> 2012-03-27 15:36:50.643693 [CONSOLE] mod_commands.c:559 Timer Test: 53
> >> sleep 20 17263
> >>
> >> 2012-03-27 15:36:50.663677 [CONSOLE] mod_commands.c:559 Timer Test: 54
> >> sleep 20 21429
> >>
> >> 2012-03-27 15:36:50.682676 [CONSOLE] mod_commands.c:559 Timer Test: 55
> >> sleep 20 18072
> >>
> >> 2012-03-27 15:36:50.723740 [CONSOLE] mod_commands.c:559 Timer Test: 56
> >> sleep 20 40933
> >>
> >> 2012-03-27 15:36:50.723740 [CONSOLE] mod_commands.c:559 Timer Test: 57
> >> sleep 20 29
> >>
> >> 2012-03-27 15:36:50.758800 [CONSOLE] mod_commands.c:559 Timer Test: 58
> >> sleep 20 35950
> >>
> >> 2012-03-27 15:36:50.758800 [CONSOLE] mod_commands.c:559 Timer Test: 59
> >> sleep 20 30
> >>
> >> 2012-03-27 15:36:50.779674 [CONSOLE] mod_commands.c:559 Timer Test: 60
> >> sleep 20 19772
> >>
> >>
> >>
> >> The CPU load is low (20%) so what parameter can affect this? The CentOS
> >> version? The kernel versione? The FS version? The number of cpu cores?
> >>
> >>
> >>
> >> Stephen
> >>
> >>
> >>
> >> On Mon, Mar 26, 2012 at 4:40 PM, Stephen Wilde <wstephen80 at gmail.com>
> >> wrote:
> >>
> >> Ok, I'll try with this parameter, I think I have to do a Freeswitch
> >> restart to make this change...
> >>
> >>
> >>
> >> Stephen
> >>
> >>
> >>
> >> On Mon, Mar 26, 2012 at 4:31 PM, Peter Olsson
> >> <peter.olsson at visionutveckling.se> wrote:
> >>
> >> You could try to enable the ”old” 1 ms-timer. It will be a little less
> >> efficient (a little more CPU load), and I’m not sure it helps, but it’s
> >> worth a try.
> >>
> >>
> >>
> >> In switch.conf.xml (under autoload_configs), add this: <param
> >> name="1ms-timer" value="true"/> - within the settings-tags.
> >>
> >>
> >>
> >> /Peter
> >>
> >>
> >>
> >> Från: freeswitch-users-bounces at lists.freeswitch.org
> >> [mailto:freeswitch-users-bounces at lists.freeswitch.org] För Stephen
> Wilde
> >> Skickat: den 26 mars 2012 16:20
> >>
> >>
> >> Till: FreeSWITCH Users Help
> >> Ämne: Re: [Freeswitch-users] Strange "timer_test" result
> >>
> >>
> >>
> >> Thank you Peter for your reply!
> >>
> >> I have already tried the upgrade to latest git, now I'm on FreeSWITCH
> >> Version 1.1.beta1 (git-c31a799 2012-03-24 14-11-49 -0700) and the
> result is
> >> the same.
> >>
> >> I have tried with few load (during night) and in this case the
> timer_test
> >> is perfect.
> >>
> >> Any suggestion?
> >>
> >>
> >>
> >>
> >>
> >> On Mon, Mar 26, 2012 at 4:08 PM, Peter Olsson
> >> <peter.olsson at visionutveckling.se> wrote:
> >>
> >> Yes, most likely.
> >>
> >>
> >>
> >> It’s very strange though, that a machine like this gives so poor timing
> >> results.
> >>
> >>
> >>
> >> The first thing I would do is to upgrade to latest GIT HEAD. A patch was
> >> commited about two weeks ago, that does the calculation for timer_test
> more
> >> properly (so time for logging is not calculated).
> >>
> >>
> >>
> >> Have you tried to do the same test with no load at all?
> >>
> >>
> >>
> >> /Peter
> >>
> >>
> >>
> >> Från: freeswitch-users-bounces at lists.freeswitch.org
> >> [mailto:freeswitch-users-bounces at lists.freeswitch.org] För Stephen
> Wilde
> >> Skickat: den 26 mars 2012 15:52
> >> Till: FreeSWITCH Users Help
> >> Ämne: Re: [Freeswitch-users] Strange "timer_test" result
> >>
> >>
> >>
> >> Can this issue affect the voice quality?
> >>
> >>
> >>
> >> On Fri, Mar 23, 2012 at 7:46 PM, Stephen Wilde <wstephen80 at gmail.com>
> >> wrote:
> >>
> >> Real hardware, a dedicate server with 2 Xeon X5670 (a total 24 core each
> >> one with 12Mb cache at 2.93GHz) that is running at 20% - 25% of load.
> OS is
> >> CentOS 5.7 64bit and FS is (git-0626c89 2012-02-29 14-45-39 -0600)
> >>
> >>
> >>
> >> On Fri, Mar 23, 2012 at 6:33 PM, Brian Foster <bdfoster at endigotech.com>
> >> wrote:
> >>
> >> Is this on virtualized or real hardware?
> >>
> >>
> >>
> >> -BDF
> >>
> >> On Fri, Mar 23, 2012 at 1:31 PM, Stephen Wilde <wstephen80 at gmail.com>
> >> wrote:
> >>
> >> I have run a "timer_test" in a dedicated FS server and I see strange
> >> result: it's normal?
> >>
> >>
> >>
> >> Stephen
> >>
> >>
> >>
> >>
> >>
> >> freeswitch at internal> timer_test 20 40
> >>
> >> Avg: 19.866ms Total Time: 795.880ms
> >>
> >>
> >>
> >> 2012-03-23 18:25:54.157822 [CONSOLE] mod_commands.c:549 Timer Test:
> >> samplecount after init: 1
> >>
> >> 2012-03-23 18:25:54.178818 [CONSOLE] mod_commands.c:554 Timer Test:
> >> samplecount after first step: 2
> >>
> >> 2012-03-23 18:25:54.199833 [CONSOLE] mod_commands.c:563 Timer Test: 1
> >> sleep 20 19568
> >>
> >> 2012-03-23 18:25:54.231890 [CONSOLE] mod_commands.c:563 Timer Test: 2
> >> sleep 20 38231
> >>
> >> 2012-03-23 18:25:54.252816 [CONSOLE] mod_commands.c:563 Timer Test: 3
> >> sleep 20 18847
> >>
> >> 2012-03-23 18:25:54.262818 [CONSOLE] mod_commands.c:563 Timer Test: 4
> >> sleep 20 13982
> >>
> >> 2012-03-23 18:25:54.305813 [CONSOLE] mod_commands.c:563 Timer Test: 5
> >> sleep 20 34793
> >>
> >> 2012-03-23 18:25:54.305813 [CONSOLE] mod_commands.c:563 Timer Test: 6
> >> sleep 20 2
> >>
> >> 2012-03-23 18:25:54.326811 [CONSOLE] mod_commands.c:563 Timer Test: 7
> >> sleep 20 23166
> >>
> >> 2012-03-23 18:25:54.347807 [CONSOLE] mod_commands.c:563 Timer Test: 8
> >> sleep 20 16957
> >>
> >> 2012-03-23 18:25:54.357811 [CONSOLE] mod_commands.c:563 Timer Test: 9
> >> sleep 20 17643
> >>
> >> 2012-03-23 18:25:54.378828 [CONSOLE] mod_commands.c:563 Timer Test: 10
> >> sleep 20 18786
> >>
> >> 2012-03-23 18:25:54.399856 [CONSOLE] mod_commands.c:563 Timer Test: 11
> >> sleep 20 25100
> >>
> >> 2012-03-23 18:25:54.420855 [CONSOLE] mod_commands.c:563 Timer Test: 12
> >> sleep 20 18552
> >>
> >> 2012-03-23 18:25:54.441855 [CONSOLE] mod_commands.c:563 Timer Test: 13
> >> sleep 20 18815
> >>
> >> 2012-03-23 18:25:54.462798 [CONSOLE] mod_commands.c:563 Timer Test: 14
> >> sleep 20 19464
> >>
> >> 2012-03-23 18:25:54.484300 [CONSOLE] mod_commands.c:563 Timer Test: 15
> >> sleep 20 22012
> >>
> >> 2012-03-23 18:25:54.494804 [CONSOLE] mod_commands.c:563 Timer Test: 16
> >> sleep 20 13980
> >>
> >> 2012-03-23 18:25:54.515793 [CONSOLE] mod_commands.c:563 Timer Test: 17
> >> sleep 20 19065
> >>
> >> 2012-03-23 18:25:54.556792 [CONSOLE] mod_commands.c:563 Timer Test: 18
> >> sleep 20 39585
> >>
> >> 2012-03-23 18:25:54.556792 [CONSOLE] mod_commands.c:563 Timer Test: 19
> >> sleep 20 2
> >>
> >> 2012-03-23 18:25:54.577790 [CONSOLE] mod_commands.c:563 Timer Test: 20
> >> sleep 20 26255
> >>
> >> 2012-03-23 18:25:54.598790 [CONSOLE] mod_commands.c:563 Timer Test: 21
> >> sleep 20 17872
> >>
> >> 2012-03-23 18:25:54.630794 [CONSOLE] mod_commands.c:563 Timer Test: 22
> >> sleep 20 32191
> >>
> >> 2012-03-23 18:25:54.651790 [CONSOLE] mod_commands.c:563 Timer Test: 23
> >> sleep 20 22634
> >>
> >> 2012-03-23 18:25:54.672788 [CONSOLE] mod_commands.c:563 Timer Test: 24
> >> sleep 20 15483
> >>
> >> 2012-03-23 18:25:54.693783 [CONSOLE] mod_commands.c:563 Timer Test: 25
> >> sleep 20 22813
> >>
> >> 2012-03-23 18:25:54.714783 [CONSOLE] mod_commands.c:563 Timer Test: 26
> >> sleep 20 17099
> >>
> >> 2012-03-23 18:25:54.714783 [CONSOLE] mod_commands.c:563 Timer Test: 27
> >> sleep 20 1
> >>
> >> 2012-03-23 18:25:54.734832 [CONSOLE] mod_commands.c:563 Timer Test: 28
> >> sleep 20 29108
> >>
> >> 2012-03-23 18:25:54.755836 [CONSOLE] mod_commands.c:563 Timer Test: 29
> >> sleep 20 11492
> >>
> >> 2012-03-23 18:25:54.776830 [CONSOLE] mod_commands.c:563 Timer Test: 30
> >> sleep 20 20855
> >>
> >> 2012-03-23 18:25:54.808851 [CONSOLE] mod_commands.c:563 Timer Test: 31
> >> sleep 20 32579
> >>
> >> 2012-03-23 18:25:54.818833 [CONSOLE] mod_commands.c:563 Timer Test: 32
> >> sleep 20 18173
> >>
> >> 2012-03-23 18:25:54.850828 [CONSOLE] mod_commands.c:563 Timer Test: 33
> >> sleep 20 22666
> >>
> >> 2012-03-23 18:25:54.871855 [CONSOLE] mod_commands.c:563 Timer Test: 34
> >> sleep 20 23792
> >>
> >> 2012-03-23 18:25:54.892823 [CONSOLE] mod_commands.c:563 Timer Test: 35
> >> sleep 20 26158
> >>
> >> 2012-03-23 18:25:54.913823 [CONSOLE] mod_commands.c:563 Timer Test: 36
> >> sleep 20 13080
> >>
> >> 2012-03-23 18:25:54.934844 [CONSOLE] mod_commands.c:563 Timer Test: 37
> >> sleep 20 24609
> >>
> >> 2012-03-23 18:25:54.934844 [CONSOLE] mod_commands.c:563 Timer Test: 38
> >> sleep 20 1
> >>
> >> 2012-03-23 18:25:54.954766 [CONSOLE] mod_commands.c:563 Timer Test: 39
> >> sleep 20 19413
> >>
> >> 2012-03-23 18:25:54.975764 [CONSOLE] mod_commands.c:563 Timer Test: 40
> >> sleep 20 19820
> >>
> >> freeswitch at internal> status
> >>
> >> UP 0 years, 0 days, 16 hours, 10 minutes, 25 seconds, 539 milliseconds,
> >> 696 microseconds
> >>
> >> FreeSWITCH is ready
> >>
> >> 955611 session(s) since startup
> >>
> >> 2192 session(s) 0/50
> >>
> >> 6000 session(s) max
> >>
> >> min idle cpu 0.00/74.00
> >>
> >>
> >>
> >>
> _________________________________________________________________________
> >> Professional FreeSWITCH Consulting Services:
> >> consulting at freeswitch.org
> >> http://www.freeswitchsolutions.com
> >>
> >>
> >>
> >>
> >> Official FreeSWITCH Sites
> >> http://www.freeswitch.org
> >> http://wiki.freeswitch.org
> >> http://www.cluecon.com
> >>
> >> FreeSWITCH-users mailing list
> >> FreeSWITCH-users at lists.freeswitch.org
> >> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
> >> UNSUBSCRIBE:
> http://lists.freeswitch.org/mailman/options/freeswitch-users
> >> http://www.freeswitch.org
> >>
> >>
> >>
> >>
> >>
> >> --
> >> Brian D. Foster
> >> Endigo Computer LLC
> >> Email: bdfoster at endigotech.com
> >> Phone: 317-800-7876
> >> Indianapolis, Indiana, USA
> >>
> >> This message contains confidential information and is intended for those
> >> listed in the "To:", "CC:", and/or "BCC:" fields of the message header.
> If
> >> you are not the intended recipient you are notified that disclosing,
> >> copying, distributing or taking any action in reliance on the contents
> of
> >> this information is strictly prohibited. E-mail transmission cannot be
> >> guaranteed to be secure or error-free as information could be
> intercepted,
> >> corrupted, lost, destroyed, arrive late or incomplete, or contain
> viruses.
> >> The sender therefore does not accept liability for any errors or
> omissions
> >> in the contents of this message, which arise as a result of e-mail
> >> transmission. If verification is required please request a hard-copy
> >> version.
> >>
> >>
> >>
> _________________________________________________________________________
> >> Professional FreeSWITCH Consulting Services:
> >> consulting at freeswitch.org
> >> http://www.freeswitchsolutions.com
> >>
> >>
> >>
> >>
> >> Official FreeSWITCH Sites
> >> http://www.freeswitch.org
> >> http://wiki.freeswitch.org
> >> http://www.cluecon.com
> >>
> >> FreeSWITCH-users mailing list
> >> FreeSWITCH-users at lists.freeswitch.org
> >> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
> >> UNSUBSCRIBE:
> http://lists.freeswitch.org/mailman/options/freeswitch-users
> >> http://www.freeswitch.org
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> _________________________________________________________________________
> >> Professional FreeSWITCH Consulting Services:
> >> consulting at freeswitch.org
> >> http://www.freeswitchsolutions.com
> >>
> >>
> >>
> >>
> >> Official FreeSWITCH Sites
> >> http://www.freeswitch.org
> >> http://wiki.freeswitch.org
> >> http://www.cluecon.com
> >>
> >> FreeSWITCH-users mailing list
> >> FreeSWITCH-users at lists.freeswitch.org
> >> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
> >> UNSUBSCRIBE:
> http://lists.freeswitch.org/mailman/options/freeswitch-users
> >> http://www.freeswitch.org
> >>
> >>
> >>
> >>
> >>
> _________________________________________________________________________
> >> Professional FreeSWITCH Consulting Services:
> >> consulting at freeswitch.org
> >> http://www.freeswitchsolutions.com
> >>
> >>
> >>
> >>
> >> Official FreeSWITCH Sites
> >> http://www.freeswitch.org
> >> http://wiki.freeswitch.org
> >> http://www.cluecon.com
> >>
> >> FreeSWITCH-users mailing list
> >> FreeSWITCH-users at lists.freeswitch.org
> >> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
> >> UNSUBSCRIBE:
> http://lists.freeswitch.org/mailman/options/freeswitch-users
> >> http://www.freeswitch.org
> >>
> >>
> >>
> >>
> >>
> >> !DSPAM:4f71c23b32762536418862!
> >>
> >>
> >>
> _________________________________________________________________________
> >> Professional FreeSWITCH Consulting Services:
> >> consulting at freeswitch.org
> >> http://www.freeswitchsolutions.com
> >>
> >>
> >>
> >>
> >> Official FreeSWITCH Sites
> >> http://www.freeswitch.org
> >> http://wiki.freeswitch.org
> >> http://www.cluecon.com
> >>
> >> FreeSWITCH-users mailing list
> >> FreeSWITCH-users at lists.freeswitch.org
> >> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
> >> UNSUBSCRIBE:
> http://lists.freeswitch.org/mailman/options/freeswitch-users
> >> http://www.freeswitch.org
> >>
> >
> >
> > _________________________________________________________________________
> > Professional FreeSWITCH Consulting Services:
> > consulting at freeswitch.org
> > http://www.freeswitchsolutions.com
> >
> >
> >
> >
> > Official FreeSWITCH Sites
> > http://www.freeswitch.org
> > http://wiki.freeswitch.org
> > http://www.cluecon.com
> >
> > FreeSWITCH-users mailing list
> > FreeSWITCH-users at lists.freeswitch.org
> > http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
> > UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
> > http://www.freeswitch.org
> >
>
>
>
> --
> Anthony Minessale II
>
> FreeSWITCH http://www.freeswitch.org/
> ClueCon http://www.cluecon.com/
> Twitter: http://twitter.com/FreeSWITCH_wire
>
> AIM: anthm
> MSN:anthony_minessale at hotmail.com
> GTALK/JABBER/PAYPAL:anthony.minessale at gmail.com
> IRC: irc.freenode.net #freeswitch
>
> FreeSWITCH Developer Conference
> sip:888 at conference.freeswitch.org
> googletalk:conf+888 at conference.freeswitch.org
> pstn:+19193869900
>
> _________________________________________________________________________
> Professional FreeSWITCH Consulting Services:
> consulting at freeswitch.org
> http://www.freeswitchsolutions.com
>
>
>
>
> Official FreeSWITCH Sites
> http://www.freeswitch.org
> http://wiki.freeswitch.org
> http://www.cluecon.com
>
> FreeSWITCH-users mailing list
> FreeSWITCH-users at lists.freeswitch.org
> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
> http://www.freeswitch.org
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.freeswitch.org/pipermail/freeswitch-users/attachments/20120327/28cc6cec/attachment-0001.html
Join us at ClueCon 2011 Aug 9-11, 2011
More information about the FreeSWITCH-users
mailing list