<div dir="ltr"><p style="font-size:12.8000001907349px">Hi Giovanni</p><p dir="ltr" style="font-size:12.8000001907349px">1) Usb dongles goes to 20ms, and skype too (I wrote it :) ).</p><span style="font-size:12.8000001907349px">I would be pretty sure TDM too.</span><div><br></div><div>I has virtualized Digium card and has flowing result<br></div><div><div>[root@localhost tools]# lspci -k | tail -n 11</div><div>03:00.0 Serial Attached SCSI controller: VMware PVSCSI SCSI Controller (rev 02)</div><div> Subsystem: VMware PVSCSI SCSI Controller</div><div> Kernel driver in use: vmw_pvscsi</div><div>0b:00.0 Ethernet controller: VMware VMXNET3 Ethernet Controller (rev 01)</div><div> Subsystem: VMware VMXNET3 Ethernet Controller</div><div> Kernel driver in use: vmxnet3</div><div>13:00.0 Ethernet controller: VMware VMXNET3 Ethernet Controller (rev 01)</div><div> Subsystem: VMware VMXNET3 Ethernet Controller</div><div> Kernel driver in use: vmxnet3</div><div>1b:00.0 Network controller: Digium, Inc. Wildcard TE133 single-span T1/E1/J1 card (PCI Express) (rev 02)</div><div> Kernel driver in use: wcte13xp</div><div>[root@localhost tools]#</div></div><div><br></div><div><div>[root@localhost ~]# /usr/sbin/dahdi_scan</div><div>[1]</div><div>active=yes</div><div>alarms=OK</div><div>description=Wildcard TE131/TE133 Card 0</div><div>name=WCT13x/0</div><div>manufacturer=Digium</div><div>devicetype=Wildcard TE131/TE133 (VPMOCT032)</div><div>location=PCI Bus 27 Slot 01</div><div>basechan=1</div><div>totchans=31</div><div>irq=0</div><div>type=digital-E1</div><div>syncsrc=1</div><div>lbo=0 db (CSU)/0-133 feet (DSX-1)</div><div>coding_opts=AMI,HDB3</div><div>framing_opts=CCS,CRC4</div><div>coding=HDB3</div><div>framing=CCS/CRC4</div></div><div><br></div><div><div>[root@localhost tools]# /tmp/dahdi-linux-complete-2.10.1+2.10.1/tools/timertest</div><div>Opened timer...</div><div>Set timer duration to 8000 samples (1000 ms)</div><div>Waiting...</div><div>Timer Expired (1000 ms)!</div><div>Timer Expired (2000 ms)!</div><div>Timer Expired (3000 ms)!</div><div>Timer Expired (4000 ms)!</div><div>Timer Expired (5000 ms)!</div></div><div><br></div><div><div>[root@localhost rt-tests]# ./cyclictest -t1 -p 80 -d 0 -n -i 125 -l 240000 -q</div><div># /dev/cpu_dma_latency set to 0us</div><div>T: 0 ( 1469) P:80 I:125 C: 240000 Min: 3 Act: 22 Avg: 22 Max: 965</div></div><div><br></div><div><br></div><div><span style="font-size:12.8000001907349px">2) Not all of those threads will wake up at same time... You probably have very little threads active with 50 calls, lets say less than 5 if you dont transcode</span><br><div>My test VM has two cores and only two cyclictest threads may run simultaneously. Other treads is seeping like FS treads. ;o)</div><div><br></div><div><br></div></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Apr 8, 2015 at 7:43 PM, Giovanni Maruzzelli <span dir="ltr"><<a href="mailto:gmaruzz@gmail.com" target="_blank">gmaruzz@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><p dir="ltr"></p>
<p dir="ltr"><span class="">sent from my mobile,<br>
Giovanni Maruzzelli<br>
cell: +39 347 266 56 18<br></span><span class="">
On Apr 8, 2015 2:26 PM, "Sergey Safarov" <<a href="mailto:s.safarov@gmail.com" target="_blank">s.safarov@gmail.com</a>> wrote:<br>
><br>
> 1) 125uS is the interval between FrameSync of ONE(!) PCM sample at 8000hz,<br>
> But here we are talking about packet telephony where commonly used frame length is 20000 uS.<br>
> So, intervals for testing should be 5000-10000-20000uS, not 125uS.<br>
><br>
> Not all FS installation has SIP endpoint. Some can have TDM cards, USB dongle and other analog equipment. Can you say what is length of this frame type?</span></p>
<p dir="ltr">Usb dongles goes to 20ms, and skype too (I wrote it :) ).</p>
<p dir="ltr">I would be pretty sure TDM too.</p><span class="">
<p dir="ltr">> I am wondering about this question. I know that the frame 125ms is enough.<br>
><br>
> 2) Why you decided that all of 42 threads should wake up simultaneously?<br>
> That totally impossible in real world applications.<br>
> Here should be tens of uS. Dependent of network card and, possibly, other I/O hardware.<br>
><br>
> Can you say how many FS create threads for 40-50 active calls?</p>
</span><p dir="ltr">Not all of those threads will wake up at same time... You probably have very little threads active with 50 calls, lets say less than 5 if you dont transcode</p><span class="">
<p dir="ltr">><br>
> 3) -q switch is missing<br>
> I am thinking it is optional. Result is same<br>
><br>
> 4) Precise time measurement and realtime processing in VM environment is a challenge. <br>
> To obtain acceptable results fine tuning of host's and guest's required.<br>
> WIthout that this numbers ... does not mean anything.<br>
><br>
> Can you learn me how to correctly measure timer source quality in VM?</p>
</span><p dir="ltr">I would say its by definition variable and impredictable, and depends on what else other VMs are doing millisecond by millisecond, and their interaction.<br>
I would test the application, and if percwived quality is not satisfying, just throw more resources at it.</p><div class="HOEnZb"><div class="h5">
<p dir="ltr">><br>
> Sergey<br>
><br>
><br>
> On Wed, Apr 8, 2015 at 2:07 PM, Dmitry Lysenko <<a href="mailto:dvl36.ripe.nick@gmail.com" target="_blank">dvl36.ripe.nick@gmail.com</a>> wrote:<br>
>><br>
>> 2015-04-07 10:48 GMT+03:00 Sergey Safarov <<a href="mailto:s.safarov@gmail.com" target="_blank">s.safarov@gmail.com</a>>:<br>
>>><br>
>>> ...<br>
>>> 2) i 125 - time us between software timer interrupts for first thread. It time is equal time between samples rate in PSTN networks<br>
>>> In order to maintain our sampling rate we have 125 microseconds (uS) between consecutive samples (1/8,000Hz), which is more<br>
>>><br>
>>> ...<br>
>><br>
>><br>
>> 125uS is the interval between FrameSync of ONE(!) PCM sample at 8000hz,<br>
>> But here we are talking about packet telephony where commonly used frame length is 20000 uS.<br>
>> So, intervals for testing should be 5000-10000-20000uS, not 125uS.<br>
>> <br>
>>><br>
>>> 3) d 0 - this switch will make time between software timer interrupts for second and following threads is equal timer value for first thread<br>
>><br>
>><br>
>> Why you decided that all of 42 threads should wake up simultaneously?<br>
>> That totally impossible in real world applications.<br>
>> Here should be tens of uS. Dependent of network card and, possibly, other I/O hardware. <br>
>> <br>
>>><br>
>>> 4) l 240000 - how many timer test must be made. It is adjusted for 30 s overall test<br>
>>> 5) n - use clock_nanosleep. it is allow take more accurate timer test values on my VM<br>
>>> 6) p 80 - it is copied from example on Cyclictest page<br>
>><br>
>><br>
>> -q switch is missing.<br>
>> <br>
>>><br>
>>> And how in your opinion this numbers are related to Freeswitch in VM environment?<br>
>>> Relation between Cyclictest switches and FS described above.<br>
>>> Relation betwen Cyclictest results and FS simple<br>
>><br>
>><br>
>> Precise time measurement and realtime processing in VM environment is a challenge. <br>
>> To obtain acceptable results fine tuning of host's and guest's required.<br>
>> WIthout that this numbers ... does not mean anything.<br>
>> <br>
>><br>
>>> On Tue, Apr 7, 2015 at 5:38 AM, Dmitry Lysenko <<a href="mailto:dvl36.ripe.nick@gmail.com" target="_blank">dvl36.ripe.nick@gmail.com</a>> wrote:<br>
>>>><br>
>>>> Sergey,<br>
>>>> Why you suggest to use exactly this numbers in cyclictest's switches?<br>
>>>> And how in your opinion this numbers are related to Freeswitch in VM environment?<br>
>>>><br>
>>>> P.S. <a href="https://mindlinux.wordpress.com/2013/10/25/using-and-understanding-the-real-time-cyclictest-benchmark-frank-rowand-sony/" target="_blank">https://mindlinux.wordpress.com/2013/10/25/using-and-understanding-the-real-time-cyclictest-benchmark-frank-rowand-sony/</a><br>
>>>><br>
>>>> 2015-04-06 15:27 GMT+03:00 Sergey Safarov <<a href="mailto:s.safarov@gmail.com" target="_blank">s.safarov@gmail.com</a>>:<br>
>>>>><br>
>>>>> Errol can you test VM timer with utility <a href="https://rt.wiki.kernel.org/index.php/Cyclictest" target="_blank">https://rt.wiki.kernel.org/index.php/Cyclictest</a><br>
>>>>><br>
>>>>> My VM currently have folowing results<br>
>>>>><br>
>>>>> [root@fs1 ~]# date && /tmp/rt-tests/cyclictest -t42 -p 80 -d 0 -n -i 125 -l 240000 && date<br>
>>>>> Sun Apr 5 07:01:31 GMT 2015<br>
>>>>> # /dev/cpu_dma_latency set to 0us<br>
>>>>> policy: fifo: loadavg: 2.38 0.93 0.50 1/194 1574 <br>
>>>>><br>
>>>>> T: 0 ( 1531) P:80 I:125 C: 240000 Min: 2 Act: 12 Avg: 16 Max: 1302<br>
>>>>> T: 1 ( 1532) P:80 I:125 C: 240000 Min: 2 Act: 15 Avg: 14 Max: 2895<br>
>>>>> T: 2 ( 1533) P:80 I:125 C: 240000 Min: 3 Act: 10 Avg: 12 Max: 2888<br>
>>>>> T: 3 ( 1534) P:80 I:125 C: 240000 Min: 1 Act: 16 Avg: 13 Max: 1333<br>
>>>>> T: 4 ( 1535) P:80 I:125 C: 240000 Min: 2 Act: 20 Avg: 14 Max: 2962<br>
>>>>> T: 5 ( 1536) P:80 I:125 C: 240000 Min: 1 Act: 12 Avg: 14 Max: 2946<br>
>>>>> T: 6 ( 1537) P:80 I:125 C: 240000 Min: 2 Act: 10 Avg: 13 Max: 1363<br>
>>>>> T: 7 ( 1538) P:80 I:125 C: 240000 Min: 2 Act: 12 Avg: 13 Max: 1344<br>
>>>>> T: 8 ( 1539) P:80 I:125 C: 240000 Min: 3 Act: 12 Avg: 16 Max: 1408<br>
>>>>> T: 9 ( 1540) P:80 I:125 C: 240000 Min: 1 Act: 8 Avg: 13 Max: 2882<br>
>>>>> T:10 ( 1541) P:80 I:125 C: 239974 Min: 2 Act: 12 Avg: 13 Max: 2908<br>
>>>>><br>
>>>>><br>
>>>>> On Mon, Apr 6, 2015 at 11:15 AM, Errol Samuels <<a href="mailto:ewsamuels@gmail.com" target="_blank">ewsamuels@gmail.com</a>> wrote:<br>
>>>>>><br>
>>>>>> Good job and Thanks for sharing!<br>
>>>>>><br>
>>>>>>> KVM at <a href="http://digitalocean.com" target="_blank">digitalocean.com</a>, Debian 7 64bit, FreeSWITCH 1.4.15: bad precision<br>
>>>>>><br>
>>>>>> <br>
>>>>>> As someone who has been using KVM for a few years and has just migrated about 20 VMs across to Digital Ocean about 6 weeks ago I admit I am a little concerned about this finding.<br>
>>>>>><br>
>>>>>> Just out of curiosity can you tell me the specs of the VM that you tested with and which DO Datacenter? I am using NYC3 so perhaps and I will do some tests as soon as I have some time.<br>
>>>>>><br>
>>>>>> With regards to Xen was this at Linode or inhouse?<br>
>>>>>><br>
>>>>>> Thanks<br>
>>>>>><br>
>>>>>> Errol<br>
>>>>>><br>
>>>>>><br>
>>>>>><br>
>>>>>> On Sun, Apr 5, 2015 at 1:37 AM, Stanislav Sinyagin <<a href="mailto:ssinyagin@gmail.com" target="_blank">ssinyagin@gmail.com</a>> wrote:<br>
>>>>>>><br>
>>>>>>> here we go:<br>
>>>>>>> <a href="https://txlab.wordpress.com/2015/04/05/testing-rtp-clock-precision-on-a-virtual-machine/" target="_blank">https://txlab.wordpress.com/2015/04/05/testing-rtp-clock-precision-on-a-virtual-machine/</a><br>
>>>>>>><br>
>>>>>>><br>
>>>>>>><br>
>>>>>>> On Sat, Apr 4, 2015 at 4:26 PM, Stanislav Sinyagin <<a href="mailto:ssinyagin@gmail.com" target="_blank">ssinyagin@gmail.com</a>> wrote:<br>
>>>>>>> > On Sat, Apr 4, 2015 at 1:03 PM, Regis M <<a href="mailto:regis.freeswitch.org@tornad.net" target="_blank">regis.freeswitch.org@tornad.net</a>> wrote:<br>
>>>>>>> >> How do you check wavs together in audacity ?<br>
>>>>>>> ><br>
>>>>>>> > you just open two WAV files, align their starting position, and<br>
>>>>>>> > visually check the waves. If there's a problem, you would see that<br>
>>>>>>> > after few seconds, the waves are not aligned any more.<br>
>>>>>>> ><br>
>>>>>>> >> Can you send me 2 samples wav (send... and recorded) so I could see the 20ms<br>
>>>>>>> >> diff that you exposed...<br>
>>>>>>> >><br>
>>>>>>> >> Is there a way to automate the result checking, so it could help to monitor<br>
>>>>>>> >> itsp quality<br>
>>>>>>> ><br>
>>>>>>> > Here<br>
>>>>>>> > <a href="https://github.com/openpreserve/scape-xcorrsound/issues/17" target="_blank">https://github.com/openpreserve/scape-xcorrsound/issues/17</a><br>
>>>>>>> > this is a link to a tool which compares two sound files at the wave<br>
>>>>>>> > level. You can also see the sound samples in the ticket.<br>
>>>>>>> > The problem is, that currently this tool does not detect such slipping frames.<br>
>>>>>>> ><br>
>>>>>>> > I will also write a detailed article with examples, during the weekend.<br>
>>>>>>> ><br>
>>>>>>> ><br>
>>>>>>> ><br>
>>>>>>> ><br>
>>>>>>> ><br>
>>>>>>> >><br>
>>>>>>> >><br>
>>>>>>> >> 2015-04-04 12:53 GMT+02:00 Stanislav Sinyagin <<a href="mailto:ssinyagin@gmail.com" target="_blank">ssinyagin@gmail.com</a>>:<br>
>>>>>>> >>><br>
>>>>>>> >>> Important is to send the media through two independent carriers - then you<br>
>>>>>>> >>> can be sure that your clock is compared against a high quality one.<br>
>>>>>>> >>><br>
>>>>>>> >>> On Apr 4, 2015 12:46 PM, "Regis M" <<a href="mailto:regis.freeswitch.org@tornad.net" target="_blank">regis.freeswitch.org@tornad.net</a>><br>
>>>>>>> >>> wrote:<br>
>>>>>>> >>>><br>
>>>>>>> >>>> Hi,<br>
>>>>>>> >>>><br>
>>>>>>> >>>> It's a very interresting test and conclusion.<br>
>>>>>>> >>>><br>
>>>>>>> >>>> I will try to build a similar environnement on my freeswitch to check<br>
>>>>>>> >>>> some system :)<br>
>>>>>>> >>>><br>
>>>>>>> >>>> thanks<br>
>>>>>>> >>>><br>
>>>>>>> >>>><br>
>>>>>>> >>>><br>
>>>>>>> >>>> 2015-04-04 2:16 GMT+02:00 Stanislav Sinyagin <<a href="mailto:ssinyagin@gmail.com" target="_blank">ssinyagin@gmail.com</a>>:<br>
>>>>>>> >>>>><br>
>>>>>>> >>>>> hi,<br>
>>>>>>> >>>>><br>
>>>>>>> >>>>> Here are some test results which might be interesting:<br>
>>>>>>> >>>>><br>
>>>>>>> >>>>> I've set up a test FreeSWITCH server at digitalocean (they use KVM),<br>
>>>>>>> >>>>> and originated test calls to some ITSP accounts. Each call played a<br>
>>>>>>> >>>>> test sound file (voice samples from ITU:<br>
>>>>>>> >>>>> <a href="http://www.itu.int/net/itu-t/sigdb/genaudio/AudioForm-g.aspx?val=1000050" target="_blank">http://www.itu.int/net/itu-t/sigdb/genaudio/AudioForm-g.aspx?val=1000050</a><br>
>>>>>>> >>>>> ), and on the receiving end another FreeSWITCH server was recording<br>
>>>>>>> >>>>> the received session. The receiving server was on a XEN VM. Both<br>
>>>>>>> >>>>> servers talked G711 to their corresponding ITSP accounts.<br>
>>>>>>> >>>>><br>
>>>>>>> >>>>> Then I compared the source audio and received audio in Audacity editor.<br>
>>>>>>> >>>>><br>
>>>>>>> >>>>> The tests showed that the received voice wave shifts 20ms from the<br>
>>>>>>> >>>>> original sound every few seconds, randomly back and forward. This<br>
>>>>>>> >>>>> skewing was always present, regardless of ITSP and time of day.<br>
>>>>>>> >>>>><br>
>>>>>>> >>>>> Then I moved the sending server to a XEN VM, and the waves appeared<br>
>>>>>>> >>>>> almost perfectly synchronized (there was a 5ms skew in one test, and I<br>
>>>>>>> >>>>> guess it's related to transcoding buffer, as the sound was obviously<br>
>>>>>>> >>>>> transcoded).<br>
>>>>>>> >>>>><br>
>>>>>>> >>>>> The effect was always visible with a 30-second sample, and I also made<br>
>>>>>>> >>>>> additional tests with 2-minute samples.<br>
>>>>>>> >>>>><br>
>>>>>>> >>>>> It would also be interesting to test this from a VmWare VM. If someone<br>
>>>>>>> >>>>> wants to run such a test, feel free to contact me directly.<br>
>>>>>>> >>>>><br>
>>>>>>> >>>>><br>
>>>>>>> >>>>> cheers,<br>
>>>>>>> >>>>> stan<br>
>>>>>>> >>>>><br>
>>>>>>> >>>>><br>
>>>>>>> >>>>> _________________________________________________________________________<br>
>>>>>>> >>>>> Professional FreeSWITCH Consulting Services:<br>
>>>>>>> >>>>> <a href="mailto:consulting@freeswitch.org" target="_blank">consulting@freeswitch.org</a><br>
>>>>>>> >>>>> <a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><br>
>>>>>>> >>>>><br>
>>>>>>> >>>>> Official FreeSWITCH Sites<br>
>>>>>>> >>>>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>>>>>>> >>>>> <a href="http://confluence.freeswitch.org" target="_blank">http://confluence.freeswitch.org</a><br>
>>>>>>> >>>>> <a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><br>
>>>>>>> >>>>><br>
>>>>>>> >>>>> FreeSWITCH-users mailing list<br>
>>>>>>> >>>>> <a href="mailto:FreeSWITCH-users@lists.freeswitch.org" target="_blank">FreeSWITCH-users@lists.freeswitch.org</a><br>
>>>>>>> >>>>> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
>>>>>>> >>>>> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
>>>>>>> >>>>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>>>>>>> >>>><br>
>>>>>>> >>>><br>
>>>>>>> >>>><br>
>>>>>>> >>>> _________________________________________________________________________<br>
>>>>>>> >>>> Professional FreeSWITCH Consulting Services:<br>
>>>>>>> >>>> <a href="mailto:consulting@freeswitch.org" target="_blank">consulting@freeswitch.org</a><br>
>>>>>>> >>>> <a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><br>
>>>>>>> >>>><br>
>>>>>>> >>>> Official FreeSWITCH Sites<br>
>>>>>>> >>>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>>>>>>> >>>> <a href="http://confluence.freeswitch.org" target="_blank">http://confluence.freeswitch.org</a><br>
>>>>>>> >>>> <a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><br>
>>>>>>> >>>><br>
>>>>>>> >>>> FreeSWITCH-users mailing list<br>
>>>>>>> >>>> <a href="mailto:FreeSWITCH-users@lists.freeswitch.org" target="_blank">FreeSWITCH-users@lists.freeswitch.org</a><br>
>>>>>>> >>>> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
>>>>>>> >>>> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
>>>>>>> >>>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>>>>>>> >>><br>
>>>>>>> >>><br>
>>>>>>> >>> _________________________________________________________________________<br>
>>>>>>> >>> Professional FreeSWITCH Consulting Services:<br>
>>>>>>> >>> <a href="mailto:consulting@freeswitch.org" target="_blank">consulting@freeswitch.org</a><br>
>>>>>>> >>> <a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><br>
>>>>>>> >>><br>
>>>>>>> >>> Official FreeSWITCH Sites<br>
>>>>>>> >>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>>>>>>> >>> <a href="http://confluence.freeswitch.org" target="_blank">http://confluence.freeswitch.org</a><br>
>>>>>>> >>> <a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><br>
>>>>>>> >>><br>
>>>>>>> >>> FreeSWITCH-users mailing list<br>
>>>>>>> >>> <a href="mailto:FreeSWITCH-users@lists.freeswitch.org" target="_blank">FreeSWITCH-users@lists.freeswitch.org</a><br>
>>>>>>> >>> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
>>>>>>> >>> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
>>>>>>> >>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>>>>>>> >><br>
>>>>>>> >><br>
>>>>>>> >><br>
>>>>>>> >> _________________________________________________________________________<br>
>>>>>>> >> Professional FreeSWITCH Consulting Services:<br>
>>>>>>> >> <a href="mailto:consulting@freeswitch.org" target="_blank">consulting@freeswitch.org</a><br>
>>>>>>> >> <a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><br>
>>>>>>> >><br>
>>>>>>> >> Official FreeSWITCH Sites<br>
>>>>>>> >> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>>>>>>> >> <a href="http://confluence.freeswitch.org" target="_blank">http://confluence.freeswitch.org</a><br>
>>>>>>> >> <a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><br>
>>>>>>> >><br>
>>>>>>> >> FreeSWITCH-users mailing list<br>
>>>>>>> >> <a href="mailto:FreeSWITCH-users@lists.freeswitch.org" target="_blank">FreeSWITCH-users@lists.freeswitch.org</a><br>
>>>>>>> >> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
>>>>>>> >> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
>>>>>>> >> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>>>>>>><br>
>>>>>>> _________________________________________________________________________<br>
>>>>>>> Professional FreeSWITCH Consulting Services:<br>
>>>>>>> <a href="mailto:consulting@freeswitch.org" target="_blank">consulting@freeswitch.org</a><br>
>>>>>>> <a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><br>
>>>>>>><br>
>>>>>>> Official FreeSWITCH Sites<br>
>>>>>>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>>>>>>> <a href="http://confluence.freeswitch.org" target="_blank">http://confluence.freeswitch.org</a><br>
>>>>>>> <a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><br>
>>>>>>><br>
>>>>>>> FreeSWITCH-users mailing list<br>
>>>>>>> <a href="mailto:FreeSWITCH-users@lists.freeswitch.org" target="_blank">FreeSWITCH-users@lists.freeswitch.org</a><br>
>>>>>>> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
>>>>>>> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
>>>>>>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>>>>>><br>
>>>>>><br>
>>>>>><br>
>>>>>> _________________________________________________________________________<br>
>>>>>> Professional FreeSWITCH Consulting Services:<br>
>>>>>> <a href="mailto:consulting@freeswitch.org" target="_blank">consulting@freeswitch.org</a><br>
>>>>>> <a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><br>
>>>>>><br>
>>>>>> Official FreeSWITCH Sites<br>
>>>>>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>>>>>> <a href="http://confluence.freeswitch.org" target="_blank">http://confluence.freeswitch.org</a><br>
>>>>>> <a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><br>
>>>>>><br>
>>>>>> FreeSWITCH-users mailing list<br>
>>>>>> <a href="mailto:FreeSWITCH-users@lists.freeswitch.org" target="_blank">FreeSWITCH-users@lists.freeswitch.org</a><br>
>>>>>> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
>>>>>> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
>>>>>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>>>>><br>
>>>>><br>
>>>>><br>
>>>>> _________________________________________________________________________<br>
>>>>> Professional FreeSWITCH Consulting Services:<br>
>>>>> <a href="mailto:consulting@freeswitch.org" target="_blank">consulting@freeswitch.org</a><br>
>>>>> <a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><br>
>>>>><br>
>>>>> Official FreeSWITCH Sites<br>
>>>>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>>>>> <a href="http://confluence.freeswitch.org" target="_blank">http://confluence.freeswitch.org</a><br>
>>>>> <a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><br>
>>>>><br>
>>>>> FreeSWITCH-users mailing list<br>
>>>>> <a href="mailto:FreeSWITCH-users@lists.freeswitch.org" target="_blank">FreeSWITCH-users@lists.freeswitch.org</a><br>
>>>>> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
>>>>> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
>>>>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>>>><br>
>>>><br>
>>>><br>
>>>> _________________________________________________________________________<br>
>>>> Professional FreeSWITCH Consulting Services:<br>
>>>> <a href="mailto:consulting@freeswitch.org" target="_blank">consulting@freeswitch.org</a><br>
>>>> <a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><br>
>>>><br>
>>>> Official FreeSWITCH Sites<br>
>>>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>>>> <a href="http://confluence.freeswitch.org" target="_blank">http://confluence.freeswitch.org</a><br>
>>>> <a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><br>
>>>><br>
>>>> FreeSWITCH-users mailing list<br>
>>>> <a href="mailto:FreeSWITCH-users@lists.freeswitch.org" target="_blank">FreeSWITCH-users@lists.freeswitch.org</a><br>
>>>> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
>>>> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
>>>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>>><br>
>>><br>
>>><br>
>>> _________________________________________________________________________<br>
>>> Professional FreeSWITCH Consulting Services:<br>
>>> <a href="mailto:consulting@freeswitch.org" target="_blank">consulting@freeswitch.org</a><br>
>>> <a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><br>
>>><br>
>>> Official FreeSWITCH Sites<br>
>>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>>> <a href="http://confluence.freeswitch.org" target="_blank">http://confluence.freeswitch.org</a><br>
>>> <a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><br>
>>><br>
>>> FreeSWITCH-users mailing list<br>
>>> <a href="mailto:FreeSWITCH-users@lists.freeswitch.org" target="_blank">FreeSWITCH-users@lists.freeswitch.org</a><br>
>>> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
>>> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
>>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>><br>
>><br>
>><br>
>> _________________________________________________________________________<br>
>> Professional FreeSWITCH Consulting Services:<br>
>> <a href="mailto:consulting@freeswitch.org" target="_blank">consulting@freeswitch.org</a><br>
>> <a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><br>
>><br>
>> Official FreeSWITCH Sites<br>
>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>> <a href="http://confluence.freeswitch.org" target="_blank">http://confluence.freeswitch.org</a><br>
>> <a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><br>
>><br>
>> FreeSWITCH-users mailing list<br>
>> <a href="mailto:FreeSWITCH-users@lists.freeswitch.org" target="_blank">FreeSWITCH-users@lists.freeswitch.org</a><br>
>> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
>> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
><br>
><br>
><br>
> _________________________________________________________________________<br>
> Professional FreeSWITCH Consulting Services:<br>
> <a href="mailto:consulting@freeswitch.org" target="_blank">consulting@freeswitch.org</a><br>
> <a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><br>
><br>
> Official FreeSWITCH Sites<br>
> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
> <a href="http://confluence.freeswitch.org" target="_blank">http://confluence.freeswitch.org</a><br>
> <a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><br>
><br>
> FreeSWITCH-users mailing list<br>
> <a href="mailto:FreeSWITCH-users@lists.freeswitch.org" target="_blank">FreeSWITCH-users@lists.freeswitch.org</a><br>
> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
</p>
</div></div><br>_________________________________________________________________________<br>
Professional FreeSWITCH Consulting Services:<br>
<a href="mailto:consulting@freeswitch.org">consulting@freeswitch.org</a><br>
<a href="http://www.freeswitchsolutions.com" target="_blank">http://www.freeswitchsolutions.com</a><br>
<br>
Official FreeSWITCH Sites<br>
<a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
<a href="http://confluence.freeswitch.org" target="_blank">http://confluence.freeswitch.org</a><br>
<a href="http://www.cluecon.com" target="_blank">http://www.cluecon.com</a><br>
<br>
FreeSWITCH-users mailing list<br>
<a href="mailto:FreeSWITCH-users@lists.freeswitch.org">FreeSWITCH-users@lists.freeswitch.org</a><br>
<a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
<a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br></blockquote></div><br></div>