if you want to use ubuntu, be sure to use hardy and not intrepid.<br><br><div class="gmail_quote">On Mon, Feb 2, 2009 at 7:03 AM, Saeed Ahmed <span dir="ltr"><<a href="mailto:saeedahmad1981@gmail.com">saeedahmad1981@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">Thanks rod for a quick answer,<br>
<br>
FS is installed on Ubuntu Server.<br>
<br>
I am planning to replace Nextone SBC with FS, Later I'll also use openZAP to<br>
communicate with TDM but this all depends how much calls it can take, or<br>
maybe we can also do something in clustering environment ( I am not sure<br>
about it). But thanks again and any further help will be highly appreciated.<br>
<br>
<br>
Kind Regards<br>
<font color="#888888">Saeed Ahmed Tariq<br>
</font><div class="Ih2E3d"><br>
<br>
<br>
-----Original Message-----<br>
From: <a href="mailto:freeswitch-users-bounces@lists.freeswitch.org">freeswitch-users-bounces@lists.freeswitch.org</a><br>
[mailto:<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org">freeswitch-users-bounces@lists.freeswitch.org</a>] On Behalf Of rod<br>
</div><div><div></div><div class="Wj3C7c">Sent: Monday, February 02, 2009 1:53 PM<br>
To: <a href="mailto:freeswitch-users@lists.freeswitch.org">freeswitch-users@lists.freeswitch.org</a><br>
Subject: Re: [Freeswitch-users] Strange Performance when using as SBC<br>
<br>
Hi Saeed,<br>
<br>
I just created an account to share my setup on the wiki. I will detail<br>
all the steps for a clean install of a debian64 lenny with FS used as a<br>
SBC (next step is to try the new LCR module :) )and what I'm doing do<br>
stress the server.<br>
<br>
I wrote nothing at this time so please be patient, I'm waiting for my<br>
new hardware so that I will detail as much as possible what I'll do.<br>
<br>
For beginning I suggest you reading the start page on the wiki,<br>
especially these pages:<br>
-<a href="http://wiki.freeswitch.org/wiki/Getting_Started_Guide" target="_blank">http://wiki.freeswitch.org/wiki/Getting_Started_Guide</a><br>
-<a href="http://wiki.freeswitch.org/wiki/Dialplan_XML" target="_blank">http://wiki.freeswitch.org/wiki/Dialplan_XML</a><br>
<br>
maybe you could tell more about the linux distribution you're using so<br>
that I can give you some pointers for sipp...<br>
<br>
regards.<br>
rod.<br>
<br>
<br>
Saeed Ahmed wrote:<br>
> Hi Rod,<br>
><br>
> Could you please share how you configured Sipp & FS to create a test<br>
> environment? Especially the dial plan, sofia settings etc..., actually I<br>
am<br>
> a newbie. I want to test it on a single FS machine.<br>
><br>
> Kind Regards<br>
> Saeed<br>
> -----Original Message-----<br>
> From: <a href="mailto:freeswitch-users-bounces@lists.freeswitch.org">freeswitch-users-bounces@lists.freeswitch.org</a><br>
> [mailto:<a href="mailto:freeswitch-users-bounces@lists.freeswitch.org">freeswitch-users-bounces@lists.freeswitch.org</a>] On Behalf Of rod<br>
> Sent: Monday, February 02, 2009 11:00 AM<br>
> To: <a href="mailto:freeswitch-users@lists.freeswitch.org">freeswitch-users@lists.freeswitch.org</a><br>
> Subject: Re: [Freeswitch-users] Strange Performance when using as SBC<br>
><br>
> Hi Ken, Jay,<br>
><br>
> thanks for pointing to proxy media, I will test.<br>
><br>
> Ken, you are right, I was brain damaged (a stupid mistake) when setting<br>
> INFO cause this kind of level could be very verbose. I'm switching to<br>
> CRIT or ERR.<br>
><br>
> Thanks guys,<br>
> rod.<br>
><br>
> thanks for<br>
><br>
> Ken Rice wrote:<br>
><br>
>> If you don't have to transcode, using proxy media mode will still save<br>
you<br>
>> some CPU time. This is 1/2 way between bypass media and the default media<br>
>> interactive mode. The other draw back to this mode is if you are using FS<br>
>><br>
> to<br>
><br>
>> clean up RTP and DTMF you loose those functions but they are not needed<br>
in<br>
>> most use cases.<br>
>><br>
>> As far as the log level goes, I found that once I had things stable<br>
>><br>
> setting<br>
><br>
>> the loglevel to helped a good deal... Info is probably a bit too high of<br>
a<br>
>> loglevel I would probably go for CRIT or ERR (2 or 1 respectively) if you<br>
>> insist on leaving logging turned on... On a busy system these can and<br>
will<br>
>> generate a good deal of activity (and disk IO if using mod_logfile)<br>
>><br>
>> Ken<br>
>><br>
>><br>
>><br>
>><br>
>>> From: rod <<a href="mailto:kawarod@laposte.net">kawarod@laposte.net</a>><br>
>>> Reply-To: <<a href="mailto:freeswitch-users@lists.freeswitch.org">freeswitch-users@lists.freeswitch.org</a>><br>
>>> Date: Mon, 02 Feb 2009 11:36:35 +0400<br>
>>> To: <<a href="mailto:freeswitch-users@lists.freeswitch.org">freeswitch-users@lists.freeswitch.org</a>><br>
>>> Subject: Re: [Freeswitch-users] Strange Performance when using as SBC<br>
>>><br>
>>> Hi Ken,<br>
>>><br>
>>> 1) I'd like to use FS to hide topology, so bypass media is not possible<br>
>>> 2) done<br>
>>> 3) done<br>
>>> 4) not used<br>
>>> 5) i'm using this ins switch.xml -> <param name="loglevel"<br>
>>> value="info"/>, if you think an other log level is more suitable.<br>
>>><br>
>>> Regarding logging, I can see in console and in the freeswitch.log that<br>
>>> there is still a lot of NOTICE logging, see below:<br>
>>> 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960<br>
>>> switch_core_session_thread() Session 8721<br>
>>> (sofia/internal/<a href="http://sipp@10.10.10.1:5060" target="_blank">sipp@10.10.10.1:5060</a>) Ended<br>
>>> 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962<br>
>>> switch_core_session_thread() Close Channel<br>
>>> sofia/internal/<a href="http://sipp@10.10.10.1:5060" target="_blank">sipp@10.10.10.1:5060</a> [CS_HANGUP]<br>
>>> 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:960<br>
>>> switch_core_session_thread() Session 8722<br>
>>> (sofia/external/<a href="mailto:9998@10.10.20.100">9998@10.10.20.100</a>) Ended<br>
>>> 2009-02-02 08:33:56 [NOTICE] switch_core_session.c:962<br>
>>> switch_core_session_thread() Close Channel<br>
>>> sofia/external/<a href="mailto:9998@10.10.20.100">9998@10.10.20.100</a> [CS_HANGUP]<br>
>>> 2009-02-02 08:33:56 [NOTICE] sofia.c:3164 sofia_handle_sip_i_state()<br>
>>> Channel [sofia/external/<a href="mailto:9998@10.10.20.100">9998@10.10.20.100</a>] has been answered<br>
>>> 2009-02-02 08:33:56 [WARNING] mod_sofia.c:740 sofia_read_frame()<br>
>>> Changing codec ptime to 30. I bet you have a linksys/sipura =D<br>
>>><br>
>>> Do you have any idea where I can switch off this kind of logging. I<br>
>>> thought it should be in /dialplan/internal.xml, but I see that in<br>
>>> internal.xml -> <param name="debug" value="0"/><br>
>>><br>
>>> thanks a lot for your suggestion.<br>
>>><br>
>>> regards,<br>
>>> rod<br>
>>><br>
>>> Ken Rice wrote:<br>
>>><br>
>>><br>
>>>> Dont forget there are several things you can do to increase<br>
>>>><br>
> performance...<br>
><br>
>>>> 1) where possible use bypass media or media proxy modes<br>
>>>> 2) mount freeswitch/db as a ram drive (if you are using voicemail with<br>
>>>> the internal FS DBs you'll need a way to make this persistant across<br>
>>>> reboots)<br>
>>>> 3) see the wiki for setting reasonable ulimits<br>
>>>> 4) (this is my oppinion others may vary) dont use mod_cdr_csv<br>
>>>> 5) turn off (or reduce logging) in switch.conf.xml<br>
>>>><br>
>>>> all of these thing can greatly improve performance.<br>
>>>><br>
>>>> On Mon, Feb 2, 2009 at 1:04 AM, rod <<a href="mailto:kawarod@laposte.net">kawarod@laposte.net</a><br>
>>>> <mailto:<a href="mailto:kawarod@laposte.net">kawarod@laposte.net</a>>> wrote:<br>
>>>><br>
>>>> Thanks Anthony,<br>
>>>><br>
>>>> the setup is like this:<br>
>>>><br>
>>>> sipp server ---- FS 1 ---- FS2<br>
>>>><br>
>>>> FS1 is the AMD CPU that has only one extension in dialplan that<br>
>>>> bridges<br>
>>>> 9999 to FS2. 9999 is the first extension in FS2 dialplan that<br>
>>>> plays moh,<br>
>>>> FS2 has no CPU pbm.<br>
>>>><br>
>>>> FS1 is maxing out at 60 bridged calls without your option -hp.<br>
>>>><br>
>>>> Using -hp, I'm now able to bridge 200 concurrent calls (a great<br>
>>>> improvement) and the system is still reactive. CPU load is high<br>
>>>> but not<br>
>>>> 100% and as the system responds well, I think that doesn't matter.<br>
>>>><br>
> The<br>
><br>
>>>> 2GB of memory are completely consumed (top command shows 700MB for<br>
>>>><br>
> FS<br>
><br>
>>>> process).<br>
>>>><br>
>>>> I understand that FS1 server is not the best hardware platform,<br>
>>>> and I'm<br>
>>>> waiting for new 4 cores server for testing.<br>
>>>> I will update those numbers when testing with the new hardware.<br>
>>>><br>
>>>> regards,<br>
>>>> rod.<br>
>>>><br>
>>>> Anthony Minessale wrote:<br>
>>>><br>
>>>><br>
>>>>> Which of the 2 machines has the load issue? You said it was one box<br>
>>>>> calling the other.<br>
>>>>><br>
>>>>> You have 2 major things against you, single CPU and AMD, but you<br>
>>>>> should at least be able to get in the vicinity of 800-1000 calls<br>
>>>>><br>
>>>>><br>
>>>> on a<br>
>>>><br>
>>>><br>
>>>>> box like that.<br>
>>>>><br>
>>>>> Are you calling the default 9999? It's not really an appropriate<br>
>>>>> extension for load testing.<br>
>>>>> On the terminating box you should set up a manual extension that is<br>
>>>>> the first one in the dial plan<br>
>>>>> to play a wav file from preferably a ram disk or /tmp<br>
>>>>><br>
>>>>> If you do plan on using this in production accept nothing less<br>
>>>>><br>
>>>>><br>
>>>> than a<br>
>>>><br>
>>>><br>
>>>>> multi-core intel machine with at least 4 cores, the more cores the<br>
>>>>> better because that parallel processing is where FS gets it's<br>
>>>>><br>
>>>>><br>
>>>> atvantage.<br>
>>>><br>
>>>><br>
>>>>> On Fri, Jan 30, 2009 at 5:56 AM, rod <<a href="mailto:kawarod@laposte.net">kawarod@laposte.net</a><br>
>>>>><br>
>>>>><br>
>>>> <mailto:<a href="mailto:kawarod@laposte.net">kawarod@laposte.net</a>><br>
>>>><br>
>>>><br>
>>>>> <mailto:<a href="mailto:kawarod@laposte.net">kawarod@laposte.net</a> <mailto:<a href="mailto:kawarod@laposte.net">kawarod@laposte.net</a>>>> wrote:<br>
>>>>><br>
>>>>> Dear list,<br>
>>>>><br>
>>>>> I've been playing with freeswitch for some time (2 months)<br>
>>>>><br>
>>>>><br>
>>>> and the<br>
>>>><br>
>>>><br>
>>>>> fact<br>
>>>>> is that I'm very pleased with the functionnalities of this<br>
>>>>><br>
>>>>><br>
>>>> software.<br>
>>>><br>
>>>><br>
>>>>> I'd like to use FS as a SBC handling media and I'm doing some<br>
>>>>> tests with<br>
>>>>> sipp to load the machine but I'm unable to bridge more than<br>
>>>>><br>
>>>>><br>
>>>> 60 calls<br>
>>>><br>
>>>><br>
>>>>> without seeing the CPU being loaded at 100%. I'm sure<br>
>>>>><br>
>>>>><br>
>>>> something is<br>
>>>><br>
>>>><br>
>>>>> going<br>
>>>>> wrong with my setup but I'm unable to see what.<br>
>>>>><br>
>>>>> The test machine has the following specs:<br>
>>>>> Athlon XP 3500+ with 2GB of memory (I know this is not a<br>
>>>>><br>
>>>>><br>
>>>> high end<br>
>>>><br>
>>>><br>
>>>>> machine :p)<br>
>>>>><br>
>>>>> Freeswitch:/opt/freeswitch/log# cat /proc/cpuinfo<br>
>>>>> processor : 0<br>
>>>>> vendor_id : AuthenticAMD<br>
>>>>> cpu family : 15<br>
>>>>> model : 95<br>
>>>>> model name : AMD Athlon(tm) 64 Processor 3500+<br>
>>>>> stepping : 2<br>
>>>>> cpu MHz : 2199.973<br>
>>>>> cache size : 512 KB<br>
>>>>> fpu : yes<br>
>>>>> fpu_exception : yes<br>
>>>>> cpuid level : 1<br>
>>>>> wp : yes<br>
>>>>> flags : fpu vme de pse tsc msr pae mce cx8 apic<br>
>>>>><br>
>>>>><br>
>>>> sep mtrr pge<br>
>>>><br>
>>>><br>
>>>>> mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext<br>
>>>>> fxsr_opt<br>
>>>>> rdtscp lm 3dnowext 3dnow up rep_good pni cx16 lahf_lm svm<br>
>>>>><br>
>>>>><br>
>>>> extapic<br>
>>>><br>
>>>><br>
>>>>> cr8_legacy<br>
>>>>> bogomips : 4402.97<br>
>>>>> TLB size : 1024 4K pages<br>
>>>>> clflush size : 64<br>
>>>>> cache_alignment : 64<br>
>>>>> address sizes : 40 bits physical, 48 bits virtual<br>
>>>>> power management: ts fid vid ttp tm stc<br>
>>>>><br>
>>>>> I installed FS on a fresh debian 64:<br>
>>>>> Linux Freeswitch 2.6.26-1-amd64 #1 SMP Sat Jan 10 17:57:00<br>
>>>>><br>
>>>>><br>
>>>> UTC 2009<br>
>>>><br>
>>>><br>
>>>>> x86_64 GNU/Linux<br>
>>>>><br>
>>>>> I set the ulimit parameters like those on the website:<br>
>>>>> freeswitch@internal> ...<br>
>>>>> Freeswitch:/opt/free-svn/bin# ulimit -a<br>
>>>>> core file size (blocks, -c) unlimited<br>
>>>>> data seg size (kbytes, -d) unlimited<br>
>>>>> scheduling priority (-e) 0<br>
>>>>> file size (blocks, -f) unlimited<br>
>>>>> pending signals (-i) unlimited<br>
>>>>> max locked memory (kbytes, -l) unlimited<br>
>>>>> max memory size (kbytes, -m) unlimited<br>
>>>>> open files (-n) 999999<br>
>>>>> pipe size (512 bytes, -p) 8<br>
>>>>> POSIX message queues (bytes, -q) unlimited<br>
>>>>> real-time priority (-r) 0<br>
>>>>> stack size (kbytes, -s) 244<br>
>>>>> cpu time (seconds, -t) unlimited<br>
>>>>> max user processes (-u) unlimited<br>
>>>>> virtual memory (kbytes, -v) unlimited<br>
>>>>> file locks (-x) unlimited<br>
>>>>><br>
>>>>><br>
>>>>> My network setup is the following:<br>
>>>>><br>
>>>>> SIPP machine (<a href="http://10.10.10.1/24%29----------------vlan" target="_blank">10.10.10.1/24)----------------vlan</a><br>
>>>>><br>
>>>>><br>
>>>> <<a href="http://10.10.10.1/24%29----------------vlan" target="_blank">http://10.10.10.1/24%29----------------vlan</a>><br>
>>>><br>
>>>><br>
>>>>> <<a href="http://10.10.10.1/24%29----------------vlan" target="_blank">http://10.10.10.1/24%29----------------vlan</a>> 55<br>
>>>>> ----------(<a href="http://10.10.10.254/24" target="_blank">10.10.10.254/24</a> <<a href="http://10.10.10.254/24" target="_blank">http://10.10.10.254/24</a>><br>
>>>>><br>
>>>>><br>
>>>> <<a href="http://10.10.10.254/24" target="_blank">http://10.10.10.254/24</a>>) FS<br>
>>>><br>
>>>><br>
>>>>> (<a href="http://10.10.20.254/24%29--------------" target="_blank">10.10.20.254/24)--------------</a><br>
>>>>><br>
>>>>><br>
>>>> <<a href="http://10.10.20.254/24%29--------------" target="_blank">http://10.10.20.254/24%29--------------</a>><br>
>>>><br>
>>>><br>
>>>>> <<a href="http://10.10.20.254/24%29--------------" target="_blank">http://10.10.20.254/24%29--------------</a>> vlan56<br>
>>>>> -------------------(<a href="http://10.10.20.100/24" target="_blank">10.10.20.100/24</a> <<a href="http://10.10.20.100/24" target="_blank">http://10.10.20.100/24</a>><br>
>>>>><br>
>>>>><br>
>>>> <<a href="http://10.10.20.100/24" target="_blank">http://10.10.20.100/24</a>>)<br>
>>>><br>
>>>><br>
>>>>> OTHER STOCK FS<br>
>>>>><br>
>>>>><br>
>>>>> I launched sipp with:<br>
>>>>> sipp -sn uac_pcap -s 9999 -r 10 -l 80 -d 60000 -mi<br>
>>>>><br>
>>>>><br>
>>>> 10.10.10.1 -i<br>
>>>><br>
>>>><br>
>>>>> 10.10.10.1 -mp 25000 <a href="http://10.10.10.254:5060" target="_blank">10.10.10.254:5060</a><br>
>>>>><br>
>>>>><br>
>>>> <<a href="http://10.10.10.254:5060" target="_blank">http://10.10.10.254:5060</a>> <<a href="http://10.10.10.254:5060" target="_blank">http://10.10.10.254:5060</a>><br>
>>>><br>
>>>><br>
>>>>> The dialplan on FS is very simple:<br>
>>>>> <?xml version="1.0" encoding="utf-8"?><br>
>>>>> <!-- <a href="http://wiki.freeswitch.org/wiki/Dialplan_XML" target="_blank">http://wiki.freeswitch.org/wiki/Dialplan_XML</a> --><br>
>>>>> <include><br>
>>>>> <context name="default"><br>
>>>>><br>
>>>>> <extension name="hold_music_bridge"><br>
>>>>> <condition field="destination_number" expression="^9999$"><br>
>>>>> <action application="answer"/><br>
>>>>> <action application="bridge"<br>
>>>>> data="sofia/external/<a href="mailto:9999@10.10.20.100">9999@10.10.20.100</a><br>
>>>>><br>
>>>>><br>
>>>> <mailto:<a href="mailto:9999@10.10.20.100">9999@10.10.20.100</a>> <mailto:<a href="mailto:9999@10.10.20.100">9999@10.10.20.100</a><br>
>>>> <mailto:<a href="mailto:9999@10.10.20.100">9999@10.10.20.100</a>>>"/><br>
>>>><br>
>>>><br>
>>>>> </condition><br>
>>>>> </extension><br>
>>>>> </context><br>
>>>>><br>
>>>>> </include><br>
>>>>><br>
>>>>> FreeSWITCH Version 1.0.trunk (11560M) Started.<br>
>>>>> Crash Protection [Disabled]<br>
>>>>> Max Sessions[1000]<br>
>>>>> Session Rate[100]<br>
>>>>> SQL [Enabled]<br>
>>>>><br>
>>>>><br>
>>>>> The test is very simple: sipp dial 9999 that matches in my<br>
>>>>><br>
>>>>><br>
>>>> FS dialplan<br>
>>>><br>
>>>><br>
>>>>> and this is bridged to an other FS machine playing music on<br>
>>>>><br>
>>>>><br>
>>>> hold.<br>
>>>><br>
>>>><br>
>>>>> When I launch "top" I see after 30 to 40 s that FS consumes all<br>
>>>>> the CPU<br>
>>>>> ressources (with a mean of 50-60 % before), with 80 calls.<br>
>>>>> When I set 70 calls, I have to wait 70-80 s before seeing<br>
>>>>><br>
>>>>><br>
>>>> the same<br>
>>>><br>
>>>><br>
>>>>> issue.<br>
>>>>><br>
>>>>> Presence is set to false on the 2 profile.<br>
>>>>><br>
>>>>> I have the same issue with FS 1.0.2 that' s why I tried FS<br>
>>>>><br>
>>>>><br>
>>>> 11560.<br>
>>>><br>
>>>><br>
>>>>> When I use the FS machine as a router to test the packet per<br>
>>>>><br>
>>>>><br>
>>>> second<br>
>>>><br>
>>>><br>
>>>>> performance, I'm reaching 100Mbps with 8000pps in each<br>
>>>>><br>
>>>>><br>
>>>> direction (from<br>
>>>><br>
>>>><br>
>>>>> vlan 55 to vlan56) with less than 12% CPU. So that I don't think<br>
>>>>> there's<br>
>>>>> an issue with the network.<br>
>>>>><br>
>>>>> Here is an "mpstat -P ALL 1" to show you what's happening<br>
>>>>><br>
>>>>><br>
>>>> suddenly<br>
>>>><br>
>>>><br>
>>>>> with<br>
>>>>> 70 bridge calls:<br>
>>>>> 12:31:26 CPU %user %nice %sys %iowait %irq %soft<br>
>>>>> %steal %idle intr/s<br>
>>>>> 12:31:27 all 3,00 0,00 3,00 0,00 1,00 4,00<br>
>>>>> 0,00 89,00 6241,00<br>
>>>>> 12:31:27 0 3,00 0,00 3,00 0,00 1,00 4,00<br>
>>>>> 0,00 89,00 6241,00<br>
>>>>><br>
>>>>> 12:31:27 CPU %user %nice %sys %iowait %irq %soft<br>
>>>>> %steal %idle intr/s<br>
>>>>> 12:31:28 all 14,14 0,00 56,57 0,00 2,02 5,05<br>
>>>>> 0,00 22,22 6035,35<br>
>>>>> 12:31:28 0 14,14 0,00 56,57 0,00 2,02 5,05<br>
>>>>> 0,00 22,22 6035,35<br>
>>>>><br>
>>>>> 12:31:28 CPU %user %nice %sys %iowait %irq %soft<br>
>>>>> %steal %idle intr/s<br>
>>>>> 12:31:29 all 24,75 0,00 67,33 0,00 0,99 6,93<br>
>>>>> 0,00 0,00 5483,17<br>
>>>>> 12:31:29 0 24,75 0,00 67,33 0,00 0,99 6,93<br>
>>>>> 0,00 0,00 5483,17<br>
>>>>><br>
>>>>><br>
>>>>> The CPU is going from 89% idle to 0% in less than 2 seconds.<br>
>>>>><br>
>>>>> I know that I don't have to expect too much from this kind of<br>
>>>>> hardware,<br>
>>>>> but it seems strange that the CPU power vanished so suddenly.<br>
>>>>><br>
>>>>> Thanks a lot for the guys that have read this long mail :p<br>
>>>>><br>
>>>>> kind regards,<br>
>>>>> rod<br>
>>>>><br>
>>>>><br>
>>>>> _______________________________________________<br>
>>>>> Freeswitch-users mailing list<br>
>>>>> <a href="mailto:Freeswitch-users@lists.freeswitch.org">Freeswitch-users@lists.freeswitch.org</a><br>
>>>>><br>
>>>>><br>
>>>> <mailto:<a href="mailto:Freeswitch-users@lists.freeswitch.org">Freeswitch-users@lists.freeswitch.org</a>><br>
>>>><br>
>>>><br>
>>>>> <mailto:<a href="mailto:Freeswitch-users@lists.freeswitch.org">Freeswitch-users@lists.freeswitch.org</a><br>
>>>>><br>
>>>>><br>
>>>> <mailto:<a href="mailto:Freeswitch-users@lists.freeswitch.org">Freeswitch-users@lists.freeswitch.org</a>>><br>
>>>><br>
>>>><br>
>>>>> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
>>>>><br>
>>>>><br>
>>>>><br>
> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
><br>
>>>><br>
>>>><br>
>>>>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>>>>><br>
>>>>><br>
>>>>><br>
>>>>><br>
>>>>> --<br>
>>>>> Anthony Minessale II<br>
>>>>><br>
>>>>> FreeSWITCH <a href="http://www.freeswitch.org/" target="_blank">http://www.freeswitch.org/</a><br>
>>>>> ClueCon <a href="http://www.cluecon.com/" target="_blank">http://www.cluecon.com/</a><br>
>>>>><br>
>>>>> AIM: anthm<br>
>>>>> <a href="mailto:MSN%3Aanthony_minessale@hotmail.com">MSN:anthony_minessale@hotmail.com</a><br>
>>>>><br>
>>>>><br>
>>>> <mailto:<a href="mailto:MSN%253Aanthony_minessale@hotmail.com">MSN%3Aanthony_minessale@hotmail.com</a>><br>
>>>><br>
>>>><br>
>>>>> <mailto:<a href="mailto:MSN%253Aanthony_minessale@hotmail.com">MSN%3Aanthony_minessale@hotmail.com</a><br>
>>>>><br>
>>>>><br>
>>>> <mailto:<a href="mailto:MSN%25253Aanthony_minessale@hotmail.com">MSN%253Aanthony_minessale@hotmail.com</a>>><br>
>>>><br>
>>>><br>
>>>>> GTALK/JABBER/<a href="mailto:PAYPAL%3Aanthony.minessale@gmail.com">PAYPAL:anthony.minessale@gmail.com</a><br>
>>>>><br>
>>>>><br>
>>>> <mailto:<a href="mailto:PAYPAL%253Aanthony.minessale@gmail.com">PAYPAL%3Aanthony.minessale@gmail.com</a>><br>
>>>><br>
>>>><br>
>>>>> <mailto:<a href="mailto:PAYPAL%253Aanthony.minessale@gmail.com">PAYPAL%3Aanthony.minessale@gmail.com</a><br>
>>>>><br>
>>>>><br>
>>>> <mailto:<a href="mailto:PAYPAL%25253Aanthony.minessale@gmail.com">PAYPAL%253Aanthony.minessale@gmail.com</a>>><br>
>>>><br>
>>>><br>
>>>>> IRC: <a href="http://irc.freenode.net" target="_blank">irc.freenode.net</a> <<a href="http://irc.freenode.net" target="_blank">http://irc.freenode.net</a>><br>
>>>>><br>
>>>>><br>
>>>> <<a href="http://irc.freenode.net" target="_blank">http://irc.freenode.net</a>> #freeswitch<br>
>>>><br>
>>>><br>
>>>>> FreeSWITCH Developer Conference<br>
>>>>> <a href="mailto:sip%3A888@conference.freeswitch.org">sip:888@conference.freeswitch.org</a><br>
>>>>><br>
>>>>><br>
>>>> <mailto:<a href="mailto:sip%253A888@conference.freeswitch.org">sip%3A888@conference.freeswitch.org</a>><br>
>>>><br>
>>>><br>
>>>>> <mailto:<a href="mailto:sip%253A888@conference.freeswitch.org">sip%3A888@conference.freeswitch.org</a><br>
>>>>><br>
>>>>><br>
>>>> <mailto:<a href="mailto:sip%25253A888@conference.freeswitch.org">sip%253A888@conference.freeswitch.org</a>>><br>
>>>><br>
>>>><br>
>>>>> <a href="http://iax:guest@conference.freeswitch.org/888" target="_blank">iax:guest@conference.freeswitch.org/888</a><br>
>>>>><br>
>>>>><br>
>>>> <<a href="http://iax:guest@conference.freeswitch.org/888" target="_blank">http://iax:guest@conference.freeswitch.org/888</a>><br>
>>>><br>
>>>><br>
>>>>> <<a href="http://iax:guest@conference.freeswitch.org/888" target="_blank">http://iax:guest@conference.freeswitch.org/888</a>><br>
>>>>> <a href="mailto:googletalk%3Aconf%2B888@conference.freeswitch.org">googletalk:conf+888@conference.freeswitch.org</a><br>
>>>>><br>
>>>>><br>
>>>> <mailto:<a href="mailto:googletalk%253Aconf%252B888@conference.freeswitch.org">googletalk%3Aconf%2B888@conference.freeswitch.org</a>><br>
>>>><br>
>>>><br>
>>>>> <mailto:<a href="mailto:googletalk%253Aconf%252B888@conference.freeswitch.org">googletalk%3Aconf%2B888@conference.freeswitch.org</a><br>
>>>>><br>
>>>>><br>
>>>> <mailto:<a href="mailto:googletalk%25253Aconf%25252B888@conference.freeswitch.org">googletalk%253Aconf%252B888@conference.freeswitch.org</a>>><br>
>>>><br>
>>>><br>
>>>>> pstn:213-799-1400<br>
>>>>><br>
>>>>><br>
>>>>><br>
> ------------------------------------------------------------------------<br>
><br>
>>>><br>
>>>><br>
>>>>> _______________________________________________<br>
>>>>> Freeswitch-users mailing list<br>
>>>>> <a href="mailto:Freeswitch-users@lists.freeswitch.org">Freeswitch-users@lists.freeswitch.org</a><br>
>>>>><br>
>>>>><br>
>>>> <mailto:<a href="mailto:Freeswitch-users@lists.freeswitch.org">Freeswitch-users@lists.freeswitch.org</a>><br>
>>>><br>
>>>><br>
>>>>> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
>>>>><br>
>>>>><br>
>>>>><br>
> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
><br>
>>>><br>
>>>><br>
>>>>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>>>>><br>
>>>>><br>
>>>>><br>
>>>> _______________________________________________<br>
>>>> Freeswitch-users mailing list<br>
>>>> <a href="mailto:Freeswitch-users@lists.freeswitch.org">Freeswitch-users@lists.freeswitch.org</a><br>
>>>> <mailto:<a href="mailto:Freeswitch-users@lists.freeswitch.org">Freeswitch-users@lists.freeswitch.org</a>><br>
>>>> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
>>>><br>
>>>><br>
> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
><br>
>>>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>>>><br>
>>>><br>
>>>><br>
------------------------------------------------------------------------<br>
>>>><br>
>>>> _______________________________________________<br>
>>>> Freeswitch-users mailing list<br>
>>>> <a href="mailto:Freeswitch-users@lists.freeswitch.org">Freeswitch-users@lists.freeswitch.org</a><br>
>>>> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
>>>><br>
UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
>>>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>>>><br>
>>>><br>
>>>><br>
>>> _______________________________________________<br>
>>> Freeswitch-users mailing list<br>
>>> <a href="mailto:Freeswitch-users@lists.freeswitch.org">Freeswitch-users@lists.freeswitch.org</a><br>
>>> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
>>> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
>>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>>><br>
>>><br>
>><br>
>> _______________________________________________<br>
>> Freeswitch-users mailing list<br>
>> <a href="mailto:Freeswitch-users@lists.freeswitch.org">Freeswitch-users@lists.freeswitch.org</a><br>
>> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
>> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
>> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
>><br>
>><br>
>><br>
>><br>
><br>
> _______________________________________________<br>
> Freeswitch-users mailing list<br>
> <a href="mailto:Freeswitch-users@lists.freeswitch.org">Freeswitch-users@lists.freeswitch.org</a><br>
> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
><br>
><br>
> _______________________________________________<br>
> Freeswitch-users mailing list<br>
> <a href="mailto:Freeswitch-users@lists.freeswitch.org">Freeswitch-users@lists.freeswitch.org</a><br>
> <a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
> UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
> <a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
><br>
><br>
><br>
<br>
_______________________________________________<br>
Freeswitch-users mailing list<br>
<a href="mailto:Freeswitch-users@lists.freeswitch.org">Freeswitch-users@lists.freeswitch.org</a><br>
<a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
<a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
<br>
<br>
_______________________________________________<br>
Freeswitch-users mailing list<br>
<a href="mailto:Freeswitch-users@lists.freeswitch.org">Freeswitch-users@lists.freeswitch.org</a><br>
<a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
<a href="http://www.freeswitch.org" target="_blank">http://www.freeswitch.org</a><br>
</div></div></blockquote></div><br><br clear="all"><br>-- <br>Anthony Minessale II<br><br>FreeSWITCH <a href="http://www.freeswitch.org/">http://www.freeswitch.org/</a><br>ClueCon <a href="http://www.cluecon.com/">http://www.cluecon.com/</a><br>
<br>AIM: anthm<br><a href="mailto:MSN%3Aanthony_minessale@hotmail.com">MSN:anthony_minessale@hotmail.com</a><br>GTALK/JABBER/<a href="mailto:PAYPAL%3Aanthony.minessale@gmail.com">PAYPAL:anthony.minessale@gmail.com</a><br>
IRC: <a href="http://irc.freenode.net">irc.freenode.net</a> #freeswitch<br><br>FreeSWITCH Developer Conference<br><a href="mailto:sip%3A888@conference.freeswitch.org">sip:888@conference.freeswitch.org</a><br><a href="http://iax:guest@conference.freeswitch.org/888">iax:guest@conference.freeswitch.org/888</a><br>
<a href="mailto:googletalk%3Aconf%2B888@conference.freeswitch.org">googletalk:conf+888@conference.freeswitch.org</a><br>pstn:213-799-1400<br>