[Freeswitch-users] XML_CURL max connection limit

[Cal Leeming [Simplicity Media Ltd]]

Hello,

This isn't really on topic within FreeSWITCH and is more related to your
web application scalability.

However, semi high traffic web application platforms is one area I do have
a decent amount of experience in, so let me offer some thoughts (I assume
you are running PHP based on your log output).

I would advise looking into the following;

* PHP FPM with NGINX (you'll get better throughput with this than mod_php
and apache - look on google for benchmarks)
* APC or xcache opcode acceleration (out of the box, this should speed up
execution)
* Assuming you have a DB, implement a caching library to reduce DB calls
(look at memcache, redis if you need atomicity or scaling, or even just
xcache)
* Implement haproxy/zxtm and balance across multiple web servers (assuming
your code isn't vuln to race, and you are able to switch to a db/cache
based session backend, rather than disk)
* Get new relic on your boxes, identify the bottlenecks, and performance
tweak where necessary
* If you stay on apache, don't just increase maxclient's... you need to
calculate how much resources the box needs to handle that many concurrent
requests, and identify the max memory space needed for each request, cpu
time etc.
* Assuming you use MySQL, switch over to Percona, use InnoDB, and separate
out read/writes from the same server (you can do this in master<>master or
master<>slave, or any combination you like). This will reduce the innodb
thread contention and give you much better throughput

Hope this helps

Cal

On Wed, Jun 5, 2013 at 3:47 PM, Muhammad Shahzad <shaheryarkh at gmail.com>wrote:

> I have already set MaxClients to 2048, but that limit is never reached.
>
> Thank you.
>
>
> On Wed, Jun 5, 2013 at 4:17 PM, Samir Doshi <smrdoshi at gmail.com> wrote:
>
>>  On 06/05/2013 07:36 PM, Michael Jerris wrote:
>>
>> Is the request going to your server and getting no response?
>>
>>  On Jun 5, 2013, at 9:50 AM, Muhammad Shahzad <shaheryarkh at gmail.com>
>> wrote:
>>
>>  Hi,
>>
>>  Is there any connection limit perhaps hard coded anywhere in xml_curl
>> module? I am load testing FS with xml_curl to provide config, directory and
>> dial-plan. I observed i start getting HTTP ERROR 0 when i have around 1600
>> concurrent calls on machine with media. Although i see no sign of system
>> overload either on FS (load average < 1.8) or Apache (load average < 4,75).
>> Both have plenty of RAM and bandwidth free.
>>
>>  Is there anyway to get rid of this HTTP ERROR 0? It must be generated
>> by FS internally, since i don't see anything like this error in Apache logs.
>>
>>  Below 1,638 concurrent calls @ 50 CPS, i get success rate of 99.999%
>> but as soon as it crosses this mark, success rate drastically drops to 60%
>> and even below (when concurrent calls go beyond 2,000). Here is error
>> console log.
>>
>>  ###################################################
>>  2013-06-05 18:09:13.591229 [ERR] mod_xml_curl.c:310 Received HTTP error
>> 0 trying to fetch http://172.16.171.61/vm-users.php
>> data:
>> [hostname=vms01&section=directory&tag_name=domain&key_name=name&key_value=10.1.3.2&Event-Name=GENERAL&Core-UUID=84c917dc-cdde-11e2-9bb2-8b779d6a4e97&FreeSWITCH-Hostname=vms01&FreeSWITCH-Switchname=vms01&FreeSWITCH-IPv4=10.1.3.2&FreeSWITCH-IPv6=%3A%3A1&Event-Date-Local=2013-06-05%2018%3A09%3A03&Event-Date-GMT=Wed,%2005%20Jun%202013%2013%3A09%3A03%20GMT&Event-Date-Timestamp=1370437743591210&Event-Calling-File=mod_voicemail.c&Event-Calling-Function=resolve_id&Event-Calling-Line-Number=1350&Event-Sequence=1776930&action=message-count&key=id&user=989000049598&domain=10.1.3.2]
>>  ###################################################
>>
>>  Although this setup is more then sufficient for my requirement but i
>> just want to know if i can extend it beyond, since i still have lot of
>> resources free.
>>
>>  OS: Debian 6.0.7 x64
>> Apache: 2.2.16
>> FreeSWITCH: 1.5.1b+git~20130424T005233Z~66d1755b06
>>
>>  Both FS and Apache are running on separate dedicated machines on same
>> LAN.
>>
>>  Thank you.
>>
>>
>>
>>
>> _________________________________________________________________________
>> Professional FreeSWITCH Consulting Services:consulting at freeswitch.orghttp://www.freeswitchsolutions.com
>>
>> FreeSWITCH-powered IP PBX: The CudaTel Communication Server
>>
>> Official FreeSWITCH Siteshttp://www.freeswitch.orghttp://wiki.freeswitch.orghttp://www.cluecon.com
>>
>> FreeSWITCH-users mailing listFreeSWITCH-users at lists.freeswitch.orghttp://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-usershttp://www.freeswitch.org
>>
>>
>> I think you need to do something with Apache configuration. Maybe
>> increase apache child instance/Threads will give you better performance.
>>
>> --
>> Thanks,
>> Sam
>>
>>
>> _________________________________________________________________________
>> Professional FreeSWITCH Consulting Services:
>> consulting at freeswitch.org
>> http://www.freeswitchsolutions.com
>>
>> 
>> 
>>
>> Official FreeSWITCH Sites
>> http://www.freeswitch.org
>> http://wiki.freeswitch.org
>> http://www.cluecon.com
>>
>> FreeSWITCH-users mailing list
>> FreeSWITCH-users at lists.freeswitch.org
>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>> http://www.freeswitch.org
>>
>>
>
>
> --
> Mit freundlichen Grüßen
> Muhammad Shahzad
> -----------------------------------
> CISCO Rich Media Communication Specialist (CRMCS)
> CISCO Certified Network Associate (CCNA)
> Cell: +49 176 99 83 10 85
> MSN: shari_786pk at hotmail.com
> Email: shaheryarkh at googlemail.com
>
> _________________________________________________________________________
> Professional FreeSWITCH Consulting Services:
> consulting at freeswitch.org
> http://www.freeswitchsolutions.com
>
> 
> 
>
> Official FreeSWITCH Sites
> http://www.freeswitch.org
> http://wiki.freeswitch.org
> http://www.cluecon.com
>
> FreeSWITCH-users mailing list
> FreeSWITCH-users at lists.freeswitch.org
> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
> http://www.freeswitch.org
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.freeswitch.org/pipermail/freeswitch-users/attachments/20130605/54e4fe4e/attachment-0001.html