module json_cdr not creating all .json cdr when high number of calls
Hello, My freeswitch version is 1.6.10 i have started freeswitch with nice with 19 priority, 'nice -n 19 freeswitch' i am using module json_cdr, here is my config file http://pastebin.com/Mt1AFRVv please note i am writing the logs to json file as well as sending them to nginx web server as well and both legs log are enable i am testing the calls with sipp and sending 10000 calls with 200 cps-call per second and 2000 cc-concurrent calls now after the test i am getting 5192 entires only instead of 20,000(2 legs entry for all 10,000 calls) -> in the other scenario when i send 100 calls with 10 cps and 50 cc, i am getting all 200(100*2) json entries. So what and where is the issue?
Any suggestion? On Nov 10, 2016 8:14 PM, "devang nathwani" <devang.nathwani31589@gmail.com> wrote:
Hello,
My freeswitch version is 1.6.10 i have started freeswitch with nice with 19 priority, 'nice -n 19 freeswitch' i am using module json_cdr, here is my config file http://pastebin.com/Mt1AFRVv please note i am writing the logs to json file as well as sending them to nginx web server as well and both legs log are enable i am testing the calls with sipp and sending 10000 calls with 200 cps-call per second and 2000 cc-concurrent calls now after the test i am getting 5192 entires only instead of 20,000(2 legs entry for all 10,000 calls)
-> in the other scenario when i send 100 calls with 10 cps and 50 cc, i am getting all 200(100*2) json entries.
So what and where is the issue?
anything? On Fri, Nov 11, 2016 at 9:06 AM, devang nathwani < devang.nathwani31589@gmail.com> wrote:
Any suggestion?
On Nov 10, 2016 8:14 PM, "devang nathwani" <devang.nathwani31589@gmail.com> wrote:
Hello,
My freeswitch version is 1.6.10 i have started freeswitch with nice with 19 priority, 'nice -n 19 freeswitch' i am using module json_cdr, here is my config file http://pastebin.com/Mt1AFRVv please note i am writing the logs to json file as well as sending them to nginx web server as well and both legs log are enable i am testing the calls with sipp and sending 10000 calls with 200 cps-call per second and 2000 cc-concurrent calls now after the test i am getting 5192 entires only instead of 20,000(2 legs entry for all 10,000 calls)
-> in the other scenario when i send 100 calls with 10 cps and 50 cc, i am getting all 200(100*2) json entries.
So what and where is the issue?
The CDRs aren't perfect, i would do XML instead, I can only imagine json considering the issues i had getting XML going. My 2 cents. Sincerely, Don Hawkins Sent from my NationPCS® Nexus 6. On Nov 11, 2016 12:46 AM, "devang nathwani" <devang.nathwani31589@gmail.com> wrote:
anything?
On Fri, Nov 11, 2016 at 9:06 AM, devang nathwani < devang.nathwani31589@gmail.com> wrote:
Any suggestion?
On Nov 10, 2016 8:14 PM, "devang nathwani" <devang.nathwani31589@gmail.co m> wrote:
Hello,
My freeswitch version is 1.6.10 i have started freeswitch with nice with 19 priority, 'nice -n 19 freeswitch' i am using module json_cdr, here is my config file http://pastebin.com/Mt1AFRVv please note i am writing the logs to json file as well as sending them to nginx web server as well and both legs log are enable i am testing the calls with sipp and sending 10000 calls with 200 cps-call per second and 2000 cc-concurrent calls now after the test i am getting 5192 entires only instead of 20,000(2 legs entry for all 10,000 calls)
-> in the other scenario when i send 100 calls with 10 cps and 50 cc, i am getting all 200(100*2) json entries.
So what and where is the issue?
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
CDR should be logged for every call, if it doesn't then it's probably a bug which should be reported. On Fri, Nov 11, 2016 at 4:01 AM, Don Hawkins <hawkins@hawkinsegroup.com> wrote:
The CDRs aren't perfect, i would do XML instead, I can only imagine json considering the issues i had getting XML going. My 2 cents.
Sincerely, Don Hawkins
Sent from my NationPCS® Nexus 6.
On Nov 11, 2016 12:46 AM, "devang nathwani" <devang.nathwani31589@gmail.co m> wrote:
anything?
On Fri, Nov 11, 2016 at 9:06 AM, devang nathwani < devang.nathwani31589@gmail.com> wrote:
Any suggestion?
On Nov 10, 2016 8:14 PM, "devang nathwani" < devang.nathwani31589@gmail.com> wrote:
Hello,
My freeswitch version is 1.6.10 i have started freeswitch with nice with 19 priority, 'nice -n 19 freeswitch' i am using module json_cdr, here is my config file http://pastebin.com/Mt1AFRVv please note i am writing the logs to json file as well as sending them to nginx web server as well and both legs log are enable i am testing the calls with sipp and sending 10000 calls with 200 cps-call per second and 2000 cc-concurrent calls now after the test i am getting 5192 entires only instead of 20,000(2 legs entry for all 10,000 calls)
-> in the other scenario when i send 100 calls with 10 cps and 50 cc, i am getting all 200(100*2) json entries.
So what and where is the issue?
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Devang very interesting issue. I'm going to use json-cdr as well. And I'm scary little bit :) Did you try to play with your configuration to exclude some "buggy" parts? My point is to try the following use cases: 1. Write json cdr only to disks 2. Write json cdr only to http service Providing configuration is not enough. We do not know the load on you disks (is it SSD, HDD, or virtual disk on SSD or HDD), load on you network adapters and response time from http service, etc. Is there any errors in freeswitch logs related to this issue? On Fri, Nov 11, 2016 at 8:45 AM devang nathwani < devang.nathwani31589@gmail.com> wrote:
anything?
On Fri, Nov 11, 2016 at 9:06 AM, devang nathwani < devang.nathwani31589@gmail.com> wrote:
Any suggestion?
On Nov 10, 2016 8:14 PM, "devang nathwani" <devang.nathwani31589@gmail.com> wrote:
Hello,
My freeswitch version is 1.6.10 i have started freeswitch with nice with 19 priority, 'nice -n 19 freeswitch' i am using module json_cdr, here is my config file http://pastebin.com/Mt1AFRVv please note i am writing the logs to json file as well as sending them to nginx web server as well and both legs log are enable i am testing the calls with sipp and sending 10000 calls with 200 cps-call per second and 2000 cc-concurrent calls now after the test i am getting 5192 entires only instead of 20,000(2 legs entry for all 10,000 calls)
-> in the other scenario when i send 100 calls with 10 cps and 50 cc, i am getting all 200(100*2) json entries.
So what and where is the issue?
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Best regards, Vladyslav Zakhozhai email: v.zakhozhai@gmail.com tel.: +380(93) 757-21-61
You can try mod_format. This module may create CDR in json format пт, 11 нояб. 2016, 12:05 Vladyslav Zakhozhai <v.zakhozhai@gmail.com>:
Devang very interesting issue. I'm going to use json-cdr as well. And I'm scary little bit :)
Did you try to play with your configuration to exclude some "buggy" parts? My point is to try the following use cases: 1. Write json cdr only to disks 2. Write json cdr only to http service
Providing configuration is not enough. We do not know the load on you disks (is it SSD, HDD, or virtual disk on SSD or HDD), load on you network adapters and response time from http service, etc.
Is there any errors in freeswitch logs related to this issue?
On Fri, Nov 11, 2016 at 8:45 AM devang nathwani < devang.nathwani31589@gmail.com> wrote:
anything?
On Fri, Nov 11, 2016 at 9:06 AM, devang nathwani < devang.nathwani31589@gmail.com> wrote:
Any suggestion?
On Nov 10, 2016 8:14 PM, "devang nathwani" <devang.nathwani31589@gmail.com> wrote:
Hello,
My freeswitch version is 1.6.10 i have started freeswitch with nice with 19 priority, 'nice -n 19 freeswitch' i am using module json_cdr, here is my config file http://pastebin.com/Mt1AFRVv please note i am writing the logs to json file as well as sending them to nginx web server as well and both legs log are enable i am testing the calls with sipp and sending 10000 calls with 200 cps-call per second and 2000 cc-concurrent calls now after the test i am getting 5192 entires only instead of 20,000(2 legs entry for all 10,000 calls)
-> in the other scenario when i send 100 calls with 10 cps and 50 cc, i am getting all 200(100*2) json entries.
So what and where is the issue?
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Best regards, Vladyslav Zakhozhai email: v.zakhozhai@gmail.com tel.: +380(93) 757-21-61 _________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Hello , i have tried using mod_format_cdr, result not much differs my server is having hdd and its dedicated and having 24 cores i have tried two other scenarios once with only writing to disk and not sending data to web server 100 cps, 1000 cc, 5000 total top is showing all the core usage 2400 % usage, which is also critical, (how to reduce that?) i am getting 5971 json cdr entries instead of 10,000(5000*2, for 2 legs) the second case is with only sending data to web server and not writing to disk 100 cps, 1000 cc, 5000 total top is again showing the core usage of all 2400%(!) and i am getting only 704 web server request, using nginx web server On Fri, Nov 11, 2016 at 3:44 PM, Sergey Safarov <s.safarov@gmail.com> wrote:
You can try mod_format. This module may create CDR in json format
пт, 11 нояб. 2016, 12:05 Vladyslav Zakhozhai <v.zakhozhai@gmail.com>:
Devang very interesting issue. I'm going to use json-cdr as well. And I'm scary little bit :)
Did you try to play with your configuration to exclude some "buggy" parts? My point is to try the following use cases: 1. Write json cdr only to disks 2. Write json cdr only to http service
Providing configuration is not enough. We do not know the load on you disks (is it SSD, HDD, or virtual disk on SSD or HDD), load on you network adapters and response time from http service, etc.
Is there any errors in freeswitch logs related to this issue?
On Fri, Nov 11, 2016 at 8:45 AM devang nathwani < devang.nathwani31589@gmail.com> wrote:
anything?
On Fri, Nov 11, 2016 at 9:06 AM, devang nathwani < devang.nathwani31589@gmail.com> wrote:
Any suggestion?
On Nov 10, 2016 8:14 PM, "devang nathwani" <devang.nathwani31589@gmail. com> wrote:
Hello,
My freeswitch version is 1.6.10 i have started freeswitch with nice with 19 priority, 'nice -n 19 freeswitch' i am using module json_cdr, here is my config file http://pastebin.com/Mt1AFRVv please note i am writing the logs to json file as well as sending them to nginx web server as well and both legs log are enable i am testing the calls with sipp and sending 10000 calls with 200 cps-call per second and 2000 cc-concurrent calls now after the test i am getting 5192 entires only instead of 20,000(2 legs entry for all 10,000 calls)
-> in the other scenario when i send 100 calls with 10 cps and 50 cc, i am getting all 200(100*2) json entries.
So what and where is the issue?
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Best regards, Vladyslav Zakhozhai email: v.zakhozhai@gmail.com tel.: +380(93) 757-21-61 _________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Gentlemen?
Try to use the xml_cdr and see if the same behavior is obtained. You need to know if it's a bug in json only or in the core. We can't say too much without seeing your test environment, logs, dialplan, etc. Post your findings to a JIRA with all logs and information included. You should consider emailing consulting@freeswitch.org to get assistance with this performance test Em sex, 11 de nov de 2016 às 08:35, devang nathwani < devang.nathwani31589@gmail.com> escreveu:
Gentlemen? _________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
participants (6)
-
Abaci B
-
devang nathwani
-
Don Hawkins
-
Sergey Safarov
-
Vladyslav Zakhozhai
-
Ítalo Rossi