[Freeswitch-users] Pushing CDR Information into Zeromq

Sun Jul 8 06:24:38 MSD 2012

Michael,

As far as I know, you are correct. Zeromq is a broker less design in which you are the one who should write your own broker. It just enables you to put the pieces together. There are lot of protocols that teach you how to do data persistence properly tho on the zeromq guide. Written by Pieter, one of the project leaders.

Once again, I really don't think that zeromq should be plugged onto the fs core because of its asserts that are still yet to be resolved but when they do, I will be the first one to propose some fancy stuff we can get done with it.

Nowadays, I use zeromq worker that consumes ESL events. It works great and enables me to have redundancy when consuming those events by syncing state on the worker cloud.

João Mesquita

On 07/07/2012, at 03:54 p.m., Michael Giagnocavo <mgg at giagnocavo.net> wrote:

> What do you mean by hold? From the 0mq site:
>  
> How do I use the ZMQ_SWAP socket feature to persist my data to disk?
> It is not the responsibility of the library to handle data persistence. If you need to make sure no messages are ever lost, you need to write application-level code to persist your data to non-volatile memory and handle the recovery modes of your application. Also, ZMQ_SWAP is deprecated and will be removed in the 3.x series of releases since it confuses many people over proper usage.
>  
> So, what am I missing? Everything I read about 0MQ make it clear that persistence and durability are something the user needs to handle. Contrast to, say, RabbitMQ or other message brokers which exist to handle the persistence for you.
>  
> -Michael
>  
> From: freeswitch-users-bounces at lists.freeswitch.org [mailto:freeswitch-users-bounces at lists.freeswitch.org] On Behalf Of Gavin Henry
> Sent: Saturday, July 07, 2012 8:07 AM
> To: FreeSWITCH Users Help
> Subject: Re: [Freeswitch-users] Pushing CDR Information into Zeromq
>  
> 0mq does hold the messages. 
>  
> -- 
> Gavin Henry
> Sent with Sparrow
>  
> On Saturday, 7 July 2012 at 11:56, Michael Giagnocavo wrote:
> 
> But 0MQ is just the transport. You still need a broker to persist messages, participate in transactions, and so on. That’s what I was referring to, not just the transport layer acknowledgements. So if you’re just taking CDRs from FS memory and sending them out over 0MQ, what if the other side is down? In that case, aren’t you risking a lot of data, should something happen before the receiver gets up and saves all the CDRs? 0MQ isn’t really an alternative to a broker like RabbitMQ or SSSB.
>  
> CDRs should be going to a local, durable, message queue. This doesn’t mean that you need to hit disk; the messages can stay in RAM for a few seconds, under the assumption that during normal ops, they’ll get delivered immediately and there’s no need for local persistence. But when something breaks, then the CDRs can just pile up on disk, and get pumped out whenever things stabilize.
>  
> Am I missing something?
>  
> -Michael
>  
> From: freeswitch-users-bounces at lists.freeswitch.org [mailto:freeswitch-users-bounces at lists.freeswitch.org] On Behalf Of João Mesquita
> Sent: Thursday, July 05, 2012 3:09 PM
> To: FreeSWITCH Users Help
> Subject: Re: [Freeswitch-users] Pushing CDR Information into Zeromq
>  
> Michael, 
>  
> You are partially correct because it depends on the socket type you use on ZeroMQ. Since the socket implemented on mod_zmq is a simple PUB/SUB, yes, messages would be discarded if they are not received by the other end. If we would use a XREQ/XREP then it would be queued until you are able to receive them.
>  
> -- 
> João Mesquita
> Sent with Sparrow
>  
> On Thursday, July 5, 2012 at 3:08 PM, Michael Giagnocavo wrote:
> 
> Wouldn’t the problem with ZeroMQ be no reliable delivery of CDRs? I was under the impression that 0MQ was more for high-performance, and things like guaranteed delivery are left as an exercise to the user.
> -Michael
>  
> From: freeswitch-users-bounces at lists.freeswitch.org [mailto:freeswitch-users-bounces at lists.freeswitch.org] On Behalf Of João Mesquita
> Sent: Thursday, July 05, 2012 9:56 AM
> To: FreeSWITCH Users Help
> Subject: Re: [Freeswitch-users] Pushing CDR Information into Zeromq
>  
> I haven't actually looked at the code, but you have to look at the variables on CHANNEL_REPORTING for example. There you will see all the vars needed to produce CDR entries, but they won't be on XML format like xml_curl would create.
>  
> Regards,
>  
> -- 
> João Mesquita
> Sent with Sparrow
>  
> On Thursday, July 5, 2012 at 10:37 AM, Neo Cheema wrote:
> 
> Hi all,
>  
> I was hoping to find a way to push CDR information into a queue.
> Zeromq comes out as an obvious choice because mod_event_zmq already
> exits. However, I can't find a way to configure this module to push
> CDR info. Have any of you guys tried it?
>  
> Regards
>  
> _________________________________________________________________________
> Professional FreeSWITCH Consulting Services:
> consulting at freeswitch.org
> http://www.freeswitchsolutions.com
>  
> 
> 
>  
> Official FreeSWITCH Sites
> http://www.freeswitch.org
> http://wiki.freeswitch.org
> http://www.cluecon.com
>  
> Join Us At ClueCon - Aug 7-9, 2012
>  
> FreeSWITCH-users mailing list
> FreeSWITCH-users at lists.freeswitch.org
> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
> http://www.freeswitch.org
>  
> _________________________________________________________________________
> Professional FreeSWITCH Consulting Services:
> consulting at freeswitch.org
> http://www.freeswitchsolutions.com
>  
> 
> 
>  
> Official FreeSWITCH Sites
> http://www.freeswitch.org
> http://wiki.freeswitch.org
> http://www.cluecon.com
>  
> Join Us At ClueCon - Aug 7-9, 2012
>  
> FreeSWITCH-users mailing list
> FreeSWITCH-users at lists.freeswitch.org
> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
> http://www.freeswitch.org
>  
> _________________________________________________________________________
> Professional FreeSWITCH Consulting Services:
> consulting at freeswitch.org
> http://www.freeswitchsolutions.com
>  
> 
> 
>  
> Official FreeSWITCH Sites
> http://www.freeswitch.org
> http://wiki.freeswitch.org
> http://www.cluecon.com
>  
> Join Us At ClueCon - Aug 7-9, 2012
>  
> FreeSWITCH-users mailing list
> FreeSWITCH-users at lists.freeswitch.org
> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
> http://www.freeswitch.org
>  
> _________________________________________________________________________
> Professional FreeSWITCH Consulting Services:
> consulting at freeswitch.org
> http://www.freeswitchsolutions.com
> 
> 
> 
> 
> Official FreeSWITCH Sites
> http://www.freeswitch.org
> http://wiki.freeswitch.org
> http://www.cluecon.com
> 
> Join Us At ClueCon - Aug 7-9, 2012
> 
> FreeSWITCH-users mailing list
> FreeSWITCH-users at lists.freeswitch.org
> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
> http://www.freeswitch.org
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.freeswitch.org/pipermail/freeswitch-users/attachments/20120707/bdaf7995/attachment-0001.html 