[Freeswitch-users] Freeswitch support for text messages/commands between Verto/webRTC to/from conferenced backend SIP/RTP systems

[Mundkowsky, Robert]

We are wondering if FreeSWITCH supports sending and receiving text messages between Verto/webRTC to/from backend SIP/RTP systems that conferenced together?


1)      We want to use this to send commands from the web browser to the backend systems, for example:

a.       "hey backend system, please turn on the ASR to start listening."


2)      We also wonder if FreeSWITCH supports sending commands from the backend to the frontend (web browser), for example:

a.       "hey avatar, here are some visemes to tell you how you should move your lips, arms, ... at the same time as playing this audio"

If both Verto/SIP or webRTC/RTP are supported, is either more ideal?

For instance, if the text/commands are over RTC then maybe we can use one clock for all RTP streams and/or RTP sessions and use the RTP timestamps to synchronize the commands with audio/video.  Or maybe Verto/SIP is better for commands.


I see there are various RFCs for text over RTP and text over RTCDataChannel in webRTC, but not sure if FreeSWITCH supports any of these.

I also see FreeSWITCH mod_verto  support text messages, but not sure if FreeSWITCH sends these to/from SIP (e.g. maybe via SIMPLE SIP) or via RTCDataChannel?


Robert



________________________________

This e-mail and any files transmitted with it may contain privileged or confidential information. It is solely for use by the individual for whom it is intended, even if addressed incorrectly. If you received this e-mail in error, please notify the sender; do not disclose, copy, distribute, or take any action in reliance on the contents of this information; and delete it from your system. Any other use of this e-mail is prohibited.


Thank you for your compliance.

________________________________
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.freeswitch.org/pipermail/freeswitch-users/attachments/20180206/0e824ea7/attachment.html>