We are wondering if FreeSWITCH supports sending and receiving text messages between Verto/webRTC to/from backend SIP/RTP systems that conferenced together?

 

1)      We want to use this to send commands from the web browser to the backend systems, for example:

a.       “hey backend system, please turn on the ASR to start listening.”

 

2)      We also wonder if FreeSWITCH supports sending commands from the backend to the frontend (web browser), for example:

a.       “hey avatar, here are some visemes to tell you how you should move your lips, arms, … at the same time as playing this audio”

 

If both Verto/SIP or webRTC/RTP are supported for sending text, is either more ideal? 

 

For instance, if the text/commands are over RTC then maybe we can use one clock for all RTP streams and/or RTP sessions and use the RTP timestamps to synchronize the commands with audio/video.  Or maybe Verto/SIP is better for commands.

 

 

I see there are various RFCs for text over RTP and text over webRTC, but not sure if FreeSWITCH supports any of these.

 

I also see FreeSWITCH mod_verto  support text messages, but not sure if FreeSWITCH sends these to/from SIP (e.g. maybe via SIMPLE SIP) or via text over RTP?

 

 

Robert