[Freeswitch-users] Web sockets and gRPC modules?

[Leonardo Ribeiro]

Awesome!

Now I think that I have resources to study! I will take a look into mod_pocketsphinx, mod_flite and mod_unimrcp!

Thank you for drive me to the right directions!

Sent from my iPhone

> On Aug 15, 2016, at 4:14 PM, Anthony Minessale <anthony.minessale at gmail.com> wrote:
> 
> You would want to probably do it real-time by using a media bug similar to how mod_flite and mod_pocketsphinx are designed.
> 
> 
> 
>> On Mon, Aug 15, 2016 at 11:37 AM, Michael Jerris <mike at jerris.com> wrote:
>> this would have to be implemented as a module, similar to mod_unimrcp or mod_pocketsphix, that implements these protocols
>> 
>> 
>>> On Aug 15, 2016, at 12:14 PM, Leonardo Lima Ribeiro <llribeiro90 at gmail.com> wrote:
>>> 
>>> Michael, thank you for the response!
>>> 
>>> Actually I was thinking about copy the function “recordFile” but instead of save a file in the system etc, just the streams to my STT service…
>>> 
>>> Example of usage in LUA:
>>> text = session:asrApi(“IBM_WATSON”, max_len_secs, silent_threshold, silence_secs, keywords)
>>> 
>>> Which “IBM_WATSON” points me to a XML conf file (eg. conf/asrapi/IBM_WATSON.xml) which have all the settings needed to stream to that API like auth token, endpoints urls, supported protocols (initially web sockets and gRPC) etc.
>>> max_len_secs, silent_threshold, silence_secs - exactly like the current recordFile function params.
>>> keywords - optional field, some of these apis can use a list of words to improve the accuracy and speed of recognition...
>>> 
>>> For now, if my approach is correct, I found the following functions, to have an idea on how to start:
>>> switch_ivr_play_say.c - switch_ivr_record_file
>>> switch_cpp.cpp - CoreSession::recordFile
>>> 
>>> So yeah, I've setup already a development environment for me, following the instructions on (Creating New Modules - Confluence page).
>>> To be honest it’s my first time developing on C, so if you have good sources to improve my learning curve on “how to create a module in FreeSWITCH” would be awesome!
>>> 
>>> Can you give me a feedback on my approach and also the directions/instructions in what modules/functions should I use to do that?
>>> 
>>> Thank you,
>>> Leo
>>> 
>>>> On Aug 15, 2016, at 11:33 AM, freeswitch-users-request at lists.freeswitch.org wrote:
>>>> 
>>>> we would welcome for review someone submitting an module to support these.. it should not require a new module format, we already have those for speech recognition.. it would require a module that implemented the interfaces.
>>>> 
>>>> 
>>>>> On Aug 14, 2016, at 5:47 AM, Leonardo Lima Ribeiro <llribeiro90 at gmail.com> wrote:
>>>>> 
>>>>> Hello guys!
>>>>> 
>>>>> Is there any modules that we can use to make ASR using IBM Bluemix Watson Speech To Text (which accepts web sockets for streaming recognition) or Google Speech to Text API (which uses gRPC for streaming recognition)?
>>>>> 
>>>>> If there are none, do you think it’s worth it to build them (like in a new module format)? I know the current standard way is to use unimrcp, but unfortunately I could not get good results for my business cases using Sphinx, and the good services appears to be pricey… Said that, I was thinking about build modules that allows us to easily integrate to Google STT and IBM Watson STT Apis, which are the most popular and accessible services... 
>>>>> 
>>>>> Thank you,
>>>> 
>>> 
>>> _________________________________________________________________________
>>> Professional FreeSWITCH Consulting Services: 
>>> consulting at freeswitch.org
>>> http://www.freeswitchsolutions.com
>>> 
>>> Official FreeSWITCH Sites
>>> http://www.freeswitch.org
>>> http://confluence.freeswitch.org
>>> http://www.cluecon.com
>>> 
>>> FreeSWITCH-users mailing list
>>> FreeSWITCH-users at lists.freeswitch.org
>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>>> http://www.freeswitch.org
>> 
>> 
>> _________________________________________________________________________
>> Professional FreeSWITCH Consulting Services:
>> consulting at freeswitch.org
>> http://www.freeswitchsolutions.com
>> 
>> Official FreeSWITCH Sites
>> http://www.freeswitch.org
>> http://confluence.freeswitch.org
>> http://www.cluecon.com
>> 
>> FreeSWITCH-users mailing list
>> FreeSWITCH-users at lists.freeswitch.org
>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>> http://www.freeswitch.org
> 
> 
> 
> -- 
> Anthony Minessale II       ♬ @anthmfs  ♬ @FreeSWITCH  ♬
> 
> ☞ http://freeswitch.org/  ☞ http://cluecon.com/  ☞ http://twitter.com/FreeSWITCH
> ☞ irc.freenode.net #freeswitch ☞ http://freeswitch.org/g+
> 
> ClueCon Weekly Development Call 
> ☎ sip:888 at conference.freeswitch.org  ☎ +19193869900 
> 
> https://www.youtube.com/watch?v=9XXgW34t40s
> https://www.youtube.com/watch?v=NLaDpGQuZDA
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.freeswitch.org/pipermail/freeswitch-users/attachments/20160816/334d6bc1/attachment.html