[Freeswitch-users] Copy incoming audio from participants for ASR

[R G]

Hi all,

currently we add an participant into the conference and take his audio 
for speech recognition.

I think bbb uses the build FS conferences.

So the mod_detect_speech app works on single channels in a conference?

I hoped i can catch dailers before joining a conference and copy their 
streams as an alternative.

Kind regards,

Robert

Am 16.12.2020 um 14:21 schrieb Seven Du:
> I believe directly run the `detect_speech` app on each channel works.
>
> On Wed, Dec 16, 2020 at 6:21 AM David P <davidswalkabout at gmail.com 
> <mailto:davidswalkabout at gmail.com>> wrote:
>
>     How do you currently forward audio to kaldi?
>
>     If you use an FS conference, I think there is no way to separate
>     the audio per-user.
>
>     I agree it would be very useful if there were a way to process
>     each user's audio separately. After a few years of using FS, I
>     haven't come across a way to do it.
>
>         --------- Forwarded message ----------
>         From: R G <mitachundkrach at gmail.com
>         <mailto:mitachundkrach at gmail.com>>
>         To: freeswitch-users at lists.freeswitch.org
>         <mailto:freeswitch-users at lists.freeswitch.org>
>         Cc:
>         Bcc:
>         Date: Mon, 14 Dec 2020 12:40:38 +0100
>         Subject: [Freeswitch-users] Copy incoming audio from
>         participants for ASR
>         Hello everyone,
>
>         i have a technical question about freeswitch and would like to
>         know if
>         my idea is technically possible.
>
>         I've got a project at the university and my goal is to improve
>         automatic
>         speech recognition for bigbluebutton.
>
>         In the summer semester a group of students of my university
>         made a
>         subtitling plugin[1] for bigbluebutton. This plugin adds a
>         participant
>         into the meeting and grabs his audiostream to send it to the
>         kaldi ASR
>         Software. When more than one person speaks at a time the
>         detection
>         decreases.
>
>         My idea is to copy the incoming freeswitch audiostreams from
>         every
>         participant and send them directly as a copy to the ASR (kaldi
>         can
>         handle multiple audiostreams at once).
>
>         In the Confluence-Wiki i searched for something in this
>         direction but
>         only found things like Dialplan to ring multiple telephones at
>         once.
>
>         I hope my idea is formulated understandably.
>
>
>         Kind regards,
>
>         Robert
>
>         [1] https://github.com/3wille/bbb-kaldi-connector
>         <https://github.com/3wille/bbb-kaldi-connector>
>
>     _________________________________________________________________________
>
>     The FreeSWITCH project is sponsored by SignalWire
>     https://signalwire.com <https://signalwire.com>
>     Enhance your FreeSWITCH install with disruptive priced SMS and
>     PSTN services.
>     Build your next product on our scalable cloud platform.
>
>     Join our online community to chat in real time
>     https://signalwire.community <https://signalwire.community>
>
>     Professional FreeSWITCH Services
>     sales at freeswitch.com <mailto:sales at freeswitch.com>
>     https://freeswitch.com <https://freeswitch.com>
>
>     Official FreeSWITCH Sites
>     https://freeswitch.com/oss <https://freeswitch.com/oss>
>     https://freeswitch.org/confluence <https://freeswitch.org/confluence>
>     https://cluecon.com <https://cluecon.com>
>
>     FreeSWITCH-users mailing list
>     FreeSWITCH-users at lists.freeswitch.org
>     <mailto:FreeSWITCH-users at lists.freeswitch.org>
>     http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>     <http://lists.freeswitch.org/mailman/listinfo/freeswitch-users>
>     UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>     <http://lists.freeswitch.org/mailman/options/freeswitch-users>
>     https://freeswitch.com <https://freeswitch.com>
>
>
>
> -- 
> About: http://about.me/dujinfang <http://about.me/dujinfang>
> Blog: http://www.dujinfang.com <http://www.dujinfang.com>
> Proj: http://www.freeswitch.org.cn <http://www.freeswitch.org.cn>
>
> _________________________________________________________________________
>
> The FreeSWITCH project is sponsored by SignalWire https://signalwire.com
> Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services.
> Build your next product on our scalable cloud platform.
>
> Join our online community to chat in real time https://signalwire.community
>
> Professional FreeSWITCH Services
> sales at freeswitch.com
> https://freeswitch.com
>
> Official FreeSWITCH Sites
> https://freeswitch.com/oss
> https://freeswitch.org/confluence
> https://cluecon.com
>
> FreeSWITCH-users mailing list
> FreeSWITCH-users at lists.freeswitch.org
> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
> https://freeswitch.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.freeswitch.org/pipermail/freeswitch-users/attachments/20201216/ae3e9bb2/attachment-0001.html>