[Freeswitch-users] Copy incoming audio from participants for ASR

[David P]

How do you currently forward audio to kaldi?

If you use an FS conference, I think there is no way to separate the audio
per-user.

I agree it would be very useful if there were a way to process each user's
audio separately. After a few years of using FS, I haven't come across a
way to do it.

--------- Forwarded message ----------
> From: R G <mitachundkrach at gmail.com>
> To: freeswitch-users at lists.freeswitch.org
> Cc:
> Bcc:
> Date: Mon, 14 Dec 2020 12:40:38 +0100
> Subject: [Freeswitch-users] Copy incoming audio from participants for ASR
> Hello everyone,
>
> i have a technical question about freeswitch and would like to know if
> my idea is technically possible.
>
> I've got a project at the university and my goal is to improve automatic
> speech recognition for bigbluebutton.
>
> In the summer semester a group of students of my university made a
> subtitling plugin[1] for bigbluebutton. This plugin adds a participant
> into the meeting and grabs his audiostream to send it to the kaldi ASR
> Software. When more than one person speaks at a time the detection
> decreases.
>
> My idea is to copy the incoming freeswitch audiostreams from every
> participant and send them directly as a copy to the ASR (kaldi can
> handle multiple audiostreams at once).
>
> In the Confluence-Wiki i searched for something in this direction but
> only found things like Dialplan to ring multiple telephones at once.
>
> I hope my idea is formulated understandably.
>
>
> Kind regards,
>
> Robert
>
> [1] https://github.com/3wille/bbb-kaldi-connector
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.freeswitch.org/pipermail/freeswitch-users/attachments/20201216/ea0ecaf0/attachment.html>