How do you currently forward audio to kaldi? If you use an FS conference, I think there is no way to separate the audio per-user. I agree it would be very useful if there were a way to process each user's audio separately. After a few years of using FS, I haven't come across a way to do it. --------- Forwarded message ----------
From: R G <mitachundkrach@gmail.com> To: freeswitch-users@lists.freeswitch.org Cc: Bcc: Date: Mon, 14 Dec 2020 12:40:38 +0100 Subject: [Freeswitch-users] Copy incoming audio from participants for ASR Hello everyone,
i have a technical question about freeswitch and would like to know if my idea is technically possible.
I've got a project at the university and my goal is to improve automatic speech recognition for bigbluebutton.
In the summer semester a group of students of my university made a subtitling plugin[1] for bigbluebutton. This plugin adds a participant into the meeting and grabs his audiostream to send it to the kaldi ASR Software. When more than one person speaks at a time the detection decreases.
My idea is to copy the incoming freeswitch audiostreams from every participant and send them directly as a copy to the ASR (kaldi can handle multiple audiostreams at once).
In the Confluence-Wiki i searched for something in this direction but only found things like Dialplan to ring multiple telephones at once.
I hope my idea is formulated understandably.
Kind regards,
Robert