How do you currently forward audio to kaldi?
If you use an FS conference, I think there is no way to separate the audio per-user.
I agree it would be very useful if there were a way to process each user's audio separately. After a few years of using FS, I haven't come across a way to do it.
--------- Forwarded message ----------
From: R G <mitachundkrach@gmail.com>
To: freeswitch-users@lists.freeswitch.org
Cc:
Bcc:
Date: Mon, 14 Dec 2020 12:40:38 +0100
Subject: [Freeswitch-users] Copy incoming audio from participants for ASR
Hello everyone,
i have a technical question about freeswitch and would like to know if
my idea is technically possible.
I've got a project at the university and my goal is to improve automatic
speech recognition for bigbluebutton.
In the summer semester a group of students of my university made a
subtitling plugin[1] for bigbluebutton. This plugin adds a participant
into the meeting and grabs his audiostream to send it to the kaldi ASR
Software. When more than one person speaks at a time the detection
decreases.
My idea is to copy the incoming freeswitch audiostreams from every
participant and send them directly as a copy to the ASR (kaldi can
handle multiple audiostreams at once).
In the Confluence-Wiki i searched for something in this direction but
only found things like Dialplan to ring multiple telephones at once.
I hope my idea is formulated understandably.
Kind regards,
Robert
[1] https://github.com/3wille/bbb-kaldi-connector