[Freeswitch-users] Copy incoming audio from participants for ASR

Seven Du dujinfang at gmail.com
Wed Dec 16 13:21:22 UTC 2020


I believe directly run the `detect_speech` app on each channel works.

On Wed, Dec 16, 2020 at 6:21 AM David P <davidswalkabout at gmail.com> wrote:

> How do you currently forward audio to kaldi?
>
> If you use an FS conference, I think there is no way to separate the audio
> per-user.
>
> I agree it would be very useful if there were a way to process each user's
> audio separately. After a few years of using FS, I haven't come across a
> way to do it.
>
> --------- Forwarded message ----------
>> From: R G <mitachundkrach at gmail.com>
>> To: freeswitch-users at lists.freeswitch.org
>> Cc:
>> Bcc:
>> Date: Mon, 14 Dec 2020 12:40:38 +0100
>> Subject: [Freeswitch-users] Copy incoming audio from participants for ASR
>> Hello everyone,
>>
>> i have a technical question about freeswitch and would like to know if
>> my idea is technically possible.
>>
>> I've got a project at the university and my goal is to improve automatic
>> speech recognition for bigbluebutton.
>>
>> In the summer semester a group of students of my university made a
>> subtitling plugin[1] for bigbluebutton. This plugin adds a participant
>> into the meeting and grabs his audiostream to send it to the kaldi ASR
>> Software. When more than one person speaks at a time the detection
>> decreases.
>>
>> My idea is to copy the incoming freeswitch audiostreams from every
>> participant and send them directly as a copy to the ASR (kaldi can
>> handle multiple audiostreams at once).
>>
>> In the Confluence-Wiki i searched for something in this direction but
>> only found things like Dialplan to ring multiple telephones at once.
>>
>> I hope my idea is formulated understandably.
>>
>>
>> Kind regards,
>>
>> Robert
>>
>> [1] https://github.com/3wille/bbb-kaldi-connector
>>
>> _________________________________________________________________________
>
> The FreeSWITCH project is sponsored by SignalWire https://signalwire.com
> Enhance your FreeSWITCH install with disruptive priced SMS and PSTN
> services.
> Build your next product on our scalable cloud platform.
>
> Join our online community to chat in real time
> https://signalwire.community
>
> Professional FreeSWITCH Services
> sales at freeswitch.com
> https://freeswitch.com
>
> Official FreeSWITCH Sites
> https://freeswitch.com/oss
> https://freeswitch.org/confluence
> https://cluecon.com
>
> FreeSWITCH-users mailing list
> FreeSWITCH-users at lists.freeswitch.org
> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
> https://freeswitch.com



-- 
About: http://about.me/dujinfang
Blog: http://www.dujinfang.com
Proj:  http://www.freeswitch.org.cn
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.freeswitch.org/pipermail/freeswitch-users/attachments/20201216/c8fbdc4a/attachment.html>


More information about the FreeSWITCH-users mailing list