Ways of Integrating Sphinx...
Hi, I know only two ways of Sphinx - FS integration and its through mod_pocketsphinx and ESL. Performance with mod_pocketsphinx was not very good especially prompts were not playing properly. I haven't tried ESL. Can anyone guide what are other possibilities and which one is best in stability and can any one be deployed in live environment. -- Regards, Moiz Chinoy.
Can you elaborate more on this? I use it often in testing with the Pizza Demo..... It works fine. What SVN rev are you on also? /b On May 1, 2009, at 8:38 AM, Moiz Chinoy wrote:
Performance with mod_pocketsphinx was not very good especially prompts were not playing properly. I haven't tried ESL.
Brian West brian@freeswitch.org -- Meet us at ClueCon! http://www.cluecon.com
Hi Moiz, I've checking out mod_pocketshinx against other asr's on Windows with the same hardware. No matter what settings one tries, mod_pocketsphinx is virtually unusable in real world scenarios. One can play around with mod_pocketsphinx settings so that it picks voice up well but then there better not be any background noise either from a bad connection or just everyday sounds. It just way to sensitive and of couse you'll notice this problem most with cell phones. If you adjust the settings to try blocking out background noise you'll find you don't suceed all that well and then there are problems picking up the callers voice. It looks like some kind of signal pre-processing is required that isn't in place yet but we all know that this is a work-in progress. I don't know if esl would make any difference. To use FS and an ASR/TTS I just bridge calls to another ASR application for now. Mark -----Original Message----- From: Moiz Chinoy <moizchinoy@gmail.com> To: freeswitch-users@lists.freeswitch.org Sent: Fri, 1 May 2009 6:38 am Subject: [Freeswitch-users] Ways of Integrating Sphinx... Hi, I know only two ways of Sphinx - FS integration and its through mod_pocketsphinx and ESL. Performance with mod_pocketsphinx was not very good especially prompts were not playing properly. I haven't tried ESL. Can anyone guide what are other possibilities and which one is best in stability and can any one be deployed in live environment. -- Regards, Moiz Chinoy. _______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
On May 1, 2009, at 6:03 PM, mszlazak@aol.com wrote:
Hi Moiz,
I've checking out mod_pocketshinx against other asr's on Windows with the same hardware. No matter what settings one tries, mod_pocketsphinx is virtually unusable in real world scenarios.
I have used it and it works fine... I think your expectations are a bit high for it... Complex things like dictation is not what PocketSphinx is for. You should try linux cuz I know it works great there.
One can play around with mod_pocketsphinx settings so that it picks voice up well but then there better not be any background noise either from a bad connection or just everyday sounds.
There is no other ASR out there that doesn't get pissed off at background noise or any noise for that matter... have you called AT&T and Sprint lately? My dogs barking in the background really send theirs into fits and they paid tons of money for it.
It just way to sensitive and of couse you'll notice this problem most with cell phones.
Same with commercial ASR, Granted the acoustical model for PocketSphinx wasn't done with any files recorded from cellphone from what I can tell. You can do adaptation of the acoustical model as per the Sphinx wiki to make it more accurate for your needs.... that takes time and effort but it works.
If you adjust the settings to try blocking out background noise you'll find you don't suceed all that well and then there are problems picking up the callers voice.
Those settings are for telling when the person stopped talking... nothing more.
It looks like some kind of signal pre-processing is required that isn't in place yet but we all know that this is a work-in progress.
I'm not working on it... I run the pizza demo with PS and it works from my polycom rather well I would say it gets some things wrong but it does score them low so you can verify it in your scripts.
I don't know if esl would make any difference. To use FS and an ASR/ TTS I just bridge calls to another ASR application for now.
Mark
Brian West brian@freeswitch.org -- Meet us at ClueCon! http://www.cluecon.com
In my comments on mod_pocketsphinx, I wasn't clear enough about it being "virtually unusable in real world scenarios." Also, the grammars I'm talking about are either single words, like "yes/no" or more complex like "leave a message." It doesn't matter how complex the grammar, the issue remains. My comments are meant in comparison to other asr's and in everyday situations of background noise. I'm not taliking about checking things out at a concert, race track, subway, construction project, etc. When compared to my AT&T 411 service, AT&T's asr has no where near the problems in dealing with the background noises I'm talking about and is very usable in the real world situations I'm taliking about. Moreover, when comparing to another vendors asr on my hardware then that vendors asr also has no were near the problems mod_pocketsphinx has and again is very usable in a real world situation. That's why I suggested using something other than mod_pocketsphinx. I think that mod_pocketspinx is not able to deal with low signal-to-noise ratios to the point where it can be used in telephony at all. At least that's the way it seems to me. I don't know what else to say. That's been my experience with mod_pocketsphinx ?? Mark. -----Original Message----- From: Brian West <brian@freeswitch.org> To: freeswitch-users@lists.freeswitch.org Sent: Sat, 2 May 2009 7:42 am Subject: Re: [Freeswitch-users] Ways of Integrating Sphinx... On May 1, 2009, at 6:03 PM, mszlazak@aol.com wrote: Hi Moiz, I've checking out mod_pocketshinx against other asr's on Windows with the same hardware.? No matter what settings one tries, mod_pocketsphinx is virtually unusable in real world scenarios.? I have used it and it works fine... I think your expectations are a bit high for it... Complex things like dictation is not what PocketSphinx is for. ?You should try linux cuz I know it works great there. One can play around with mod_pocketsphinx settings so that it picks voice up well but then there better not be any background noise either from a bad connection or just everyday sounds.? There is no other ASR out there that doesn't get pissed off at background noise or any noise for that matter... have you called AT&T and Sprint lately? ?My dogs barking in the background really send theirs into fits and they paid tons of money for it. ? It just way to sensitive and of couse you'll notice this problem most with cell phones. Same with commercial ASR, Granted the acoustical model for PocketSphinx wasn't done with any files recorded from cellphone from what I can tell. ?You can do adaptation of the acoustical model as per the Sphinx wiki to make it more accurate for your needs.... that takes time and effort but it works. If you adjust the settings to try blocking out background noise you'll find you don't suceed all that well and then there are problems picking up the callers voice. Those settings are for telling when the person stopped talking... nothing more. It looks like some kind of signal pre-processing is required that isn't in place yet but we all know that this is a work-in progress. I'm not working on it... I run the pizza demo with PS and it works from my polycom rather well I would say it gets some things wrong but it does score them low so you can verify it in your scripts. I don't know if esl would make any difference. To use FS and an ASR/TTS I just bridge calls to another ASR application for now.? Mark Brian West brian@freeswitch.org -- Meet us at ClueCon! ?http://www.cluecon.com = _______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
BTW Brian, Here is something that would make FS's VAD much better. The technique also improved Sphinx-3 performance in low-SNR enviroments and made it run over 40% faster. http://figment.cse.usf.edu/~sfefilat/data/papers/WeBT5.3.pdf Mark. -----Original Message----- From: Brian West <brian@freeswitch.org> To: freeswitch-users@lists.freeswitch.org Sent: Sat, 2 May 2009 7:42 am Subject: Re: [Freeswitch-users] Ways of Integrating Sphinx... On May 1, 2009, at 6:03 PM, mszlazak@aol.com wrote: Hi Moiz, I've checking out mod_pocketshinx against other asr's on Windows with the same hardware.? No matter what settings one tries, mod_pocketsphinx is virtually unusable in real world scenarios.? I have used it and it works fine... I think your expectations are a bit high for it... Complex things like dictation is not what PocketSphinx is for. ?You should try linux cuz I know it works great there. One can play around with mod_pocketsphinx settings so that it picks voice up well but then there better not be any background noise either from a bad connection or just everyday sounds.? There is no other ASR out there that doesn't get pissed off at background noise or any noise for that matter... have you called AT&T and Sprint lately? ?My dogs barking in the background really send theirs into fits and they paid tons of money for it. ? It just way to sensitive and of couse you'll notice this problem most with cell phones. Same with commercial ASR, Granted the acoustical model for PocketSphinx wasn't done with any files recorded from cellphone from what I can tell. ?You can do adaptation of the acoustical model as per the Sphinx wiki to make it more accurate for your needs.... that takes time and effort but it works. If you adjust the settings to try blocking out background noise you'll find you don't suceed all that well and then there are problems picking up the callers voice. Those settings are for telling when the person stopped talking... nothing more. It looks like some kind of signal pre-processing is required that isn't in place yet but we all know that this is a work-in progress. I'm not working on it... I run the pizza demo with PS and it works from my polycom rather well I would say it gets some things wrong but it does score them low so you can verify it in your scripts. I don't know if esl would make any difference. To use FS and an ASR/TTS I just bridge calls to another ASR application for now.? Mark Brian West brian@freeswitch.org -- Meet us at ClueCon! ?http://www.cluecon.com = _______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Wasn't aware Sphinx 3 was integrated into FreeSWITCH ... /b On May 4, 2009, at 12:00 PM, mszlazak@aol.com wrote:
BTW Brian,
Here is something that would make FS's VAD much better. The technique also improved Sphinx-3 performance in low-SNR enviroments and made it run over 40% faster.
http://figment.cse.usf.edu/~sfefilat/data/papers/WeBT5.3.pdf
Mark.
Brian West brian@freeswitch.org -- Meet us at ClueCon! http://www.cluecon.com
Nope it isn't but does that make a difference if pocketsphinx could use a similar upgrade? Anyway, you now have a way to make VAD better in FS. -----Original Message----- From: Brian West <brian@freeswitch.org> To: freeswitch-users@lists.freeswitch.org Sent: Mon, 4 May 2009 10:29 am Subject: Re: [Freeswitch-users] Ways of Integrating Sphinx... Wasn't aware Sphinx 3 was integrated into FreeSWITCH ...? /b On May 4, 2009, at 12:00 PM, mszlazak@aol.com wrote: BTW Brian, Here is something that would make FS's VAD much better. The technique also improved Sphinx-3 performance in low-SNR enviroments and made it run over 40% faster. http://figment.cse.usf.edu/~sfefilat/data/papers/WeBT5.3.pdf Mark. Brian West brian@freeswitch.org -- Meet us at ClueCon! ?http://www.cluecon.com = _______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
VAD isn't really high on my list right now. /b On May 4, 2009, at 12:46 PM, mszlazak@aol.com wrote:
Nope it isn't but does that make a difference if pocketsphinx could use a similar upgrade? Anyway, you now have a way to make VAD better in FS.
Brian West brian@freeswitch.org -- Meet us at ClueCon! http://www.cluecon.com
Hi, maybe things in speex should be worth to look for too. Just my 2 cents... Regards, Tamas ps: It seems, VAD+DTX in mod_speex does not work. Brian West írta:
VAD isn't really high on my list right now.
/b
On May 4, 2009, at 12:46 PM, mszlazak@aol.com <mailto:mszlazak@aol.com> wrote:
Nope it isn't but does that make a difference if pocketsphinx could use a similar upgrade? Anyway, you now have a way to make VAD better in FS.
Brian West brian@freeswitch.org <mailto:brian@freeswitch.org>
-- Meet us at ClueCon! http://www.cluecon.com <http://www.cluecon.com/>
------------------------------------------------------------------------
_______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
No problem but at least this reference could be used in the future. -----Original Message----- From: Brian West <brian@freeswitch.org> To: freeswitch-users@lists.freeswitch.org Sent: Mon, 4 May 2009 10:56 am Subject: Re: [Freeswitch-users] Ways of Integrating Sphinx... VAD isn't really high on my list right now. /b On May 4, 2009, at 12:46 PM, mszlazak@aol.com wrote: Nope it isn't but does that make a difference if pocketsphinx could use a similar upgrade? Anyway, you now have a way to make VAD better in FS. Brian West brian@freeswitch.org -- Meet us at ClueCon! ?http://www.cluecon.com = _______________________________________________ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
participants (4)
-
Brian West
-
Moiz Chinoy
-
mszlazak＠aol.com
-
Tamas