[Freeswitch-users] play_and_detect_speech not working

21 Apr 2015

      Hello,

I am trying to run play_and_detect_speech for async playing and listening. The console doesn't show any errors but neither a soundfile nor speech will be played to the client.
Can anyone confirm that play_and_detect_speech is still working and give a valid example?

Here is my Extension:

<include>
<extension name="play_and_detect_speech example">
  <condition field="destination_number" expression="^(414)$">

     <action application="answer"/>
            <action application="set" data="tts_engine=unimrcp"/>
            <action application="set" data="tts_voice=donna"/>

<action application="log" data="INFO PLAY AND DETECT SPEECH"/>
 <action application="play_and_detect_speech" data="ivr/test.wavdetect:unimrcp {start-input-timers=false,no-input timeout=5000,recognition-timeout=5000}builtin:grammar/boolean?language=en-US;y=1;n=2"/> 
<action application="log" data="INFO !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!"/>
<action application="log" data="CRIT ${detect_speech_result}"/> 

</condition>
</extension>
</include>

Freeswitch console output:

FreeSWITCH Started
Max Sessions [1000]
Session Rate [30]
SQL [Enabled]
2015-04-21 13:45:03.542985 [CONSOLE] switch_core.c:2238 
[This app Best viewed at 160x60 or more..]
freeswitch@debian-queuex> 2015-04-21 13:45:03.551482 [INFO] switch_time.c:607 Clock synchronized to system time.
2015-04-21 13:45:18.032188 [CONSOLE] mod_voicemail.c:4066 Event Thread Started
2015-04-21 13:45:26.392280 [NOTICE] switch_channel.c:1055 New Channel sofia/internal/queuex_user1@10.1.11.115 [e6ed7d96-e81b-11e4-ac47-a729e6b18938]
2015-04-21 13:45:26.412163 [INFO] mod_dialplan_xml.c:635 Processing GDWOMSLK <queuex_user1>->414 in context default
2015-04-21 13:45:26.432225 [INFO] switch_core_media.c:5364 Activating RTCP PORT 4117
2015-04-21 13:45:26.432225 [NOTICE] sofia_media.c:92 Pre-Answer sofia/internal/queuex_user1@10.1.11.115!
2015-04-21 13:45:26.432225 [NOTICE] mod_dptools.c:1268 Channel [sofia/internal/queuex_user1@10.1.11.115] has been answered
2015-04-21 13:45:26.432225 [INFO] mod_dptools.c:1638 PLAY AND DETECT SPEECH
2015-04-21 13:45:26.432225 [INFO] mod_unimrcp.c:3129 asr_handle: name = unimrcp, codec = (null), rate = 8000, grammar = (null), param = (null)
2015-04-21 13:45:26.432225 [INFO] mod_unimrcp.c:3131 codec = L16, rate = 8000, dest = (null)
2015-04-21 13:45:26.432225 [NOTICE] mrcp_application.c:96 (ASR-0) Create MRCP Handle 0x837cbc0 [unimrcpserver-mrcp1]
2015-04-21 13:45:26.432225 [INFO] mrcp_client_session.c:133 (ASR-0) Create Channel ASR-0 <new>
2015-04-21 13:45:26.432225 [INFO] mrcp_client_session.c:387 (ASR-0) Receive App Request ASR-0 <new> [2]
2015-04-21 13:45:26.432225 [NOTICE] rtsp_client.c:298 () Create RTSP Handle 0x837ebc8
2015-04-21 13:45:26.432225 [INFO] mrcp_client.c:700 (ASR-0) Add MRCP Handle ASR-0 <new>
2015-04-21 13:45:26.432225 [NOTICE] mrcp_client_session.c:719 (ASR-0) Add Control Channel ASR-0 <new@speechrecog>
2015-04-21 13:45:26.451886 [INFO] mrcp_client_session.c:411 (ASR-0) Send Offer ASR-0 <new> [c:0 a:1 v:0] to 127.0.1.1:1554
2015-04-21 13:45:26.451886 [NOTICE] rtsp_client.c:374 () Established RTSP Connection 127.0.0.1:41506 <-> 127.0.1.1:1554
2015-04-21 13:45:26.451886 [INFO] rtsp_client.c:573 () Add RTSP Handle 0x837ebc8
2015-04-21 13:45:26.451886 [INFO] rtsp_client.c:839 () Send RTSP Data 127.0.0.1:41506 <-> 127.0.1.1:1554 [347 bytes]
SETUP rtsp://127.0.1.1:1554/speechrecognizer RTSP/1.0
CSeq: 1
Transport: RTP/AVP;unicast;client_port=4000-4001
Content-Type: application/sdp
Content-Length: 179

v=0
o=FreeSWITCH 0 0 IN IP4 127.0.1.1
s=-
c=IN IP4 127.0.1.1
t=0 0
m=audio 4000 RTP/AVP 0 8 96
a=rtpmap:0 PCMU/8000
a=rtpmap:8 PCMA/8000
a=rtpmap:96 L16/8000
a=sendonly

2015-04-21 13:45:26.451886 [INFO] rtsp_client.c:526 () Push RTSP Request to In-Progress Queue 0x837ebc8 <new> CSeq:1
2015-04-21 13:45:26.451886 [INFO] rtsp_client.c:937 () Receive RTSP Data 127.0.0.1:41506 <-> 127.0.1.1:1554 [312 bytes]
RTSP/1.0 200 OK
CSeq: 1
Transport: RTP/AVP;unicast;client_port=4000-4001;server_port=5008-5009
Session: e6f516a0e81b11e4
Content-Type: application/sdp
Content-Length: 133

v=0
o=UniMRCPServer 0 0 IN IP4 127.0.1.1
s=-
c=IN IP4 127.0.1.1
t=0 0
m=audio 5008 RTP/AVP 0
a=rtpmap:0 PCMU/8000
a=recvonly

2015-04-21 13:45:26.451886 [INFO] rtsp_client.c:551 () Pop In-Progress RTSP Request 0x837ebc8 CSeq:1
2015-04-21 13:45:26.451886 [INFO] rtsp_client.c:688 () Add RTSP Session 0x837ebc8 <e6f516a0e81b11e4>
2015-04-21 13:45:26.451886 [INFO] mrcp_client_session.c:151 (ASR-0) Receive Answer ASR-0 <e6f516a0e81b11e4> [c:0 a:1 v:0] Status 200
2015-04-21 13:45:26.451886 [INFO] mpf_rtp_stream.c:331 () Enable RTP Session 127.0.1.1:4000
2015-04-21 13:45:26.451886 [INFO] mpf_rtp_stream.c:921 () Open RTP Transmitter 127.0.1.1:4000 -> 127.0.1.1:5008
2015-04-21 13:45:26.451886 [INFO] mpf_bridge.c:93 () Media Path ASR-0 Source->[LPCM/8000/1]->Bridge->[LPCM/8000/1]->Encoder->[PCMU/8000/1]->Sink
2015-04-21 13:45:26.451886 [INFO] mrcp_client_session.c:455 (ASR-0) Raise App Response ASR-0 <e6f516a0e81b11e4> [2] SUCCESS [0]
2015-04-21 13:45:26.451886 [INFO] mrcp_client_session.c:392 (ASR-0) Receive App MRCP Request ASR-0 <e6f516a0e81b11e4>
2015-04-21 13:45:26.451886 [INFO] mrcp_client_session.c:622 (ASR-0) Send MRCP Request ASR-0 <e6f516a0e81b11e4@speechrecog> [1]
2015-04-21 13:45:26.451886 [INFO] rtsp_client.c:839 () Send RTSP Data 127.0.0.1:41506 <-> 127.0.1.1:1554 [378 bytes]
ANNOUNCE rtsp://127.0.1.1:1554/speechrecognizer RTSP/1.0
CSeq: 2
Session: e6f516a0e81b11e4
Content-Type: application/mrcp
Content-Length: 229

RECOGNIZE 1 MRCP/1.0
Content-Type: text/uri-list
Recognition-Timeout: 5000
Recognizer-Start-Timers: false
Vendor-Specific-Parameters: no-input timeout=5000
Content-Length: 46

builtin:grammar/boolean?language=en-US;y=1;n=2
2015-04-21 13:45:26.451886 [INFO] rtsp_client.c:526 () Push RTSP Request to In-Progress Queue 0x837ebc8 <e6f516a0e81b11e4> CSeq:2
2015-04-21 13:45:26.451886 [INFO] rtsp_client.c:937 () Receive RTSP Data 127.0.0.1:41506 <-> 127.0.1.1:1554 [137 bytes]
RTSP/1.0 200 OK
CSeq: 2
Session: e6f516a0e81b11e4
Content-Type: application/mrcp
Content-Length: 30

MRCP/1.0 1 200 IN-PROGRESS

2015-04-21 13:45:26.451886 [INFO] rtsp_client.c:551 () Pop In-Progress RTSP Request 0x837ebc8 CSeq:2
2015-04-21 13:45:26.451886 [INFO] mrcp_client_session.c:500 (ASR-0) Raise App MRCP Response ASR-0 <e6f516a0e81b11e4>
2015-04-21 13:45:26.451886 [WARNING] switch_core_file.c:230 File has 2 channels, muxing to 1 channel will occur.
2015-04-21 13:45:26.531882 [WARNING] sofia.c:5692 Ping succeeded sipgate with code 200 - count 1/1/1, state UP
2015-04-21 13:45:26.872152 [INFO] rtsp_client.c:937 () Receive RTSP Data 127.0.0.1:41506 <-> 127.0.1.1:1554 [190 bytes]
ANNOUNCE rtsp://127.0.1.1:1554/speechrecognizer RTSP/1.0
CSeq: 2
Session: e6f516a0e81b11e4
Content-Type: application/mrcp
Content-Length: 42

START-OF-SPEECH 1 IN-PROGRESS MRCP/1.0

2015-04-21 13:45:26.872152 [INFO] rtsp_client.c:839 () Send RTSP Data 127.0.0.1:41506 <-> 127.0.1.1:1554 [55 bytes]
RTSP/1.0 200 OK
CSeq: 2
Session: e6f516a0e81b11e4

2015-04-21 13:45:26.872152 [INFO] mrcp_client_session.c:516 (ASR-0) Raise App MRCP Event ASR-0 <e6f516a0e81b11e4>
2015-04-21 13:45:26.891692 [INFO] switch_ivr_async.c:3884 (sofia/internal/queuex_user1@10.1.11.115) START OF SPEECH
2015-04-21 13:45:26.891692 [INFO] switch_ivr_async.c:3943 (sofia/internal/queuex_user1@10.1.11.115) WAITING FOR RESULT
2015-04-21 13:45:35.692016 [NOTICE] switch_rtp.c:5185 Receiving an RTCP packet[2015-21-03 11:45:35.700029] SSRC[723361390]RTT[0.013550] A[3068113717] - DLSR[273063] - LSR[3067839766]
2015-04-21 13:45:40.312178 [NOTICE] switch_rtp.c:5185 Receiving an RTCP packet[2015-21-03 11:45:40.320207] SSRC[723361390]RTT[0.013275] A[3068416505] - DLSR[248184] - LSR[3068167451]
2015-04-21 13:45:44.932184 [NOTICE] switch_rtp.c:5185 Receiving an RTCP packet[2015-21-03 11:45:44.939794] SSRC[723361390]RTT[0.012268] A[3068719254] - DLSR[223320] - LSR[3068495130]
2015-04-21 13:45:49.551974 [NOTICE] switch_rtp.c:5185 Receiving an RTCP packet[2015-21-03 11:45:49.559918] SSRC[723361390]RTT[0.010956] A[3069022038] - DLSR[198496] - LSR[3068822824]
2015-04-21 13:45:54.171909 [NOTICE] switch_rtp.c:5185 Receiving an RTCP packet[2015-21-03 11:45:54.180123] SSRC[723361390]RTT[0.010818] A[3069324828] - DLSR[173622] - LSR[3069150497]
2015-04-21 13:45:58.791859 [NOTICE] switch_rtp.c:5185 Receiving an RTCP packet[2015-21-03 11:45:58.800101] SSRC[723361390]RTT[0.010559] A[3069627603] - DLSR[148737] - LSR[3069478174]
2015-04-21 13:46:03.411703 [NOTICE] switch_rtp.c:5185 Receiving an RTCP packet[2015-21-03 11:46:03.420106] SSRC[723361390]RTT[0.010025] A[3069930380] - DLSR[123880] - LSR[3069805843]
2015-04-21 13:46:08.031655 [NOTICE] switch_rtp.c:5185 Receiving an RTCP packet[2015-21-03 11:46:08.39750] SSRC[723361390]RTT[0.008957] A[3070233133] - DLSR[99038] - LSR[3070133508]
2015-04-21 13:46:12.651812 [NOTICE] switch_rtp.c:5185 Receiving an RTCP packet[2015-21-03 11:46:12.660125] SSRC[723361390]RTT[0.008652] A[3070535933] - DLSR[74161] - LSR[3070461205]
2015-04-21 13:46:17.271783 [NOTICE] switch_rtp.c:5185 Receiving an RTCP packet[2015-21-03 11:46:17.280116] SSRC[723361390]RTT[0.008118] A[3070838709] - DLSR[49271] - LSR[3070788906]
2015-04-21 13:46:21.891722 [NOTICE] switch_rtp.c:5185 Receiving an RTCP packet[2015-21-03 11:46:21.900002] SSRC[723361390]RTT[0.007355] A[3071141478] - DLSR[24416] - LSR[3071116580]
2015-04-21 13:46:26.511739 [NOTICE] switch_rtp.c:5185 Receiving an RTCP packet[2015-21-03 11:46:26.520157] SSRC[723361390]RTT[0.006851] A[3071444265] - DLSR[327236] - LSR[3071116580]
2015-04-21 13:46:31.132034 [NOTICE] switch_rtp.c:5185 Receiving an RTCP packet[2015-21-03 11:46:31.139830] SSRC[723361390]RTT[0.005707] A[3071747019] - DLSR[302385] - LSR[3071444260]
2015-04-21 13:46:34.811605 [NOTICE] sofia.c:952 Hangup sofia/internal/queuex_user1@10.1.11.115 [CS_EXECUTE] [NORMAL_CLEARING]
2015-04-21 13:46:34.811605 [INFO] mrcp_client_session.c:392 (ASR-0) Receive App MRCP Request ASR-0 <e6f516a0e81b11e4>
2015-04-21 13:46:34.811605 [INFO] mrcp_client_session.c:622 (ASR-0) Send MRCP Request ASR-0 <e6f516a0e81b11e4@speechrecog> [2]
2015-04-21 13:46:34.811605 [INFO] rtsp_client.c:839 () Send RTSP Data 127.0.0.1:41506 <-> 127.0.1.1:1554 [167 bytes]
ANNOUNCE rtsp://127.0.1.1:1554/speechrecognizer RTSP/1.0
CSeq: 3
Session: e6f516a0e81b11e4
Content-Type: application/mrcp
Content-Length: 19

STOP 2 MRCP/1.0

2015-04-21 13:46:34.811605 [INFO] rtsp_client.c:526 () Push RTSP Request to In-Progress Queue 0x837ebc8 <e6f516a0e81b11e4> CSeq:3
2015-04-21 13:46:34.811605 [INFO] rtsp_client.c:937 () Receive RTSP Data 127.0.0.1:41506 <-> 127.0.1.1:1554 [170 bytes]
RTSP/1.0 200 OK
CSeq: 3
Session: e6f516a0e81b11e4
Content-Type: application/mrcp
Content-Length: 63

MRCP/1.0 2 200 COMPLETE
Active-Request-Id-List: 1
2015-04-21 13:46:34.811605 [INFO] rtsp_client.c:551 () Pop In-Progress RTSP Request 0x837ebc8 CSeq:3
2015-04-21 13:46:34.811605 [INFO] mrcp_client_session.c:500 (ASR-0) Raise App MRCP Response ASR-0 <e6f516a0e81b11e4>
2015-04-21 13:46:34.811605 [INFO] mrcp_client_session.c:387 (ASR-0) Receive App Request ASR-0 <e6f516a0e81b11e4> [1]
2015-04-21 13:46:34.811605 [INFO] mrcp_client_session.c:833 (ASR-0) Terminate Session ASR-0 <e6f516a0e81b11e4>
2015-04-21 13:46:34.811605 [INFO] rtsp_client.c:839 () Send RTSP Data 127.0.0.1:41506 <-> 127.0.1.1:1554 [96 bytes]
TEARDOWN rtsp://127.0.1.1:1554/speechrecognizer RTSP/1.0
CSeq: 4
Session: e6f516a0e81b11e4

2015-04-21 13:46:34.811605 [INFO] rtsp_client.c:526 () Push RTSP Request to In-Progress Queue 0x837ebc8 <e6f516a0e81b11e4> CSeq:4
2015-04-21 13:46:34.831763 [INFO] mpf_rtp_stream.c:935 () Close RTP Transmitter 127.0.1.1:4000 -> 127.0.1.1:5008 [s:3418 o:546880]
2015-04-21 13:46:34.831763 [INFO] mpf_rtp_stream.c:418 () Remove RTP Session 127.0.1.1:4000
2015-04-21 13:46:34.831763 [INFO] rtsp_client.c:937 () Receive RTSP Data 127.0.0.1:41506 <-> 127.0.1.1:1554 [55 bytes]
RTSP/1.0 200 OK
CSeq: 4
Session: e6f516a0e81b11e4

2015-04-21 13:46:34.831763 [INFO] rtsp_client.c:551 () Pop In-Progress RTSP Request 0x837ebc8 CSeq:4
2015-04-21 13:46:34.831763 [INFO] rtsp_client.c:706 () Remove RTSP Session 0x837ebc8 <e6f516a0e81b11e4>
2015-04-21 13:46:34.831763 [INFO] rtsp_client.c:442 () Remove RTSP Handle 0x837ebc8
2015-04-21 13:46:34.831763 [NOTICE] rtsp_client.c:305 () Destroy RTSP Handle 0x837ebc8
2015-04-21 13:46:34.831763 [INFO] rtsp_client.c:382 () Close RTSP Connection 127.0.0.1:41506 <-> 127.0.1.1:1554
2015-04-21 13:46:34.831763 [NOTICE] rtsp_client.c:432 () Destroy RTSP Connection 127.0.0.1:41506 <-> 127.0.1.1:1554
2015-04-21 13:46:34.831763 [INFO] mrcp_client_session.c:209 (ASR-0) Session Terminated ASR-0 <e6f516a0e81b11e4>
2015-04-21 13:46:34.831763 [INFO] mrcp_client.c:710 (ASR-0) Remove MRCP Handle ASR-0 <e6f516a0e81b11e4>
2015-04-21 13:46:34.831763 [INFO] mrcp_client_session.c:455 (ASR-0) Raise App Response ASR-0 <e6f516a0e81b11e4> [1] SUCCESS [0]
2015-04-21 13:46:34.831763 [NOTICE] mrcp_application.c:182 (ASR-0) Destroy MRCP Handle ASR-0
2015-04-21 13:46:34.831763 [NOTICE] switch_core_session.c:1641 Session 1 (sofia/internal/queuex_user1@10.1.11.115) Ended
2015-04-21 13:46:34.831763 [NOTICE] switch_core_session.c:1645 Close Channel sofia/internal/queuex_user1@10.1.11.115 [CS_DESTROY]

Freundliche Grüße,
Bemigho Eyimofe
Softwareentwickler

. Netempire AG | Lüghauser Straße 16 | D - 51503 Rösrath
. Fon: 0221 99 11 12 - 22 | Fax: 0221 99 11 12 - 99
. mailto:bee@netempire.de <mailto:bee@netempire.de> | http://www.netempire.de <http://www.netempire.de/>
__________________________________________________________

. Vorstandsvorsitzender: Andreas Nettesheim
. Vorstand: Dr. Guido Gimmler | Johannes Krause | Kim Bauer
. Vorsitzender des Aufsichtsrates: Dr. Dierk Wehrmeister

. Handelsregister: Amtsgericht Köln, HRB 35407
. USt-IdNr.: DE 215404683
__________________________________________________________