Hi,<br><br>I am trying to setup ASR in FreeSwitch using Nuance ASR server and MRCP. Both FreeSwitch and Nuance installed on Windows Server 2003. FreeSwitch version is 1.0.3 (12567M)<br><br>I found an example in Perl at <a href="http://www.softivr.com/wiki/index.php/FreeSWITCH_MRCP_in_Perl">http://www.softivr.com/wiki/index.php/FreeSWITCH_MRCP_in_Perl</a> and decided to do the same in C#.<br>
It establishes connection with Nuance and loads the grammar, everything works fine. The next step is to capture audio from FS and tramsmit it to ASR. This can be done with unicast. We must create an outbound socket and issue "unicast" command. Here it goes:<br>
<br>private void SetupAudioTransmission()<br>{<br> EventSocket = new Socket(AddressFamily.InterNetwork, SocketType.Stream, ProtocolType.Tcp);<br> EventSocket.SendTimeout = Config.Timeout;<br> int ESPort = SearchESPort(EventSocket);<br>
<br> Thread thrESListener = new Thread(new ThreadStart(ListenerThreadStart));<br> thrESListener.Start();<br> <br> WriteLog(LogLevel.Info, "Creating outbound event socket");<br> Session.Execute("socket", "<a href="http://127.0.0.1">127.0.0.1</a>:" + ESPort); //main thread stops, listener thread listens for outbound socket connection.<br>
WriteLog(LogLevel.Info, "Outbound event socket disconnected");<br><br> EventSocket.Close();<br>}<br> <br>//here we accept outbound socket and transmit unicast command through it<br>private void ListenerThreadStart()<br>
{<br> Socket sockHandler = EventSocket.Accept();<br> WriteLog(LogLevel.Info, "Incoming connection");<br> sockHandler.Send(MessageEncoding.GetBytes("Connect\n\n"));<br> <br> WriteLog(LogLevel.Info, GetServerResponse(sockHandler));<br>
<br> int rtpPort = (RTPSocket.RemoteEndPoint as IPEndPoint).Port;<br> string command = string.Format("sendmsg\r\ncall-command: unicast\r\nlocal-ip: {0}\r\nlocal-port: {1}\r\nremote-ip: {2}\r\n" +<br> "remote-port: {3}\r\ntransport: udp\r\nflags: native\r\n\r\n", Config.LocalIP, rtpPort + 1, Config.LocalIP, rtpPort);<br>
<br> WriteLog(LogLevel.Info, command);<br><br> sockHandler.Send(MessageEncoding.GetBytes(command));<br> WriteLog(LogLevel.Info, GetServerResponse(sockHandler));<br> <br> sockHandler.Disconnect(false); <br> sockHandler.Close(); <br>
}<br><br>After this, FS writes that unicast has been created on corresponding IPs and ports. It really creates an UDP socket, but doesn't transmit any data through it. I tested it with Wireshark and from my application, nothing was detected.<br>
Also, if we specify "transport:tcp" in unicast command, it uses UDP anyway, that's strange.<br><br>Here is how I listen UDP packets.<br>private void DetectSpeech()<br>{<br> WriteLog(LogLevel.Info, "Reading audio");<br>
byte[] FSRecvBuf = new byte[2048];<br> <br> IPEndPoint epFS = new IPEndPoint(IPAddress.Loopback, (RTPSocket.RemoteEndPoint as IPEndPoint).Port);<br> FSSocket = new Socket(AddressFamily.InterNetwork, SocketType.Dgram, ProtocolType.Udp);<br>
FSSocket.ReceiveTimeout = 100000;<br> FSSocket.SendTimeout = 100000;<br> WriteLog(LogLevel.Info, "Binding socket to " + epFS.Port);<br><br> FSSocket.Bind(epFS);<br> FSSocket.Connect(new IPEndPoint(IPAddress.Loopback, epFS.Port + 1));<br>
<br> while (Session.Ready())<br> {<br> int recvCount = FSSocket.Receive(FSRecvBuf);<br> WriteLog(LogLevel.Info, "Received bytes: " + recvCount);<br> }<br>}<br><br>Can someone help me to solve this? Do I do something wrong or I forgot something or it doesn't work at all?<br>
<br>Best regards.<br>Artem<br><br>