[Freeswitch-dev] About video broadcasting
Hi I am a researcher in dialog system field. We built a system using Freeswitch as the front to collect conversation videos. I have a question about the Freeswitch video recording component. Freeswitch streams the video and saves it incrementally. I need to extract the head position of the human in the video in real time. I have a head tracker that can access the video stream from a webcam and process the video stream from the webcam in real time. But I am not sure how to stream the incrementally recorded video from Freeswitch to my head tracker. Could Freeswitch broadcast the video to somewhere else? Or Could you point me to where I can modify Freeswitch to integrate my head tracker in? Another small question is can the audio be broadcast the same way? Thanks a lot! -- Best Wishes Zhou Yu http://www.cs.cmu.edu/~zhouyu/ Language Technology Institute School of Computer Science Carnegie Mellon University
Take a look at mod_cv for an example of a module that interacts with the video real time. That module has access to the individual raw video frames. This approach probably makes the most sense for real time integration. Do you need to actually stream realtime, or are you looking to integrate to a library to handle real time? Very interested in this, sounds like a cool application.
On May 24, 2016, at 4:46 PM, zhou Yu <zhouyu@cs.cmu.edu> wrote:
Hi I am a researcher in dialog system field. We built a system using Freeswitch as the front to collect conversation videos. I have a question about the Freeswitch video recording component. Freeswitch streams the video and saves it incrementally. I need to extract the head position of the human in the video in real time. I have a head tracker that can access the video stream from a webcam and process the video stream from the webcam in real time. But I am not sure how to stream the incrementally recorded video from Freeswitch to my head tracker. Could Freeswitch broadcast the video to somewhere else? Or Could you point me to where I can modify Freeswitch to integrate my head tracker in?
Another small question is can the audio be broadcast the same way? Thanks a lot!
-- Best Wishes Zhou Yu http://www.cs.cmu.edu/~zhouyu/ <http://www.cs.cmu.edu/~zhouyu/> Language Technology Institute School of Computer Science Carnegie Mellon University
Hi Michael I am using a library to process the video in real time to get some info of the video. Thanks a lot! -zhou On Tue, May 24, 2016 at 2:17 PM, Michael Jerris <mike@jerris.com> wrote:
Take a look at mod_cv for an example of a module that interacts with the video real time. That module has access to the individual raw video frames. This approach probably makes the most sense for real time integration. Do you need to actually stream realtime, or are you looking to integrate to a library to handle real time? Very interested in this, sounds like a cool application.
On May 24, 2016, at 4:46 PM, zhou Yu <zhouyu@cs.cmu.edu> wrote:
Hi I am a researcher in dialog system field. We built a system using Freeswitch as the front to collect conversation videos. I have a question about the Freeswitch video recording component. Freeswitch streams the video and saves it incrementally. I need to extract the head position of the human in the video in real time. I have a head tracker that can access the video stream from a webcam and process the video stream from the webcam in real time. But I am not sure how to stream the incrementally recorded video from Freeswitch to my head tracker. Could Freeswitch broadcast the video to somewhere else? Or Could you point me to where I can modify Freeswitch to integrate my head tracker in?
Another small question is can the audio be broadcast the same way? Thanks a lot!
-- Best Wishes Zhou Yu http://www.cs.cmu.edu/~zhouyu/ Language Technology Institute School of Computer Science Carnegie Mellon University
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-dev mailing list FreeSWITCH-dev@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-dev UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-dev http://www.freeswitch.org
-- Best Wishes Zhou Yu http://www.cs.cmu.edu/~zhouyu/ Language Technology Institute School of Computer Science Carnegie Mellon University
I would look at how we interface in mod_cv as a basis for integrating then for sure. if you need help figuring out the interface, feel free to track me down on hipchat and I can help point you to examples. On Tuesday, May 24, 2016, zhou Yu <zhouyu@cs.cmu.edu> wrote:
Hi Michael I am using a library to process the video in real time to get some info of the video. Thanks a lot! -zhou
On Tue, May 24, 2016 at 2:17 PM, Michael Jerris <mike@jerris.com <javascript:_e(%7B%7D,'cvml','mike@jerris.com');>> wrote:
Take a look at mod_cv for an example of a module that interacts with the video real time. That module has access to the individual raw video frames. This approach probably makes the most sense for real time integration. Do you need to actually stream realtime, or are you looking to integrate to a library to handle real time? Very interested in this, sounds like a cool application.
On May 24, 2016, at 4:46 PM, zhou Yu <zhouyu@cs.cmu.edu <javascript:_e(%7B%7D,'cvml','zhouyu@cs.cmu.edu');>> wrote:
Hi I am a researcher in dialog system field. We built a system using Freeswitch as the front to collect conversation videos. I have a question about the Freeswitch video recording component. Freeswitch streams the video and saves it incrementally. I need to extract the head position of the human in the video in real time. I have a head tracker that can access the video stream from a webcam and process the video stream from the webcam in real time. But I am not sure how to stream the incrementally recorded video from Freeswitch to my head tracker. Could Freeswitch broadcast the video to somewhere else? Or Could you point me to where I can modify Freeswitch to integrate my head tracker in?
Another small question is can the audio be broadcast the same way? Thanks a lot!
-- Best Wishes Zhou Yu http://www.cs.cmu.edu/~zhouyu/ Language Technology Institute School of Computer Science Carnegie Mellon University
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <javascript:_e(%7B%7D,'cvml','consulting@freeswitch.org');> http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-dev mailing list FreeSWITCH-dev@lists.freeswitch.org <javascript:_e(%7B%7D,'cvml','FreeSWITCH-dev@lists.freeswitch.org');> http://lists.freeswitch.org/mailman/listinfo/freeswitch-dev UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-dev http://www.freeswitch.org
-- Best Wishes Zhou Yu http://www.cs.cmu.edu/~zhouyu/ Language Technology Institute School of Computer Science Carnegie Mellon University
Thanks a lot Michael.My coworker Dmytro, cced in the email will try to contact you. -zhou On Tue, May 24, 2016 at 10:05 PM, Michael Jerris <mike@jerris.com> wrote:
I would look at how we interface in mod_cv as a basis for integrating then for sure. if you need help figuring out the interface, feel free to track me down on hipchat and I can help point you to examples.
On Tuesday, May 24, 2016, zhou Yu <zhouyu@cs.cmu.edu> wrote:
Hi Michael I am using a library to process the video in real time to get some info of the video. Thanks a lot! -zhou
On Tue, May 24, 2016 at 2:17 PM, Michael Jerris <mike@jerris.com> wrote:
Take a look at mod_cv for an example of a module that interacts with the video real time. That module has access to the individual raw video frames. This approach probably makes the most sense for real time integration. Do you need to actually stream realtime, or are you looking to integrate to a library to handle real time? Very interested in this, sounds like a cool application.
On May 24, 2016, at 4:46 PM, zhou Yu <zhouyu@cs.cmu.edu> wrote:
Hi I am a researcher in dialog system field. We built a system using Freeswitch as the front to collect conversation videos. I have a question about the Freeswitch video recording component. Freeswitch streams the video and saves it incrementally. I need to extract the head position of the human in the video in real time. I have a head tracker that can access the video stream from a webcam and process the video stream from the webcam in real time. But I am not sure how to stream the incrementally recorded video from Freeswitch to my head tracker. Could Freeswitch broadcast the video to somewhere else? Or Could you point me to where I can modify Freeswitch to integrate my head tracker in?
Another small question is can the audio be broadcast the same way? Thanks a lot!
-- Best Wishes Zhou Yu http://www.cs.cmu.edu/~zhouyu/ Language Technology Institute School of Computer Science Carnegie Mellon University
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-dev mailing list FreeSWITCH-dev@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-dev UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-dev http://www.freeswitch.org
-- Best Wishes Zhou Yu http://www.cs.cmu.edu/~zhouyu/ Language Technology Institute School of Computer Science Carnegie Mellon University
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-dev mailing list FreeSWITCH-dev@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-dev UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-dev http://www.freeswitch.org
-- Best Wishes Zhou Yu http://www.cs.cmu.edu/~zhouyu/ Language Technology Institute School of Computer Science Carnegie Mellon University
Maybe you want to come discuss what you are doing at our FreeSWITCH Conference this summer? On Wed, May 25, 2016 at 12:05 AM, Michael Jerris <mike@jerris.com> wrote:
I would look at how we interface in mod_cv as a basis for integrating then for sure. if you need help figuring out the interface, feel free to track me down on hipchat and I can help point you to examples.
On Tuesday, May 24, 2016, zhou Yu <zhouyu@cs.cmu.edu> wrote:
Hi Michael I am using a library to process the video in real time to get some info of the video. Thanks a lot! -zhou
On Tue, May 24, 2016 at 2:17 PM, Michael Jerris <mike@jerris.com> wrote:
Take a look at mod_cv for an example of a module that interacts with the video real time. That module has access to the individual raw video frames. This approach probably makes the most sense for real time integration. Do you need to actually stream realtime, or are you looking to integrate to a library to handle real time? Very interested in this, sounds like a cool application.
On May 24, 2016, at 4:46 PM, zhou Yu <zhouyu@cs.cmu.edu> wrote:
Hi I am a researcher in dialog system field. We built a system using Freeswitch as the front to collect conversation videos. I have a question about the Freeswitch video recording component. Freeswitch streams the video and saves it incrementally. I need to extract the head position of the human in the video in real time. I have a head tracker that can access the video stream from a webcam and process the video stream from the webcam in real time. But I am not sure how to stream the incrementally recorded video from Freeswitch to my head tracker. Could Freeswitch broadcast the video to somewhere else? Or Could you point me to where I can modify Freeswitch to integrate my head tracker in?
Another small question is can the audio be broadcast the same way? Thanks a lot!
-- Best Wishes Zhou Yu http://www.cs.cmu.edu/~zhouyu/ Language Technology Institute School of Computer Science Carnegie Mellon University
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-dev mailing list FreeSWITCH-dev@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-dev UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-dev http://www.freeswitch.org
-- Best Wishes Zhou Yu http://www.cs.cmu.edu/~zhouyu/ Language Technology Institute School of Computer Science Carnegie Mellon University
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-dev mailing list FreeSWITCH-dev@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-dev UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-dev http://www.freeswitch.org
-- Anthony Minessale II ♬ @anthmfs ♬ @FreeSWITCH ♬ ☞ http://freeswitch.org/ ☞ http://cluecon.com/ ☞ http://twitter.com/FreeSWITCH ☞ irc.freenode.net #freeswitch ☞ *http://freeswitch.org/g+ <http://freeswitch.org/g+>* ClueCon Weekly Development Call ☎ sip:888@conference.freeswitch.org ☎ +19193869900 https://www.youtube.com/watch?v=9XXgW34t40s https://www.youtube.com/watch?v=NLaDpGQuZDA
that sounds interesting let me talk to my other team mates about this! Zhou On Friday, May 27, 2016, Anthony Minessale <anthony.minessale@gmail.com> wrote:
Maybe you want to come discuss what you are doing at our FreeSWITCH Conference this summer?
On Wed, May 25, 2016 at 12:05 AM, Michael Jerris <mike@jerris.com <javascript:_e(%7B%7D,'cvml','mike@jerris.com');>> wrote:
I would look at how we interface in mod_cv as a basis for integrating then for sure. if you need help figuring out the interface, feel free to track me down on hipchat and I can help point you to examples.
On Tuesday, May 24, 2016, zhou Yu <zhouyu@cs.cmu.edu <javascript:_e(%7B%7D,'cvml','zhouyu@cs.cmu.edu');>> wrote:
Hi Michael I am using a library to process the video in real time to get some info of the video. Thanks a lot! -zhou
On Tue, May 24, 2016 at 2:17 PM, Michael Jerris <mike@jerris.com> wrote:
Take a look at mod_cv for an example of a module that interacts with the video real time. That module has access to the individual raw video frames. This approach probably makes the most sense for real time integration. Do you need to actually stream realtime, or are you looking to integrate to a library to handle real time? Very interested in this, sounds like a cool application.
On May 24, 2016, at 4:46 PM, zhou Yu <zhouyu@cs.cmu.edu> wrote:
Hi I am a researcher in dialog system field. We built a system using Freeswitch as the front to collect conversation videos. I have a question about the Freeswitch video recording component. Freeswitch streams the video and saves it incrementally. I need to extract the head position of the human in the video in real time. I have a head tracker that can access the video stream from a webcam and process the video stream from the webcam in real time. But I am not sure how to stream the incrementally recorded video from Freeswitch to my head tracker. Could Freeswitch broadcast the video to somewhere else? Or Could you point me to where I can modify Freeswitch to integrate my head tracker in?
Another small question is can the audio be broadcast the same way? Thanks a lot!
-- Best Wishes Zhou Yu http://www.cs.cmu.edu/~zhouyu/ Language Technology Institute School of Computer Science Carnegie Mellon University
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-dev mailing list FreeSWITCH-dev@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-dev UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-dev http://www.freeswitch.org
-- Best Wishes Zhou Yu http://www.cs.cmu.edu/~zhouyu/ Language Technology Institute School of Computer Science Carnegie Mellon University
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <javascript:_e(%7B%7D,'cvml','consulting@freeswitch.org');> http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-dev mailing list FreeSWITCH-dev@lists.freeswitch.org <javascript:_e(%7B%7D,'cvml','FreeSWITCH-dev@lists.freeswitch.org');> http://lists.freeswitch.org/mailman/listinfo/freeswitch-dev UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-dev http://www.freeswitch.org
-- Anthony Minessale II ♬ @anthmfs ♬ @FreeSWITCH ♬
☞ http://freeswitch.org/ ☞ http://cluecon.com/ ☞ http://twitter.com/FreeSWITCH ☞ irc.freenode.net #freeswitch ☞ *http://freeswitch.org/g+ <http://freeswitch.org/g+>*
ClueCon Weekly Development Call ☎ sip:888@conference.freeswitch.org <javascript:_e(%7B%7D,'cvml','sip:888@conference.freeswitch.org');> ☎ +19193869900
https://www.youtube.com/watch?v=9XXgW34t40s https://www.youtube.com/watch?v=NLaDpGQuZDA
-- Best Wishes Zhou Yu http://www.cs.cmu.edu/~zhouyu/ Language Technology Institute School of Computer Science Carnegie Mellon University
participants (3)
-
Anthony Minessale
-
Michael Jerris
-
zhou Yu