Video with mod_conference
Hi guys, I am experimenting with mod_conference and video, I have a conference (not in video-bridge mode), I am connecting with 2 clients using SIPjs, my goal is to have video from client1 to client2. Here is what I'v tried: Assume client1 is the broadcaster while client2 is the receiver. Client1 connects to the conference first, he is floor at this point: freeswitch@internal> conference list Conference 1234-172.30.3.212 (2 members rate: 16000 flags: running|answered|enforce_min|dynamic|exit_sound|enter_sound) 1;sofia/internal/anonymous.2po4ni@anonymous.invalid ;7c8e7494-decc-11e4-93cd-2391a0614a29;anonymous.2po4ni;anonymous.2po4ni;video|floor;0;0;0;0 Now, client2 joins in, as expected, client1 is still floor: freeswitch@internal> conference list Conference 1234-172.30.3.212 (2 members rate: 16000 flags: running|answered|enforce_min|dynamic|exit_sound|enter_sound) 2;sofia/internal/anonymous.hgbmm4@anonymous.invalid ;80a2f38e-decc-11e4-93d3-2391a0614a29;anonymous.hgbmm4;anonymous.hgbmm4;video;0;0;0;0 1;sofia/internal/anonymous.2po4ni@anonymous.invalid ;7c8e7494-decc-11e4-93cd-2391a0614a29;anonymous.2po4ni;anonymous.2po4ni;video|floor;0;0;0;0 No video goes through to client2. Now, if I am setting client2 as floor and then setting back client1 as floor, video start to come in.. And just before the video starts, the log shows that client2's video DTLS handshake becomes READY: 2015-04-09 15:24:40.391590 [DEBUG] switch_core_media.c:4361 sofia/internal/anonymous.2po4ni@anonymous.invalid Video thread resumed Echo is off 2015-04-09 15:24:41.851825 [INFO] switch_rtp.c:2923 Changing video DTLS state from HANDSHAKE to SETUP 2015-04-09 15:24:41.851825 [INFO] switch_rtp.c:2831 video Fingerprint Verified. 2015-04-09 15:24:41.851825 [INFO] switch_rtp.c:3373 Activating Video Secure RTP SEND 2015-04-09 15:24:41.851825 [INFO] switch_rtp.c:3351 Activating Video Secure RTP RECV 2015-04-09 15:24:41.851825 [INFO] switch_rtp.c:2871 Changing video DTLS state from SETUP to READY In addition, even before doing the floor toggle to get the video going, I see mod_conference's video thread doing: switch_core_session_write_video_frame(imember->session, vid_frame, SWITCH_IO_FLAG_NONE, 0); on line 2991. Something in the video thread seems to delay/lock the video DTLS handshake.... Any idea? Thanks! Adam
These features are significantly better in the upcoming 1.6 version. Keep an eye out for upcoming announcements on that. I would not expect the video features to be very stable in 1.4 except for point to point passthrough with no transcoding.
On Apr 9, 2015, at 11:30 AM, Adam Ben-Ayoun <adam.ben.ayoun1@gmail.com> wrote:
Hi guys,
I am experimenting with mod_conference and video, I have a conference (not in video-bridge mode), I am connecting with 2 clients using SIPjs, my goal is to have video from client1 to client2.
Here is what I'v tried: Assume client1 is the broadcaster while client2 is the receiver. Client1 connects to the conference first, he is floor at this point: freeswitch@internal> conference list Conference 1234-172.30.3.212 (2 members rate: 16000 flags: running|answered|enforce_min|dynamic|exit_sound|enter_sound) 1;sofia/internal/anonymous.2po4ni@anonymous.invalid;7c8e7494-decc-11e4-93cd-2391a0614a29;anonymous.2po4ni;anonymous.2po4ni;video|floor;0;0;0;0
Now, client2 joins in, as expected, client1 is still floor: freeswitch@internal> conference list Conference 1234-172.30.3.212 (2 members rate: 16000 flags: running|answered|enforce_min|dynamic|exit_sound|enter_sound) 2;sofia/internal/anonymous.hgbmm4@anonymous.invalid;80a2f38e-decc-11e4-93d3-2391a0614a29;anonymous.hgbmm4;anonymous.hgbmm4;video;0;0;0;0 1;sofia/internal/anonymous.2po4ni@anonymous.invalid;7c8e7494-decc-11e4-93cd-2391a0614a29;anonymous.2po4ni;anonymous.2po4ni;video|floor;0;0;0;0
No video goes through to client2. Now, if I am setting client2 as floor and then setting back client1 as floor, video start to come in.. And just before the video starts, the log shows that client2's video DTLS handshake becomes READY: 2015-04-09 15:24:40.391590 [DEBUG] switch_core_media.c:4361 sofia/internal/anonymous.2po4ni@anonymous.invalid Video thread resumed Echo is off 2015-04-09 15:24:41.851825 [INFO] switch_rtp.c:2923 Changing video DTLS state from HANDSHAKE to SETUP 2015-04-09 15:24:41.851825 [INFO] switch_rtp.c:2831 video Fingerprint Verified. 2015-04-09 15:24:41.851825 [INFO] switch_rtp.c:3373 Activating Video Secure RTP SEND 2015-04-09 15:24:41.851825 [INFO] switch_rtp.c:3351 Activating Video Secure RTP RECV 2015-04-09 15:24:41.851825 [INFO] switch_rtp.c:2871 Changing video DTLS state from SETUP to READY
In addition, even before doing the floor toggle to get the video going, I see mod_conference's video thread doing: switch_core_session_write_video_frame(imember->session, vid_frame, SWITCH_IO_FLAG_NONE, 0); on line 2991.
Something in the video thread seems to delay/lock the video DTLS handshake....
Any idea?
Thanks! Adam
Would using mod_verto with v1.4 make any difference? On 10 April 2015 at 22:39, Michael Jerris <mike@jerris.com> wrote:
These features are significantly better in the upcoming 1.6 version. Keep an eye out for upcoming announcements on that. I would not expect the video features to be very stable in 1.4 except for point to point passthrough with no transcoding.
On Apr 9, 2015, at 11:30 AM, Adam Ben-Ayoun <adam.ben.ayoun1@gmail.com> wrote:
Hi guys,
I am experimenting with mod_conference and video, I have a conference (not in video-bridge mode), I am connecting with 2 clients using SIPjs, my goal is to have video from client1 to client2.
Here is what I'v tried: Assume client1 is the broadcaster while client2 is the receiver. Client1 connects to the conference first, he is floor at this point: freeswitch@internal> conference list Conference 1234-172.30.3.212 (2 members rate: 16000 flags: running|answered|enforce_min|dynamic|exit_sound|enter_sound) 1;sofia/internal/anonymous.2po4ni@anonymous.invalid ;7c8e7494-decc-11e4-93cd-2391a0614a29;anonymous.2po4ni;anonymous.2po4ni;video|floor;0;0;0;0
Now, client2 joins in, as expected, client1 is still floor: freeswitch@internal> conference list Conference 1234-172.30.3.212 (2 members rate: 16000 flags: running|answered|enforce_min|dynamic|exit_sound|enter_sound) 2;sofia/internal/anonymous.hgbmm4@anonymous.invalid ;80a2f38e-decc-11e4-93d3-2391a0614a29;anonymous.hgbmm4;anonymous.hgbmm4;video;0;0;0;0 1;sofia/internal/anonymous.2po4ni@anonymous.invalid ;7c8e7494-decc-11e4-93cd-2391a0614a29;anonymous.2po4ni;anonymous.2po4ni;video|floor;0;0;0;0
No video goes through to client2. Now, if I am setting client2 as floor and then setting back client1 as floor, video start to come in.. And just before the video starts, the log shows that client2's video DTLS handshake becomes READY: 2015-04-09 15:24:40.391590 [DEBUG] switch_core_media.c:4361 sofia/internal/anonymous.2po4ni@anonymous.invalid Video thread resumed Echo is off 2015-04-09 15:24:41.851825 [INFO] switch_rtp.c:2923 Changing video DTLS state from HANDSHAKE to SETUP 2015-04-09 15:24:41.851825 [INFO] switch_rtp.c:2831 video Fingerprint Verified. 2015-04-09 15:24:41.851825 [INFO] switch_rtp.c:3373 Activating Video Secure RTP SEND 2015-04-09 15:24:41.851825 [INFO] switch_rtp.c:3351 Activating Video Secure RTP RECV 2015-04-09 15:24:41.851825 [INFO] switch_rtp.c:2871 Changing video DTLS state from SETUP to READY
In addition, even before doing the floor toggle to get the video going, I see mod_conference's video thread doing: switch_core_session_write_video_frame(imember->session, vid_frame, SWITCH_IO_FLAG_NONE, 0); on line 2991.
Something in the video thread seems to delay/lock the video DTLS handshake....
Any idea?
Thanks! Adam
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Verto is a signaling protocol unique to FreeSWITCH. It would not change how the conference bridge handles video media. As Mike said, the core developers are feverishly working on perfecting the video capabilities of FreeSWITCH and I suspect their efforts will go a long way toward helping you achieve your goal. I don’t know any more than that, but I have seen a glimpse of it and it is substantially better than before. Bote From: Adam Ben-Ayoun Sent: Friday, 10 April, 2015 16:45 Subject: Re: [Freeswitch-users] Video with mod_conference Would using mod_verto with v1.4 make any difference? On 10 April 2015 at 22:39, Michael Jerris <mike@jerris.com> wrote: These features are significantly better in the upcoming 1.6 version. Keep an eye out for upcoming announcements on that. I would not expect the video features to be very stable in 1.4 except for point to point passthrough with no transcoding.
On Apr 9, 2015, at 11:30 AM, Adam Ben-Ayoun <adam.ben.ayoun1@gmail.com> wrote:
Hi guys,
I am experimenting with mod_conference and video, I have a conference (not in video-bridge mode), I am connecting with 2 clients using SIPjs, my goal is to have video from client1 to client2.
Here is what I'v tried:
participants (3)
-
Adam Ben-Ayoun
-
Bote Man
-
Michael Jerris